-- Logs begin at Thu 2022-06-02 18:13:20 UTC, end at Thu 2022-06-02 19:47:34 UTC. -- Jun 02 18:52:23.041136 dv-cinder-797608-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 18:52:23.050257 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 18:52:23 2022] *** Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: nodename: dv-cinder-797608-28-iscsi Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: machine: x86_64 Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: clock source: unix Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: pcre jit disabled Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: detected number of CPU cores: 4 Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: current working directory: / Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: detected binary path: /usr/bin/uwsgi-core Jun 02 18:52:23.052270 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: your processes number limit is 47680 Jun 02 18:52:23.053091 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: your memory page size is 4096 bytes Jun 02 18:52:23.053091 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: detected max file descriptor number: 2048 Jun 02 18:52:23.053091 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: lock engine: pthread robust mutexes Jun 02 18:52:23.053091 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: thunder lock: enabled Jun 02 18:52:23.053091 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 18:52:23.053091 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 18:52:23.096741 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: Python main interpreter initialized at 0x561fd55ca9c0 Jun 02 18:52:23.096741 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: python threads support enabled Jun 02 18:52:23.096741 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: your server socket listen backlog is limited to 100 connections Jun 02 18:52:23.096741 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: your mercy for graceful operations on workers is 90 seconds Jun 02 18:52:23.097093 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 18:52:23.097093 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: *** Operational MODE: preforking *** Jun 02 18:52:23.097402 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: *** uWSGI is running in multiple interpreter mode *** Jun 02 18:52:23.097402 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: spawned uWSGI master process (pid: 103140) Jun 02 18:52:23.097601 dv-cinder-797608-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 18:52:23.100094 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: spawned uWSGI worker 1 (pid: 103141, cores: 1) Jun 02 18:52:23.100094 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: spawned uWSGI worker 2 (pid: 103142, cores: 1) Jun 02 18:52:23.100094 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 18:52:24.299285 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 18:52:24.299936 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 18:52:25.000486 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 18:52:25.000486 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: from cryptography.utils import int_from_bytes Jun 02 18:52:25.000780 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 18:52:25.000780 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: from cryptography.utils import int_from_bytes Jun 02 18:52:25.000780 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 18:52:25.000780 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: from cryptography.utils import int_from_bytes Jun 02 18:52:25.000997 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 18:52:25.000997 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: from cryptography.utils import int_from_bytes Jun 02 18:52:27.571228 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 18:52:27.571796 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 18:52:27.571997 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 18:52:27.572354 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 18:52:27.572602 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 18:52:27.572972 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.573295 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.573611 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.573954 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.574279 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.574582 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.574886 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.575196 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.575511 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.575765 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.576073 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.576389 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-28-iscsi {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.576704 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.577003 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.577308 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.577619 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.577724 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 18:52:27.578468 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.578549 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 18:52:27.578637 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.578798 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 18:52:27.578935 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.579154 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 18:52:27.579347 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.579796 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 18:52:27.579796 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.580023 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.580142 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.580255 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.580359 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.580461 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.580681 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.580855 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.581065 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.581253 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.581443 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.581593 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.581824 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.581981 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.582183 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.582371 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.582558 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.582743 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.582923 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.583067 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.583067 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.583407 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-28-iscsi {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.583591 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-28-iscsi {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.583763 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.583941 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.584156 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.584418 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.584749 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.585010 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.585158 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.585158 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.585459 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.585612 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.585741 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.585920 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.586080 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.586222 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.586343 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.586460 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.586460 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.586769 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.586937 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.587066 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.587185 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.587303 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.587433 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.587560 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.587679 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.587805 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.587944 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588073 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588225 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588354 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588474 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588606 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588727 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588853 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588980 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.588980 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.589233 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.589427 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.589551 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.589672 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.589790 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-28-iscsi {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.589944 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.590066 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.590184 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.590306 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.590432 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.590575 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.590706 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.590867 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.591017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.591138 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.591261 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.591404 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.591525 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.591717 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.591895 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.592026 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.592149 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.592287 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.592409 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.592564 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.592693 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.592887 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.593082 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.593228 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.593353 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.593474 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.593594 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.593750 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.593927 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.594088 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.594219 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.594425 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.594625 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.594760 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.594898 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.595024 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.595143 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.595376 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.595550 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.595693 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.595829 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.595963 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.596084 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.596195 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.596312 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.596529 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.596717 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.596942 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.597084 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.597084 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.597319 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.597450 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.597579 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.597699 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.597863 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.597999 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.598135 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.598265 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.598385 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.598504 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.598623 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.598822 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.599023 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.599170 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.599296 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.599438 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.599560 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.599686 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.599970 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.600247 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.600578 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.600755 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.600885 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.601211 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.601476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.601476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.601720 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.601864 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.601986 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.602125 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.602249 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.602369 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.602487 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.602707 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.602894 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.603038 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.603170 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.603294 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.603413 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.603566 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.603693 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.603899 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.604075 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.604218 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.604344 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.604465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.604591 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.604748 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.604883 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.605094 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.605271 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.605403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.605545 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.605675 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.605816 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.606009 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.606201 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.606324 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.606460 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.606592 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.606713 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.606869 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.607101 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.607235 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.607365 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.607494 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.607614 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.607745 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.607872 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.608071 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.608263 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.608396 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.608520 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.608642 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.608761 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.608953 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.609144 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.609279 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.609409 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.609532 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.609654 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.609866 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.610010 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.610135 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.610254 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.610454 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.610632 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.610764 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.610900 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.611023 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.611134 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.611309 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.611437 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.611574 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.611698 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.611888 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.612015 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.612183 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.612309 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.612469 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.612607 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.612778 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.612904 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.613062 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.613197 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.613383 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.613518 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.613700 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.613854 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.614027 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.614154 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.614325 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.614453 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.614627 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.614860 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.614988 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.615176 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.615330 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.615585 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.615739 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.615934 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.616241 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.616379 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.616566 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.616700 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.616895 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.617023 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.617233 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.617366 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.617488 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.617614 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.617782 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.617963 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.618155 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.618290 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.618419 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.618538 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.618737 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.618863 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.619038 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.619172 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.619330 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.619455 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.619639 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.619764 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.619929 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.620056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.620238 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.620371 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.620540 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.620666 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.620828 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.620954 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.621151 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.621278 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.621459 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.621589 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.621772 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.621927 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.622106 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.622234 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.622410 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.622533 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.622732 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:52:27.622865 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.623055 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.623188 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.623370 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.623503 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.623716 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.623860 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.623984 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.624110 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.624271 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.624409 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.624540 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.624660 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.624861 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.624986 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.625173 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.625314 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.625486 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.625622 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.625813 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.625939 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.626129 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.626270 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.626437 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.626553 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.626746 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.626875 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.627050 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.627182 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.627381 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.627506 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.627635 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.627757 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.627958 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.628095 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.628263 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.628385 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.628570 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.628692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.628875 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.629012 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.629185 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.629316 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.629489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.629613 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.629838 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.629965 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.630123 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.630245 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.630423 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.630548 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.630723 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.630855 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.631161 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.631483 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.631670 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.631796 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.632011 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.632135 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.632336 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.632471 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.632650 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.632775 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.632961 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.633092 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.633273 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.633412 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.633581 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.633711 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.633925 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.634061 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.634236 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.634357 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.634537 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.634667 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.634845 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.634966 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.635151 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.635281 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.635452 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.635582 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.635760 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.635881 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.636064 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.636192 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.636368 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.636499 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.636687 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.636809 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.636988 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.637109 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.637289 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.637488 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.637611 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.637730 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.637901 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.638026 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.638208 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.638333 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.638516 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.638638 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.638821 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.638944 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.639122 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.639245 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.639425 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.639547 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.639735 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.639857 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.640038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.640169 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.640357 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.640488 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.640661 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.640798 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.640978 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.641099 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.641295 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.641416 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.641602 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.641732 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.641924 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.642045 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.642228 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.642351 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.642530 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.642669 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.642834 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.642955 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.643130 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.643251 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.643433 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.643570 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.643731 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.643853 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.644030 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.644153 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.644328 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.644451 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.644626 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.644756 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.644924 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.645047 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.645238 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.645371 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.645540 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.645669 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.645856 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.645993 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.646158 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.646283 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.646456 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.646578 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.646825 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.647129 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.647304 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.647535 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.647682 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.647804 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.647923 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.648087 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.648211 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.648408 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.648531 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.648713 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.648835 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.649021 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.649166 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.649326 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.649475 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.649639 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.649840 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.649984 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.650149 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.650271 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.650469 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.650601 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.650775 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.650976 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.651099 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.651217 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.651378 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.651508 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.651683 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.651814 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.651986 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.652116 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.652294 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.652416 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.652597 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.652731 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.652900 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.653031 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.653204 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.653326 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.653507 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.653631 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.653826 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.653952 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.654152 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.654287 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.654460 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.654591 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.654769 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.654890 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.655068 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.655189 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.655370 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.655490 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.655677 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.655800 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.655983 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.656114 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.656296 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.656429 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.656604 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.656737 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.656914 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.657047 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.657216 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.657338 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.657530 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.657726 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.657979 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.658119 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.658297 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.658430 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.658606 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.658729 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.658915 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.659049 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.659223 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.659352 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.659544 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.659660 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.659855 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.659979 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.660162 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.660282 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.660469 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.660590 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.660772 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.660901 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.661075 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.661198 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.661380 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.661513 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.661681 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.661823 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.662005 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.662140 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.662379 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.662579 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.662783 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.662982 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.663140 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.663265 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.663385 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.663537 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.663662 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.663846 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.663968 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.664146 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.664276 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.664450 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.664574 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.664749 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.664873 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.665057 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.665181 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.665368 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.665500 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.665672 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.665872 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.665994 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.666112 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.666313 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.666437 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.666612 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.666732 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.666913 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.667035 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.667226 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.667348 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.667530 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.667650 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.667848 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.667980 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.668108 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.668235 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.668403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.668526 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.668741 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.668872 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.669044 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.669175 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.669344 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.669468 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.669658 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.669783 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.669991 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.670112 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.670296 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.670417 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.670604 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.670739 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.670906 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.671026 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.671208 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.671329 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.671519 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.671651 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.671827 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.671947 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.672132 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.672255 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.672439 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.672564 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.672739 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.672891 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.673045 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.673166 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.673351 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.673473 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.673654 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.673776 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.673981 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.674102 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.674287 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.674413 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.674592 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.674718 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.674891 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.675027 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.675196 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.675320 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.675506 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.675638 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.675808 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.676076 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.676200 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.676405 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.676528 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.676708 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.676831 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.677013 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.677136 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.677315 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.677437 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.677618 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.677741 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.678036 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.678159 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.678351 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.678686 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.678884 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.679019 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.679142 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.679269 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.679442 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.679574 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.679767 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.679892 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.680078 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.680209 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.680395 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.680524 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.680706 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.680829 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.681010 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.681139 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.681317 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.681450 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.681616 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.681737 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.681940 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.682066 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.682241 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.682372 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.682542 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.682664 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.682851 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.682980 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.683148 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.683269 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.683455 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.683578 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.683757 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.683880 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.684063 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.684184 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.684367 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.684497 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.684666 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.684789 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.684965 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.685096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.685264 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.685396 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.685604 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.685855 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.685992 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.686198 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.686321 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.686518 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.686641 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.686842 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.686965 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.687164 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.687295 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.687462 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.687582 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.687779 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.687901 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.688105 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.688246 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.688369 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.688496 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.688661 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.688794 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.688963 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.689085 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.689264 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.689400 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.689566 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.689689 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.689896 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.690031 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.690204 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.690329 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.690508 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.690630 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.690808 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.690932 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.691106 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.691230 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.691407 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.691528 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.691703 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.691825 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.692003 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.692125 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.692304 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.692425 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.692600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.692732 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.692897 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.693030 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.693200 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.693322 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.693590 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.693775 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.693926 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.694206 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.694432 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.694556 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.694752 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.694888 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.695070 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.695200 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.695370 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.695491 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.695668 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.695800 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.695970 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.696094 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.696271 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.696407 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.696568 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.696693 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.696885 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.697008 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.697190 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.697313 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.697489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.697612 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.697784 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.697957 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.698110 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.698320 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.698454 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.698575 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.698696 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.698815 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.698981 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.699104 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.699297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.699421 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.699615 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.699746 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.699913 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.700049 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.700215 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.700338 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.700514 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.700643 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.700815 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.700946 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.701111 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.701241 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.701413 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.701534 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.701708 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.701875 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.702029 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.702152 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.702326 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.702449 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.702623 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.702757 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.703252 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.703387 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.703566 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.703697 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.703906 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.704029 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.704148 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.704267 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.704441 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.704565 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.704741 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.704866 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.705042 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.705164 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.705358 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.705481 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.705661 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.705785 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.705991 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.706115 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.706297 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.706422 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.706606 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.706729 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.706914 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.707036 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.707213 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.707345 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.707523 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.707652 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.707825 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.707947 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.708128 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.708259 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.708454 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.708575 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.708725 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.708856 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.709021 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.709169 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.709362 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.709716 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.709957 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.710078 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.710207 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.710339 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.710504 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.710621 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.710823 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.710939 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.711133 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.711257 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.711443 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.711566 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.711782 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.711903 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.712086 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.712223 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.712388 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.712511 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.712689 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.712812 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.712991 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.713114 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.713291 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.713420 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.713591 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.713713 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.713917 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.714040 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.714220 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.714342 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.714521 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.714650 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.714821 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.714943 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.715125 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.715248 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.715425 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.715557 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.715723 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.715845 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.716040 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.716162 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.716342 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.716480 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.716638 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.716761 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.716939 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.717062 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.717236 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.717369 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.717539 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.717663 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.717855 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.717982 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.718219 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.718342 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.718573 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.718846 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.718968 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.719161 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.719292 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.719472 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.719592 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.719777 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.719899 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.720088 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.720217 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.720393 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.720516 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.720690 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.720812 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.721005 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.721138 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.721315 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.721437 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.721627 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.721750 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.721972 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.722113 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.722284 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.722404 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.722583 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.722706 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.722886 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.723009 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.723189 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.723309 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.723489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.723608 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.723788 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.723921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.724086 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.724204 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.724389 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.724510 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.724762 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.724947 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.725146 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.725536 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.725684 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.725860 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.726020 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.726183 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.726306 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.726496 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.726719 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.726853 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.727028 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.727153 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.727335 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.727457 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.727654 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.727793 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.727971 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.728102 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.728284 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.731699 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.731916 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.732069 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.732197 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.732330 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.732451 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.732571 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.732700 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.732820 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.732938 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.733056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.733056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.733279 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.733758 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.734360 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.734484 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.734618 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.734741 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.734860 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.734989 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.735109 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.735228 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.735347 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.735347 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.735573 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.735700 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.735700 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.735924 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.736043 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.736043 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.736345 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.736468 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.736587 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.736705 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.736837 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.736957 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.737084 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.737203 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.737321 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.737470 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.737601 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.737721 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.737889 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.738023 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.738153 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.738273 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.738392 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.738519 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.738640 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.738759 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.738886 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739006 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739124 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739242 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739360 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739478 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739606 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739727 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739854 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.739973 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.740101 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.740228 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.740377 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.740498 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.740602 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.740728 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.740856 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.740984 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.741103 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.741213 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.741339 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.741459 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.741576 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.741708 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.741845 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.742043 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.742166 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.742166 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.742402 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.742541 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.742662 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.742782 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.742782 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.743012 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.743140 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.743272 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.743402 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.743522 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.743641 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.743759 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.743887 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.744015 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.744135 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.744254 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.744372 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.744490 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.744698 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.744821 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.744940 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.745068 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.745195 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.745315 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.745443 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.745563 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.745682 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.745829 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.745953 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.746085 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.746205 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.746325 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.746444 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.746562 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.746688 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.746822 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.746944 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.747063 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.747191 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.747319 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.747439 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.747567 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.747687 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.747814 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.747934 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.748054 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.748173 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.748301 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.748421 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.748548 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.748668 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.748786 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.748913 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.749042 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.749163 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.749349 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.749474 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.749651 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.749784 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.749981 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.750104 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.750303 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.750424 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.750612 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.750750 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.750929 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.751054 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.751233 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.751362 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.751547 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.751677 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.751852 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.751973 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.752167 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.752291 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.752449 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.752573 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.752755 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.752883 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.753063 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.753185 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.753374 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.753497 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.753685 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.753840 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.754019 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.754141 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.754331 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.754455 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.754640 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.754796 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.754930 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.755137 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.755269 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.755465 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.755588 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.758129 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.758406 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.758406 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.758668 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.758790 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.758920 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.759042 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.759167 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.759298 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.759425 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.759601 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.759721 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.759839 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.759977 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.760113 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.760234 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.760353 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.760472 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.761197 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.761328 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.761458 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.761587 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.761712 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.761850 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.761983 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.762114 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.762365 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.762490 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.762610 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.762731 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.762858 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.762992 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.762992 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.763219 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.763933 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.764065 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.764186 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.764316 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.764437 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.764557 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.764667 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.764778 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.764910 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.765084 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.765209 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.765339 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.765459 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.765577 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.765706 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.765848 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.765848 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.766072 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.766842 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.766967 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.767101 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.767223 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.767342 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.767470 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.767590 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.767736 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.767858 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.767979 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.768104 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.768222 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.768340 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.768468 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.768596 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.768723 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.768844 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.768971 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.769099 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.769232 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.769353 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.769472 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.769592 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.769710 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.769859 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.769999 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.770129 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.770258 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.770379 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.770498 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.770625 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.770753 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.770864 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.770982 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.771103 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.771225 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.771354 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.771488 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.771628 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.771756 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.771876 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.771995 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.772128 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.772374 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.772568 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.772702 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.772832 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.772993 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.773115 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.773237 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.773356 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.773356 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.773356 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.773761 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.773913 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.774034 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.774165 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.774288 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.774407 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.774535 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.774663 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.774783 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.774783 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.775017 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.775145 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.775274 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.775395 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.775516 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.775634 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.775763 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.775896 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.776024 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.776150 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.776270 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.776389 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.776516 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.776644 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.776765 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.776883 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.777001 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.777119 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.777247 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.777368 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.777487 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.777614 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.777746 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.777884 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.778017 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.778139 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.778258 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.778385 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.778505 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.778695 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.778829 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.779004 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.779124 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.779308 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.779431 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.779608 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.779731 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.779933 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.780057 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.780234 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.780357 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.780533 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.780664 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.780833 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.781053 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.781184 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.781367 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.781499 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.781698 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.781849 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.782023 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.782144 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.782324 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.782457 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.782664 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.782795 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.782962 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.783091 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.783221 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.783342 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.783502 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.783626 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.783804 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.783927 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.784105 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.784228 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.784407 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.784531 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.784726 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.784849 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.785047 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.785171 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.785344 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.785464 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.785641 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.785764 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.785981 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.786106 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.786288 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.786419 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.786603 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.786819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.786946 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.787237 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.787365 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.787723 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.788039 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.788181 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.788378 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.788567 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.788900 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.789024 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.789220 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.789352 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.789552 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.789675 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.789911 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.790071 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.790206 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.790327 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.790508 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.790640 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.790810 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.790941 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.791128 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.791252 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.791434 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.791556 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.791738 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.791869 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.792042 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.792165 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.792346 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.792482 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.792739 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.792886 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.793015 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.793135 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.793254 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.793371 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.793536 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.793679 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.793860 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.793985 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.794165 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.794290 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.794468 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.794592 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.794770 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.794893 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.795072 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.795203 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.795371 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.795494 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.795673 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.795804 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.795986 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.796109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.796289 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.796415 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.796597 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.796721 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.796901 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.797033 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.797206 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.797330 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.797507 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.797629 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.797848 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.797986 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.798133 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.798262 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.798427 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.798550 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.798753 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.798887 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.799062 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.799186 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.799367 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.799491 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.799672 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.799808 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.799992 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.800115 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.800303 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.800427 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.800610 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.800735 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.800963 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.801095 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.801278 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.801401 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.801596 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.801818 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.801956 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.802162 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.802285 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.802480 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.802614 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.802903 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.803036 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.803204 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.803533 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.803681 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.803849 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.803974 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.804150 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.804274 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.804449 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.804582 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.804749 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.804873 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.805051 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.805175 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.805363 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.805499 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.805668 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.805823 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.805992 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.806116 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.806293 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.806435 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.806599 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.806724 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.806898 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.807021 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.807198 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.807322 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.807498 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.807628 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.807797 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.807920 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.808100 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.808236 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.808396 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.808521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.808690 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.808816 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.808987 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.809111 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.809281 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.809404 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.809575 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.809707 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.809899 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.810035 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.810202 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.810325 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.810501 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.810634 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.810798 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.810933 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.811097 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.811222 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.811394 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.811531 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.811688 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.811811 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.812013 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.812137 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.812341 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.812478 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.812650 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.812775 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.812980 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.813112 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.813270 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.813427 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.813588 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.813748 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.813908 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.814095 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.814229 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.814418 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.814541 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.814726 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.814858 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.815046 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.815180 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.815366 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.815490 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.815676 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.815799 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.815996 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.816124 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.816304 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.816426 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.816610 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.816731 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.816913 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.817044 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.817214 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.817344 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.817533 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.817655 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.817878 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.818017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.818181 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.818305 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.818543 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.818757 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.818957 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.819160 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.819290 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.819412 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.819531 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.819670 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.819792 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.819969 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.820093 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.820274 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.820399 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.820585 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.820710 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.820893 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.821024 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.821205 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.821330 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.821510 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.821633 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.821828 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.821954 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.822141 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.822275 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.822444 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.822569 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.822745 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.822868 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.823053 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.823205 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.823356 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.823488 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.823657 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.823781 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.823958 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.824090 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.824263 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.824387 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.824565 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.824689 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.824868 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.825006 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.825170 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.825295 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.825473 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.825606 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.825773 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.825931 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.826053 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 18:52:27.826172 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.826446 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.826758 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.827078 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.827386 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.827703 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.828348 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.828666 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.828984 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.829295 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.829601 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.829956 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.830267 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.830576 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.830893 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.831202 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.831507 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.831814 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.832140 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.832466 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.832769 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.833088 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.833405 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.833723 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.834132 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.834877 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.835212 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.835524 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.835836 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.836153 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.836462 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.836774 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.837090 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.837404 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.837727 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.838080 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.838387 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.838708 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.839028 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.839373 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.839683 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.840028 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.840356 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.840668 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.840986 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.841292 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:52:27.841535 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 18:52:27.883563 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO dbcounter [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Registered counter for database nova_api Jun 02 18:52:27.900324 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO dbcounter [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Registered counter for database nova_api Jun 02 18:52:27.905273 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_db.sqlalchemy.engines [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:52:27.913278 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writer thread running {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:52:27.921013 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG oslo_db.sqlalchemy.engines [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:52:27.929335 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writer thread running {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:52:27.969392 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.context [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04738c04-a365-48d6-9e43-2e295188c73a(cell1) {{(pid=103142) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 18:52:27.973533 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:52:27.975356 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:52:27.976134 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:52:27.978124 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:52:27.980097 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO dbcounter [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Registered counter for database nova_cell0 Jun 02 18:52:27.984003 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO dbcounter [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Registered counter for database nova_cell1 Jun 02 18:52:27.987112 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.context [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04738c04-a365-48d6-9e43-2e295188c73a(cell1) {{(pid=103141) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 18:52:27.991929 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_db.sqlalchemy.engines [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:52:27.992107 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG oslo_concurrency.lockutils [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:52:27.993299 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_db.sqlalchemy.engines [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:52:27.993584 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG oslo_concurrency.lockutils [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:52:27.994343 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG oslo_concurrency.lockutils [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:52:27.996339 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG oslo_concurrency.lockutils [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:52:27.998350 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writer thread running {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:52:27.998481 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO dbcounter [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Registered counter for database nova_cell0 Jun 02 18:52:28.000749 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writer thread running {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:52:28.002408 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO dbcounter [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Registered counter for database nova_cell1 Jun 02 18:52:28.010276 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG oslo_db.sqlalchemy.engines [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:52:28.013761 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG oslo_db.sqlalchemy.engines [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:52:28.016348 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writer thread running {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:52:28.148449 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO dbcounter [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Registered counter for database nova_cell0 Jun 02 18:52:28.157464 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_db.sqlalchemy.engines [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:52:28.162422 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writer thread running {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:52:28.163273 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writer thread running {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:52:28.172861 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO dbcounter [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Registered counter for database nova_cell0 Jun 02 18:52:28.182158 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG oslo_db.sqlalchemy.engines [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:52:28.188594 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writer thread running {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:52:28.630888 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: WARNING keystonemiddleware.auth_token [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 18:52:28.631483 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: WARNING keystonemiddleware.auth_token [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 18:52:28.638239 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: WARNING keystonemiddleware.auth_token [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 18:52:28.638859 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: WARNING keystonemiddleware.auth_token [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 18:52:28.852918 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: WARNING keystonemiddleware.auth_token [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 18:52:28.858801 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: WARNING keystonemiddleware.auth_token [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 18:52:28.858935 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: WARNING keystonemiddleware.auth_token [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 18:52:28.863871 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561fd55ca9c0 pid: 103142 (default app) Jun 02 18:52:28.864885 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: WARNING keystonemiddleware.auth_token [None req-5842f4af-b732-4fcc-bf9e-5adab75e7844 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 18:52:28.866264 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:52:28.867426 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002026 Jun 02 18:52:28.867827 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Thu Jun 2 18:52:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:52:28.870164 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561fd55ca9c0 pid: 103141 (default app) Jun 02 18:53:48.500428 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:53:48.501434 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 02 18:53:48.501879 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:53:48.514100 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writing DB stats nova_api:SELECT=3 {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:48.515220 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writing DB stats nova_cell0:SELECT=3 {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:48.516220 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writing DB stats nova_cell1:SELECT=3 {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:48.516952 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writing DB stats nova_cell0:SELECT=3 {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:48.976138 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-6c022188-3650-4da0-a1b4-a8d290319b88 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:53:49.005242 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-6c022188-3650-4da0-a1b4-a8d290319b88 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.496264 Jun 02 18:53:49.006646 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1291 bytes} [Thu Jun 2 18:53:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:53:51.350370 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:53:51.352281 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-b452fe3f-b41a-4056-a5b5-b4fe6c1219b6 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Jun 02 18:53:51.352897 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:53:51.415190 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-24e13030-e4e3-4fdf-8bf6-2cb9f3234d02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "vcpus": 1, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:53:51.435164 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:53:51.435164 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: warnings.warn(msg) Jun 02 18:53:51.465940 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-24e13030-e4e3-4fdf-8bf6-2cb9f3234d02 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106794 Jun 02 18:53:51.466726 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:53:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:53:51.480881 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_api:SELECT=3 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:51.482524 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_cell0:SELECT=3 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:51.483576 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_cell1:SELECT=3 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:51.484682 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:51.697542 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-c6cf1d08-9116-49aa-80d2-a5715be45a9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:53:51.700024 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:53:51.700024 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: warnings.warn(msg) Jun 02 18:53:51.756924 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-c6cf1d08-9116-49aa-80d2-a5715be45a9e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281847 Jun 02 18:53:51.757834 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Jun 2 18:53:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:53:54.055091 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-24e13030-e4e3-4fdf-8bf6-2cb9f3234d02 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:53:54.056137 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-24e13030-e4e3-4fdf-8bf6-2cb9f3234d02 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 02 18:53:54.056549 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 18:53:54.165327 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-e6b40424-fcba-4e6b-8d3e-969684fa8734 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:53:54.183022 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:53:54.183022 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: warnings.warn(msg) Jun 02 18:53:54.202853 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-e6b40424-fcba-4e6b-8d3e-969684fa8734 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140299 Jun 02 18:53:54.203408 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:53:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:53:54.216594 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-e53ec20c-0b89-4576-a0e6-f9543f439041 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:53:54.218390 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:53:54.218390 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: warnings.warn(msg) Jun 02 18:53:54.254187 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-e53ec20c-0b89-4576-a0e6-f9543f439041 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041757 Jun 02 18:53:54.254697 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Jun 2 18:53:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:53:56.558593 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-e6b40424-fcba-4e6b-8d3e-969684fa8734 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:53:56.559750 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-e6b40424-fcba-4e6b-8d3e-969684fa8734 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Jun 02 18:53:56.560229 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:53:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:53:56.625473 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-3df5e38a-71b4-444c-8f93-b1b526642c84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "swap": 0, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:53:56.649765 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-3df5e38a-71b4-444c-8f93-b1b526642c84 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083606 Jun 02 18:53:56.657412 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:53:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:53:56.667112 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-e2155ab1-d0b1-4719-89a1-01401b14bf7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:53:56.692623 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-e2155ab1-d0b1-4719-89a1-01401b14bf7c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029375 Jun 02 18:53:56.693524 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Jun 2 18:53:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:53:58.991987 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-3df5e38a-71b4-444c-8f93-b1b526642c84 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:53:58.993043 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-3df5e38a-71b4-444c-8f93-b1b526642c84 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jun 02 18:53:58.993447 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:53:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:53:59.061896 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-4750fd76-024f-40f8-ab2b-91056e35137e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:53:59.091539 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-4750fd76-024f-40f8-ab2b-91056e35137e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090421 Jun 02 18:53:59.092881 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:53:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:53:59.107505 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-c59f8e44-6182-421e-a037-15aa3b003489 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:53:59.133088 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-c59f8e44-6182-421e-a037-15aa3b003489 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029530 Jun 02 18:53:59.133665 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Jun 2 18:53:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:54:01.518511 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-4750fd76-024f-40f8-ab2b-91056e35137e admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:01.525269 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-4750fd76-024f-40f8-ab2b-91056e35137e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Jun 02 18:54:01.525269 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:54:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:01.589911 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-2944931f-ab24-4ce3-af45-c275f7f7c223 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:01.611084 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-2944931f-ab24-4ce3-af45-c275f7f7c223 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084357 Jun 02 18:54:01.612136 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:54:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:01.626909 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-5456bb33-58a0-406e-b653-d2d56cb151d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:01.654218 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-5456bb33-58a0-406e-b653-d2d56cb151d0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031297 Jun 02 18:54:01.665622 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Jun 2 18:54:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:54:03.964407 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-2944931f-ab24-4ce3-af45-c275f7f7c223 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:03.965536 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-2944931f-ab24-4ce3-af45-c275f7f7c223 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Jun 02 18:54:03.966246 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:54:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:04.028293 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-c22a7d76-0f24-4298-92f0-e1f46e641be8 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:04.055230 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-c22a7d76-0f24-4298-92f0-e1f46e641be8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082725 Jun 02 18:54:04.056689 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1291 bytes} [Thu Jun 2 18:54:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:54:06.454611 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-2944931f-ab24-4ce3-af45-c275f7f7c223 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:06.456080 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-2944931f-ab24-4ce3-af45-c275f7f7c223 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Jun 02 18:54:06.456493 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:06.523105 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-5fb49c37-6f44-4bbe-bbbf-23601b155878 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "1", "ram": 512, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:06.542806 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-5fb49c37-6f44-4bbe-bbbf-23601b155878 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079043 Jun 02 18:54:06.543372 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:54:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:06.556364 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-ab9a53f4-4aa9-469c-8316-531d8204adc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:06.584500 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-ab9a53f4-4aa9-469c-8316-531d8204adc2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032666 Jun 02 18:54:06.585377 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Jun 2 18:54:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:54:08.866147 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-5fb49c37-6f44-4bbe-bbbf-23601b155878 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:08.867363 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-5fb49c37-6f44-4bbe-bbbf-23601b155878 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jun 02 18:54:08.867636 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:54:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:08.936741 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-68fcebba-f693-4b8c-b0bb-382f625ec480 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "vcpus": 1}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:08.963667 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-68fcebba-f693-4b8c-b0bb-382f625ec480 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089751 Jun 02 18:54:08.964650 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:54:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:08.977603 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-adcafb8a-0be9-4dce-8528-c7bba35b8f0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:09.002795 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-adcafb8a-0be9-4dce-8528-c7bba35b8f0e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029357 Jun 02 18:54:09.003384 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Jun 2 18:54:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 18:54:11.610515 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-68fcebba-f693-4b8c-b0bb-382f625ec480 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:11.611552 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-68fcebba-f693-4b8c-b0bb-382f625ec480 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jun 02 18:54:11.611961 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:54:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:11.670435 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-7b87b472-b42f-466a-947d-708bd8dc0b11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "id": "3"}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:11.689820 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-7b87b472-b42f-466a-947d-708bd8dc0b11 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071714 Jun 02 18:54:11.690371 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:54:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:11.702584 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-065d5ce6-e62b-4829-8ad6-2980fd772758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:11.727702 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-065d5ce6-e62b-4829-8ad6-2980fd772758 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028917 Jun 02 18:54:11.728480 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Jun 2 18:54:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 18:54:14.069102 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-7b87b472-b42f-466a-947d-708bd8dc0b11 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:14.070826 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-7b87b472-b42f-466a-947d-708bd8dc0b11 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Jun 02 18:54:14.071251 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:54:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:14.133998 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-742df8f3-5e9b-439b-b9ee-60361abd9699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "id": "4", "swap": 0}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:14.154000 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-742df8f3-5e9b-439b-b9ee-60361abd9699 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076932 Jun 02 18:54:14.154576 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:54:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:14.166617 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-7c80bf7e-c56f-45bc-ae80-cabd0158c3cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:14.191884 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-7c80bf7e-c56f-45bc-ae80-cabd0158c3cf admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029069 Jun 02 18:54:14.192687 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Jun 2 18:54:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:54:16.609291 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-742df8f3-5e9b-439b-b9ee-60361abd9699 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:16.610974 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-742df8f3-5e9b-439b-b9ee-60361abd9699 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002135 Jun 02 18:54:16.611372 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:54:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:16.675406 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-de9314ef-e459-4ee1-8859-13aaea82e703 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "disk": 160, "ram": 16384}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:16.694955 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-de9314ef-e459-4ee1-8859-13aaea82e703 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076906 Jun 02 18:54:16.696332 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Jun 2 18:54:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:16.708670 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-23ffc46c-8516-4935-ae59-d5c4f640b50d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:16.733267 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-23ffc46c-8516-4935-ae59-d5c4f640b50d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028881 Jun 02 18:54:16.749899 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Jun 2 18:54:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:54:40.469401 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-de9314ef-e459-4ee1-8859-13aaea82e703 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:40.471011 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-de9314ef-e459-4ee1-8859-13aaea82e703 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002227 Jun 02 18:54:40.471621 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:40.488892 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:54:40.544886 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-5923ad2a-2972-45ac-856b-aa6a385060ce admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:40.564909 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-5923ad2a-2972-45ac-856b-aa6a385060ce admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083387 Jun 02 18:54:40.565465 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1291 bytes} [Thu Jun 2 18:54:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:54:41.597786 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-de9314ef-e459-4ee1-8859-13aaea82e703 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:41.598877 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-de9314ef-e459-4ee1-8859-13aaea82e703 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 02 18:54:41.599273 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:41.814340 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-4f262e0a-d220-4fb6-a82f-9c1fc75bb263 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:41.820192 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.wsgi [None req-4f262e0a-d220-4fb6-a82f-9c1fc75bb263 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-4f262e0a-d220-4fb6-a82f-9c1fc75bb263 admin admin] Request method failure captured: Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Accept: application/json Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Accept-Encoding: gzip, deflate Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Connection: keep-alive Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Content-Length: 0 Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Host: 10.222.0.15 Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Openstack-Api-Version: compute 2.90 Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Openstack-System-Scope: None Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: User-Agent: python-novaclient Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Auth-Token: gAAAAABimQdxLjCJ22CtHkEfV9Irne4mX_3fRGne_E7iHSirZT8xiAedHncTv4jpMhLISyuRJAf6ZpyU6PO4ccvwntZGyxC_PoFBjriHbuncehR7Xf2GK3GogJfr_Mm-7UutJ8Xge_PlzCu81whX1LJuCvwUU0Jz7-7MRyCABB3fm51c6ZFn_Iw Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Domain-Id: None Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Domain-Name: None Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Identity-Status: Confirmed Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Is-Admin-Project: True Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Domain-Id: default Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Domain-Name: Default Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Name: admin Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Role: reader,admin,member Jun 02 18:54:41.823445 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Roles: reader,admin,member Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant: admin Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant-Name: admin Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User: admin Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Domain-Id: default Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Domain-Name: Default Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Id: f2f2aaa398bb4bba874340ea4e3288dd Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Name: admin Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: method: > Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: exception: Flavor 42 could not be found. Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: action_args: {'id': '42'} Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 18:54:41.824921 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:41.825819 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.827037 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-4f262e0a-d220-4fb6-a82f-9c1fc75bb263 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 18:54:41.828091 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-4f262e0a-d220-4fb6-a82f-9c1fc75bb263 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073172 Jun 02 18:54:41.828091 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Jun 2 18:54:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:41.837219 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-2b92abc4-c7ae-4200-a320-c7d28539b9ef admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:41.840297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:54:41.859551 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-2b92abc4-c7ae-4200-a320-c7d28539b9ef admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027300 Jun 02 18:54:41.860113 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Jun 2 18:54:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:54:41.889172 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-31b873c7-db64-4f60-b66f-a5ab52a0d236 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:41.910835 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-31b873c7-db64-4f60-b66f-a5ab52a0d236 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025322 Jun 02 18:54:41.911378 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Jun 2 18:54:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:54:41.921022 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-9b9e9559-0e50-4db1-a403-9024fd03e7ef admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:41.927221 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.wsgi [None req-9b9e9559-0e50-4db1-a403-9024fd03e7ef admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-9b9e9559-0e50-4db1-a403-9024fd03e7ef admin admin] Request method failure captured: Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Accept: application/json Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Accept-Encoding: gzip, deflate Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Connection: keep-alive Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Content-Length: 0 Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Host: 10.222.0.15 Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Openstack-Api-Version: compute 2.90 Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Openstack-System-Scope: None Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: User-Agent: python-novaclient Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Auth-Token: gAAAAABimQdxLjCJ22CtHkEfV9Irne4mX_3fRGne_E7iHSirZT8xiAedHncTv4jpMhLISyuRJAf6ZpyU6PO4ccvwntZGyxC_PoFBjriHbuncehR7Xf2GK3GogJfr_Mm-7UutJ8Xge_PlzCu81whX1LJuCvwUU0Jz7-7MRyCABB3fm51c6ZFn_Iw Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Domain-Id: None Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Domain-Name: None Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Identity-Status: Confirmed Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Is-Admin-Project: True Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Domain-Id: default Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Domain-Name: Default Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Name: admin Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Role: reader,admin,member Jun 02 18:54:41.931015 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Roles: reader,admin,member Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant: admin Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant-Name: admin Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User: admin Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Domain-Id: default Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Domain-Name: Default Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Id: f2f2aaa398bb4bba874340ea4e3288dd Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Name: admin Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: method: > Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: exception: Flavor 42 could not be found. Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: action_args: {'id': '42'} Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 18:54:41.932480 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:41.933297 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:41.934465 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-9b9e9559-0e50-4db1-a403-9024fd03e7ef admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 18:54:41.935714 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-9b9e9559-0e50-4db1-a403-9024fd03e7ef admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014968 Jun 02 18:54:41.935714 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Jun 2 18:54:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:42.813555 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-31b873c7-db64-4f60-b66f-a5ab52a0d236 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:42.814621 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-31b873c7-db64-4f60-b66f-a5ab52a0d236 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 02 18:54:42.815249 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:54:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:43.029902 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-4e26c149-b77c-411c-9c88-a3e40c51233b admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:43.035853 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.wsgi [None req-4e26c149-b77c-411c-9c88-a3e40c51233b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-4e26c149-b77c-411c-9c88-a3e40c51233b admin admin] Request method failure captured: Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Accept: application/json Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Accept-Encoding: gzip, deflate Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Connection: keep-alive Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Content-Length: 0 Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Host: 10.222.0.15 Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Openstack-Api-Version: compute 2.90 Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Openstack-System-Scope: None Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: User-Agent: python-novaclient Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Auth-Token: gAAAAABimQdywuaXxBlsT2hOxZzVHJ7FBtTTNj8bUUVSZJ-rmeNEs3fXsAfXDvMyQT0xApxxj-0PudV2a3cdgx-L6EmweTetsvToYFA4MVVPyT-SzAoNoZdXk9EsVtwe5f4vndwjxXqjJpaUvqsAyZCwdBE4GodFzsj0zd-WgXqFK3ksezX2pcw Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Domain-Id: None Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Domain-Name: None Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Identity-Status: Confirmed Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Is-Admin-Project: True Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Domain-Id: default Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Domain-Name: Default Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Name: admin Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Role: reader,admin,member Jun 02 18:54:43.037403 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Roles: reader,admin,member Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant: admin Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant-Name: admin Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User: admin Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Domain-Id: default Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Domain-Name: Default Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Id: f2f2aaa398bb4bba874340ea4e3288dd Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Name: admin Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: method: > Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: exception: Flavor 84 could not be found. Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: action_args: {'id': '84'} Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 18:54:43.039056 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:43.040109 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.041489 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-4e26c149-b77c-411c-9c88-a3e40c51233b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 18:54:43.042772 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-4e26c149-b77c-411c-9c88-a3e40c51233b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.089290 Jun 02 18:54:43.042772 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Jun 2 18:54:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:43.050181 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-c14e8dcf-0e19-4242-9f16-1568a7885f1d admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:43.064380 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-c14e8dcf-0e19-4242-9f16-1568a7885f1d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017986 Jun 02 18:54:43.064919 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Jun 2 18:54:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:54:43.078440 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-8fa195ff-ce57-4751-8cae-e5f49f5a1dd6 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:43.101379 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-8fa195ff-ce57-4751-8cae-e5f49f5a1dd6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028988 Jun 02 18:54:43.101930 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Jun 2 18:54:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:54:43.116507 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-57cfd433-ba23-485c-bac8-3fa85cbbb848 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:43.124984 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.wsgi [None req-57cfd433-ba23-485c-bac8-3fa85cbbb848 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-57cfd433-ba23-485c-bac8-3fa85cbbb848 admin admin] Request method failure captured: Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Accept: application/json Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Accept-Encoding: gzip, deflate Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Connection: keep-alive Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Content-Length: 0 Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Host: 10.222.0.15 Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Openstack-Api-Version: compute 2.90 Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Openstack-System-Scope: None Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: User-Agent: python-novaclient Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Auth-Token: gAAAAABimQdywuaXxBlsT2hOxZzVHJ7FBtTTNj8bUUVSZJ-rmeNEs3fXsAfXDvMyQT0xApxxj-0PudV2a3cdgx-L6EmweTetsvToYFA4MVVPyT-SzAoNoZdXk9EsVtwe5f4vndwjxXqjJpaUvqsAyZCwdBE4GodFzsj0zd-WgXqFK3ksezX2pcw Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Domain-Id: None Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Domain-Name: None Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Identity-Status: Confirmed Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Is-Admin-Project: True Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Domain-Id: default Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Domain-Name: Default Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Name: admin Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Role: reader,admin,member Jun 02 18:54:43.127521 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Roles: reader,admin,member Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant: admin Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant-Name: admin Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User: admin Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Domain-Id: default Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Domain-Name: Default Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Id: f2f2aaa398bb4bba874340ea4e3288dd Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Name: admin Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: method: > Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: exception: Flavor 84 could not be found. Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: action_args: {'id': '84'} Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 18:54:43.129038 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:43.130017 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:43.131692 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-57cfd433-ba23-485c-bac8-3fa85cbbb848 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 18:54:43.132998 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-57cfd433-ba23-485c-bac8-3fa85cbbb848 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.018377 Jun 02 18:54:43.132998 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Jun 2 18:54:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:44.002352 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-8fa195ff-ce57-4751-8cae-e5f49f5a1dd6 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:44.003866 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-8fa195ff-ce57-4751-8cae-e5f49f5a1dd6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Jun 02 18:54:44.004396 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:44.204181 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-3a892511-c43e-418f-8e5f-ccaa6ce409fd admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:44.210622 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.wsgi [None req-3a892511-c43e-418f-8e5f-ccaa6ce409fd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-3a892511-c43e-418f-8e5f-ccaa6ce409fd admin admin] Request method failure captured: Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Accept: application/json Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Accept-Encoding: gzip, deflate Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Connection: keep-alive Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Content-Length: 0 Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Host: 10.222.0.15 Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Openstack-Api-Version: compute 2.90 Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Openstack-System-Scope: None Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: User-Agent: python-novaclient Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Auth-Token: gAAAAABimQdzEZxHnK3n3pxeJFHno5PUrxvVCdhOLEyAB4IM9NKZiJ4cN5R99P2Rxd9-CGm7Q-oZWSJdcH_IQWwiSu4gFrcqwcZkWoRZOgTMULTH38aTWnp2ONLFjq-iq0u6Lnxf404D5ZMpC0F9O8gvrK4XkjJrgIRty_6nVWiQwayA6B0FAus Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Domain-Id: None Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Domain-Name: None Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Identity-Status: Confirmed Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Is-Admin-Project: True Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Domain-Id: default Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Domain-Name: Default Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Project-Name: admin Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Role: reader,admin,member Jun 02 18:54:44.212096 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Roles: reader,admin,member Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant: admin Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-Tenant-Name: admin Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User: admin Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Domain-Id: default Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Domain-Name: Default Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Id: f2f2aaa398bb4bba874340ea4e3288dd Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: X-User-Name: admin Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: method: > Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: exception: Flavor 451 could not be found. Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: action_args: {'id': '451'} Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 18:54:44.213636 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:44.218617 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.219913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-3a892511-c43e-418f-8e5f-ccaa6ce409fd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 18:54:44.220971 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-3a892511-c43e-418f-8e5f-ccaa6ce409fd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068978 Jun 02 18:54:44.220971 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Jun 2 18:54:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:44.223417 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-63a7ca9e-f210-4610-86cd-1e227fd7e0e9 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:44.237273 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-63a7ca9e-f210-4610-86cd-1e227fd7e0e9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017429 Jun 02 18:54:44.237853 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Jun 2 18:54:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:54:44.247787 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:44.261633 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017445 Jun 02 18:54:44.262184 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Jun 2 18:54:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 18:54:44.272820 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-fd154fbd-51af-40de-9687-e0febd056302 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:44.278380 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.wsgi [None req-fd154fbd-51af-40de-9687-e0febd056302 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-fd154fbd-51af-40de-9687-e0febd056302 admin admin] Request method failure captured: Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Accept: application/json Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Accept-Encoding: gzip, deflate Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Connection: keep-alive Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Content-Length: 0 Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Host: 10.222.0.15 Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Openstack-Api-Version: compute 2.90 Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Openstack-System-Scope: None Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: User-Agent: python-novaclient Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Auth-Token: gAAAAABimQdzEZxHnK3n3pxeJFHno5PUrxvVCdhOLEyAB4IM9NKZiJ4cN5R99P2Rxd9-CGm7Q-oZWSJdcH_IQWwiSu4gFrcqwcZkWoRZOgTMULTH38aTWnp2ONLFjq-iq0u6Lnxf404D5ZMpC0F9O8gvrK4XkjJrgIRty_6nVWiQwayA6B0FAus Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Domain-Id: None Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Domain-Name: None Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Identity-Status: Confirmed Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Is-Admin-Project: True Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Domain-Id: default Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Domain-Name: Default Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Project-Name: admin Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Role: reader,admin,member Jun 02 18:54:44.279880 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Roles: reader,admin,member Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b970ca87a411459db54f4a7b6d487f4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant: admin Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant-Id: b970ca87a411459db54f4a7b6d487f4a Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-Tenant-Name: admin Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User: admin Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Domain-Id: default Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Domain-Name: Default Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Id: f2f2aaa398bb4bba874340ea4e3288dd Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: X-User-Name: admin Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: method: > Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: exception: Flavor 451 could not be found. Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: action_args: {'id': '451'} Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 18:54:44.281476 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:44.282600 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: ERROR nova.api.openstack.wsgi Jun 02 18:54:44.283851 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-fd154fbd-51af-40de-9687-e0febd056302 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 18:54:44.285050 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-fd154fbd-51af-40de-9687-e0febd056302 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013074 Jun 02 18:54:44.285050 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Jun 2 18:54:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:45.187155 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:45.188161 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 02 18:54:45.188558 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:54:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:45.389669 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-d68063d5-304e-4de5-9fc2-e6b884a61486 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:45.410383 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-d68063d5-304e-4de5-9fc2-e6b884a61486 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085638 Jun 02 18:54:45.410916 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Jun 2 18:54:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:46.284418 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:46.285737 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Jun 02 18:54:46.286307 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:46.480635 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-bdf3b10c-3f01-436d-8320-c8bce1782cc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:46.502637 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-bdf3b10c-3f01-436d-8320-c8bce1782cc7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080696 Jun 02 18:54:46.503148 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Jun 2 18:54:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:47.380550 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:47.381571 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 02 18:54:47.382010 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:54:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:47.581786 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-9c510f3a-23a7-4d15-82e8-1e926e96a347 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:47.602865 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-9c510f3a-23a7-4d15-82e8-1e926e96a347 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.084593 Jun 02 18:54:47.603431 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Jun 2 18:54:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:48.469387 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:48.470433 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 02 18:54:48.470830 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:48.681673 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-34513354-80e9-459a-81a8-f34fbee34009 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 18:54:48.703106 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-34513354-80e9-459a-81a8-f34fbee34009 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.095974 Jun 02 18:54:48.703683 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Jun 2 18:54:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:54:49.611663 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:49.612653 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 02 18:54:49.613066 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:54:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:54:49.812162 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-f80ee3df-db7d-415c-bea7-dbbab4191ac8 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:54:49.832838 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-f80ee3df-db7d-415c-bea7-dbbab4191ac8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084864 Jun 02 18:54:49.833386 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Thu Jun 2 18:54:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:55:50.881767 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:55:50.883149 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-19264b41-eb82-417f-b91b-1512f6ff2325 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002202 Jun 02 18:55:50.883716 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 930 bytes} [Thu Jun 2 18:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:55:50.892589 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:55:50.946527 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-d0dd0d83-fb2b-4b51-a1bf-ded4f1384f2a admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:55:50.967570 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-d0dd0d83-fb2b-4b51-a1bf-ded4f1384f2a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076377 Jun 02 18:55:50.968216 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1291 bytes} [Thu Jun 2 18:55:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:55:50.988951 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG dbcounter [-] [103141] Writing DB stats nova_api:SELECT=14 {{(pid=103141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:55:50.992787 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-7ca95764-248d-4cea-9618-7856655538c5 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:55:51.000798 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-7ca95764-248d-4cea-9618-7856655538c5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013242 Jun 02 18:55:51.001306 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1282 bytes} [Thu Jun 2 18:55:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:55:51.016262 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-3125801f-6a18-4a95-ae38-3c87b3c04423 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:55:51.025021 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-3125801f-6a18-4a95-ae38-3c87b3c04423 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012336 Jun 02 18:55:51.025545 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1285 bytes} [Thu Jun 2 18:55:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:55:51.039021 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:55:51.049546 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015455 Jun 02 18:55:51.050439 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1285 bytes} [Thu Jun 2 18:55:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:55:51.067977 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-f31852a3-a92e-48cd-ac16-502b3e6bb969 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:55:51.076452 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-f31852a3-a92e-48cd-ac16-502b3e6bb969 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014432 Jun 02 18:55:51.076980 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1282 bytes} [Thu Jun 2 18:55:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 18:59:14.811987 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:59:14.813359 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 Jun 02 18:59:14.813913 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:59:14.976543 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_api:SELECT=6 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:59:15.103749 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-1832550d-3977-4aa4-9910-78a6242d0dd4 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:59:15.105151 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:59:15.105151 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: warnings.warn(msg) Jun 02 18:59:15.106778 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-1832550d-3977-4aa4-9910-78a6242d0dd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:59:15.106979 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-1832550d-3977-4aa4-9910-78a6242d0dd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:59:15.107961 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-1832550d-3977-4aa4-9910-78a6242d0dd4 admin admin] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:59:15.108457 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-1832550d-3977-4aa4-9910-78a6242d0dd4 admin admin] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:59:15.145631 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-1832550d-3977-4aa4-9910-78a6242d0dd4 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.177031 Jun 02 18:59:15.146214 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Jun 2 18:59:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:59:16.058226 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:59:16.059249 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Jun 02 18:59:16.059647 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:59:16.266078 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-3d2ba878-d917-4040-a85a-514a125a8dd0 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:59:16.267258 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:59:16.267258 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: warnings.warn(msg) Jun 02 18:59:16.268449 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-3d2ba878-d917-4040-a85a-514a125a8dd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:59:16.268892 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-3d2ba878-d917-4040-a85a-514a125a8dd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:59:16.269669 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-3d2ba878-d917-4040-a85a-514a125a8dd0 admin admin] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:59:16.270120 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-3d2ba878-d917-4040-a85a-514a125a8dd0 admin admin] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:59:16.290653 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-3d2ba878-d917-4040-a85a-514a125a8dd0 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.089775 Jun 02 18:59:16.291213 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Jun 2 18:59:16 2022] GET /compute/v2.1/os-services => generated 794 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 18:59:27.685365 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:59:27.686512 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 Jun 02 18:59:27.686894 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:59:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:59:27.832317 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_cell0:SELECT=4 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:59:27.833019 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_cell1:SELECT=4 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:59:27.833621 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG dbcounter [-] [103142] Writing DB stats nova_api:SELECT=8 {{(pid=103142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:59:27.885183 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-c0e81006-f57e-40c1-81bc-911cd48be032 admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:59:27.886384 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:59:27.886384 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: warnings.warn(msg) Jun 02 18:59:27.887582 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-c0e81006-f57e-40c1-81bc-911cd48be032 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:59:27.887999 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-c0e81006-f57e-40c1-81bc-911cd48be032 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:59:27.888817 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-c0e81006-f57e-40c1-81bc-911cd48be032 admin admin] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:59:27.889238 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-c0e81006-f57e-40c1-81bc-911cd48be032 admin admin] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:59:27.915083 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-c0e81006-f57e-40c1-81bc-911cd48be032 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.087928 Jun 02 18:59:27.916856 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Jun 2 18:59:27 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 18:59:28.838771 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: DEBUG nova.api.openstack.wsgi [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] Calling method '>' {{(pid=103141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:59:28.839789 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: INFO nova.api.openstack.requestlog [None req-be31782c-9ede-4687-b5ee-77d59a71e494 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 02 18:59:28.840186 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: [pid: 103141|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Jun 2 18:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 18:59:29.037972 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG nova.api.openstack.wsgi [None req-7c2d0c13-0a8a-457f-915b-43181fb55ebe admin admin] Calling method '>' {{(pid=103142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 18:59:29.039205 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:59:29.039205 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: warnings.warn(msg) Jun 02 18:59:29.040388 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-7c2d0c13-0a8a-457f-915b-43181fb55ebe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:59:29.040826 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-7c2d0c13-0a8a-457f-915b-43181fb55ebe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:59:29.041644 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-7c2d0c13-0a8a-457f-915b-43181fb55ebe admin admin] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 18:59:29.042044 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: DEBUG oslo_concurrency.lockutils [None req-7c2d0c13-0a8a-457f-915b-43181fb55ebe admin admin] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 18:59:29.064535 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: INFO nova.api.openstack.requestlog [None req-7c2d0c13-0a8a-457f-915b-43181fb55ebe admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080736 Jun 02 18:59:29.065128 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: [pid: 103142|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Jun 2 18:59:28 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:00:26.699740 dv-cinder-797608-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 02 19:00:26.700942 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: Thu Jun 2 19:00:26 2022 - graceful shutdown triggered... Jun 02 19:00:26.701456 dv-cinder-797608-28-iscsi devstack@n-api.service[103141]: Gracefully killing worker 1 (pid: 103141)... Jun 02 19:00:26.701857 dv-cinder-797608-28-iscsi devstack@n-api.service[103142]: Gracefully killing worker 2 (pid: 103142)... Jun 02 19:00:27.701996 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: worker 1 buried after 1 seconds Jun 02 19:00:27.701996 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: worker 2 buried after 1 seconds Jun 02 19:00:27.701996 dv-cinder-797608-28-iscsi devstack@n-api.service[103140]: goodbye to uWSGI. Jun 02 19:00:27.703579 dv-cinder-797608-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 02 19:00:27.704496 dv-cinder-797608-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 02 19:00:27.707307 dv-cinder-797608-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 19:00:27.721695 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 19:00:27 2022] *** Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: nodename: dv-cinder-797608-28-iscsi Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: machine: x86_64 Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: clock source: unix Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: pcre jit disabled Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: detected number of CPU cores: 4 Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: current working directory: / Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: detected binary path: /usr/bin/uwsgi-core Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: your processes number limit is 47680 Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: your memory page size is 4096 bytes Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: detected max file descriptor number: 2048 Jun 02 19:00:27.737811 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: lock engine: pthread robust mutexes Jun 02 19:00:27.738788 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: thunder lock: enabled Jun 02 19:00:27.738788 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 19:00:27.738788 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 19:00:27.788223 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: Python main interpreter initialized at 0x55b92f69b9c0 Jun 02 19:00:27.788223 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: python threads support enabled Jun 02 19:00:27.788223 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: your server socket listen backlog is limited to 100 connections Jun 02 19:00:27.788223 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: your mercy for graceful operations on workers is 90 seconds Jun 02 19:00:27.788661 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 19:00:27.788661 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: *** Operational MODE: preforking *** Jun 02 19:00:27.788871 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: *** uWSGI is running in multiple interpreter mode *** Jun 02 19:00:27.789048 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: spawned uWSGI master process (pid: 117755) Jun 02 19:00:27.789246 dv-cinder-797608-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 19:00:27.790043 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: spawned uWSGI worker 1 (pid: 117776, cores: 1) Jun 02 19:00:27.793182 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: spawned uWSGI worker 2 (pid: 117777, cores: 1) Jun 02 19:00:27.793182 dv-cinder-797608-28-iscsi devstack@n-api.service[117755]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 19:00:29.048684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 19:00:29.049895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 19:00:29.873907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 19:00:29.873907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: from cryptography.utils import int_from_bytes Jun 02 19:00:29.874223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 19:00:29.874223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: from cryptography.utils import int_from_bytes Jun 02 19:00:29.888420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 19:00:29.888420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: from cryptography.utils import int_from_bytes Jun 02 19:00:29.888766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 19:00:29.888766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: from cryptography.utils import int_from_bytes Jun 02 19:00:32.243558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 19:00:32.244150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 19:00:32.244317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 19:00:32.244716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 19:00:32.244977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 19:00:32.245360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.245684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.246052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.246368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.246704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.247012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.247342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.247663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.247991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.248237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.248554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.249317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-28-iscsi {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.249317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.249597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.249941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.250284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.250589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.250914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.251219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.251725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.253008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.253008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.253008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.253248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.253384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.253691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.254045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.254352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.254680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.254993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.255420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-28-iscsi {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.255737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.256029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.256365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.256784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.257099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.257426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.257721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.258074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.258397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.258725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.259042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.259362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.259661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.259979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.260278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.260605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.260919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.261205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.261551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.261821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.262129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.262460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.262753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.263075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.263326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.263579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.263894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.264248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.264746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.264746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.264746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.265624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.265772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.266115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.266395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.266719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.267036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.267359 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.267685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.267992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.268315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.268715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.268968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.269279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.269605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.269955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.270272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.270577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.270900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.271209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.271520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.271829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.272147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.272484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.272790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.273042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.273344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.273650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.274002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.274307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.274612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.274919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.275219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.275526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.275834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.276143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.276449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.276757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.277061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.277372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.277717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.278009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.278328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.278647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.278953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.279259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.279565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.279871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.280529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.280529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.280865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.281345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.281572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.281726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.282063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.282372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.282677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.282996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.283296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.283605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.283922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.284228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.284536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.284839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.285141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.285446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.285750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.286078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.286471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.287825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.287825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.287825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.287825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.288489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.288489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.288489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.288919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.289224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.289638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.289832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.290122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.290580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.290770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.291084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.291745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.291745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.292033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.292309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.292620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.292939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.293259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.293588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.293927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.294249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.294569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.294883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.295041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 19:00:32.295533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.295791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 19:00:32.296178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.296178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.296846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 19:00:32.297066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.297216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 19:00:32.297370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.297513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 19:00:32.297656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.297838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.298051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.298330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.298490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.298643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.298643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.298923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.298923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.299229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.299379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.299529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.299678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.299822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.299963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.300113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.300256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.300397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.300538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.300685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.300844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.301004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.301153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.301295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-28-iscsi {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.301663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.301974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.302143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.302299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.302443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.302593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.302736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.302877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.303038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.303192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.304358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.304524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.304687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.304848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.305006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.305006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.305297 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.305531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.305676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.305911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.306068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.306274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.306428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.306572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.306714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.306870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.307014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.307163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.307307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.307459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.307613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.307765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.307918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.308060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.308220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.308455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.308613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.308766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.308766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.309054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-28-iscsi {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.309247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.309434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.309586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.309905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.310069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.310272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.310446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.310600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.310747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.310897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.311048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.311304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.312357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.312539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.312696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.312848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.313001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.313155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.313312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.313312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.313620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.313772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.313949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.314094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.314319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.314473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.314623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.314768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.314919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.314919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.315213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.315361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.315531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.315531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.315747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.315859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.315982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.316094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.316231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.316231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.316484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.316627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.316757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.316953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.317120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.317272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.317425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.317577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.317965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.318132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.318278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.318403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.318626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.318794 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.318940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.319076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.319203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.319339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.319465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.319591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.319711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.319838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.320076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.320227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.320927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.321100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.321650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.321845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.321997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.322156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.322156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.322802 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.322925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.323056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.323202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.323424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.323585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.323782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.323935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.323935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.324332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.324481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.324481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.325257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.325406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.325521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.325641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.325772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.325966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.325966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.326174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.326347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.326541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.326715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.326898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.327697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.327697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.328039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.328189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.328343 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.328491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.328625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.328857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.329347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.329487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.329632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.329761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.329906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.330018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.330160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.330291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.330291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.330510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.330647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.330783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.330911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.331051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.331216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.331369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.332141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.332141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.332393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.332393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.332972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.332972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.333195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.333306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.333433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.333569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.333710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.333928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.334060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.334188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.334188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.334451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.334586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.334586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.334844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.334972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.335109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.335237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.335371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.335499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.335625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.335752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.335752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.336016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.336151 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.336287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.336423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.336551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.336687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.336823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.336952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.337078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.337205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.337339 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.337476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.337612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.337754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.337895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.338035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.338177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.338307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.338433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.338569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.338705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.338855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.339060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.339199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.339328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.339469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.339597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.339723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.339857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.339985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.340120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.340257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.340392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.340527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.340654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.340788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.340916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.341051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.341188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.341315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.341449 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.341577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.341826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.341961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.342100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.342238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.342389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.342568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.343468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.343607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.343745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.343886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.344025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.344206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.344344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.344482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.344611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.344746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.344909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.345042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.345167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.345167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.345394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.345394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.345602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.345739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.345902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.346036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.346162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.346319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.346465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.346623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.346774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.346925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.347069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:32.347224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.347224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.347522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.347666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.347815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.347959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.348099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.348099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.348099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.348099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.348658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.348800 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.348960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.349214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.349364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.349509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.349659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.349836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.349985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.350145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.350298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.350395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.350518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.350637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.350756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.350877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.350997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.351117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.351228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.351228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.351228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.351228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.351692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.351814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.351930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.352962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.353120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.353216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.353308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.353539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.353645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.353873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.353984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.354239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.354331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.354597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.354696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.354924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.355015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.355236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.355339 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.355549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.355648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.355866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.356033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.356247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.356407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.356508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.356779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.356869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.357095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.357194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.357400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.357499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.357713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.357858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.358113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.358221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.358426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.358742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.359028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.359150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.359345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.359451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.359650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.359742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.359964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.360117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.360271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.360443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.360594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.360789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.360905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.361115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.361208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.361442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.361533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.361762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.361887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.362147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.362239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.362455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.362555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.362771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.362867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.363090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.363207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.363402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.363517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.363714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.363887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.364035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.364187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.364339 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.364487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.364647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.364800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.364966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.365109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.365245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.365390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.365543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.365691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.365851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.365961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.366176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.366441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.366572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.366752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.367606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.367748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.367860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.367971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.368093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.368214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.368334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.368427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.368518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.368602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.368910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.369073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.369231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.369470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.369620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.369771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.370033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.370180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.370322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.370464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.370607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.370757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.370900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.371155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.371324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.371488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.371641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.371783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.371873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.372192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.372498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.372804 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.373108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.373418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.374097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.374243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.374520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.374820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.375127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.375434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.375744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.376049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.376359 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.376670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.376998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.377314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.377617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.377957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.378123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.378285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.378453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.378600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.378751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.378899 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.379052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.379199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.379386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.379549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.379726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.379891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.380044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.380198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.380351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.380542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.380693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.380870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.381022 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.381214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.381383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.381535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.381686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.381867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.382031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.382191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.382336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.382480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.382703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.382894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.383066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.383300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.383523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.383865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.384028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.384183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.384183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.384499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.384766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.384919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.385076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.385222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.385388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.385545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.385705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.385937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.386097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.386251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.386424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.386733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.386887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.387031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.387182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.387356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.387518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.387671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.387823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.387987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.388212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.388378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.388531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.388675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.388828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.388974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.389126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.389126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.389453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.389606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.389750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.389916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.390071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.390282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.390282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.390282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.390742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.390887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.391037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.391191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.391342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.391507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.391661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.391805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.391957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.392108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.392252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.392402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.392558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.392713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.392867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.393012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.393163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.393307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.393465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.393617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.393771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.394035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.394035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.394330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.394482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.394635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.394807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.395045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.395196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.395347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.395515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.395676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.395822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.395972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.396124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.396268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.396411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.396564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.396869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.396869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.397169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.397314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.397464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.397630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.397777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.397982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.398138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.398382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.398532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.398750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.398906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.399058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.399212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.399358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.399501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.399654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.399818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.399965 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.400116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.400268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.400422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.400575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.400729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.400882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.401034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.401185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.401344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.401605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.401756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.401960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.401960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.402247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.402405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.402551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.402696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.402847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.402994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.403138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.403138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.403441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.403587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.403756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.403901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.404148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.404299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.404446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.404592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.404736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.404904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.405128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.405128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.405608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.405869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.406089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.406308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.406308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.406685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.407036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.407202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.407349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.407349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.407641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.407794 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.407947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.408092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.408246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.408417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.408666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.408826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.408973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.409117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.409279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.409435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.409586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.409738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.409960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.410105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.410249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.410415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.410561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.410724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.410869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.411013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.411155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.411311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.411458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.411602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.411753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.411906 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.412060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.412239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.412239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.412538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.412709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.412858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.413011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.413164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.413310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.413461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.413606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.413757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.414009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.414175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.414405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.414555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.414718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.414718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.415010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.415155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.415306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.415477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.415730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.415896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.416042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.416187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.416330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.416473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.416618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.416780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.416934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.417286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.417439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.417592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.417738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.417922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.418069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.418221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.418373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.418518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.418688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.418930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.419089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.419233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.419377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.419529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.419683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.419830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.419973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.420116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.420267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.420411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.420595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.420745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.420745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.421047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.421457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.421652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.421868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.422060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.422216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.422216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.422506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.422652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.422805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.422952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.423104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.423268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.423421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.423579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.423579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.423870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.424023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.424167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.424318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.424577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.424729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.424873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.425018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.425177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.425349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.425349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.425642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.425927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.426095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.426243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.426387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.426531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.426531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.426822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.426977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.427150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.427478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.427625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.427778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.427929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.428084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.428232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.428383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.428528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.428528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.428807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.429097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.429251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.429442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.429659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.429901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.430150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.430372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.430595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.430763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.430918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.430918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.431207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.431355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.431507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.431653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.431797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.431953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.432108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.432253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.432253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.432535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.432688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.432841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.432995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.433139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.433292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.433444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.433588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.433740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.433924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.434071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.434071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.434354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.434508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.434811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.434972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.435128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.435273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.435426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.435573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.435730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.435730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.436281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.436480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.436783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.436965 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.437128 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.437308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.437669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.437841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.437993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.438155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.438302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.438447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.438447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.438447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.438877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.439053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.439319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.439468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.439612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.439966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.440121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.440282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.440441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.440593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.440763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.440763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.441048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.441197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.441342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.441494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.441647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.441876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.442046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.442193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.442350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.442350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.442660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.442807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.442959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.443111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.443111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.443391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.443545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.443690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.443841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.443994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.444147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.444292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.444454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.444611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.444775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.445041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.445202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.445359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.445505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.445650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.445820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.445983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.446138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.446435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.446587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.446743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.446896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.447049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.447049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.447332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.447476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.447805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.447967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.448115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.448274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.448420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.448564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.448715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.448870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.449022 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.449177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.449348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.449586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.449736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.449900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.450046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.450208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.450354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.450506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.450658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.450803 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.450965 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.451123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.451278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.451422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.451566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.451710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.451940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.452090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.452235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.452387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.452540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.452685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.452839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.453002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.453002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.453285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.453439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.453585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.453585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.453585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.454386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.454534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.454687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.454832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.454832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.455223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.455383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.455538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.455693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.455849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.455995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.456139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.456283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.456456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.456697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.456862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.457008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.457152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.457306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.457450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.457594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.457928 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.458099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.458254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.458407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.458554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.458699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.458856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.459008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.459154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.459297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.459297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.459599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.459842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.459992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.460144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.460289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.460434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.460591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.460786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.460786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.461146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.461343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.461566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.461988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.462167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.462329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.462475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.462620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.462765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.462919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.463065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.463217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.463217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.463489 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.463641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.463796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.463954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.464761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.464922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.465068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.465250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.465502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.465661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.465834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.465988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.466144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.466303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.466458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.466624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.466901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.467070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.467223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.467478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.467684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.467934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.468367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.468529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.468697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.468865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.469023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.469185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.469370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.469370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.469723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.470101 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.470268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.470429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.470581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.470740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.470907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.470907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.471219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.471371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.471521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.471691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.471857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.472011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.472171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.472323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.472474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.472632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.472798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.472950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.473102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.473262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.473413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.473588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.473588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.473911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.474071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.474244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.474398 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.474563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.474716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.474716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.475001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.475164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.475318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.475570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.475847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.476013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.476166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.476325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.476489 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.476650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.476803 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.477118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.477291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.477448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.477614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.477767 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.477958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.478142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.478142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.478644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.478807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.478959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.479112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.479269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.479430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.479590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.479752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.479903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.480087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.480087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.480516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.480686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.480846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.480846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.481143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.481304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.481456 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.481617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.481771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.481973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.482135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.482298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.482450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.482609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.482762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.482913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.483131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.483379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.483698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.483886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.484049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.484280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.484464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.484657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.484920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.485147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.485374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.485374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.485671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.485865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.486135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.486305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.486475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.486634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.486786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.486953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.486953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.487384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.487543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.487543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.487856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.488019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.488019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.488345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.488665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.488822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.488974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.489135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.489295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.489295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.489601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.489753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.489955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.490122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.490281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.490571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.490729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.490890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.491053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.491213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.491372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.491532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.491695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.491847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.492016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.492171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.492329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.492482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.492633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.492792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.492960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.493114 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.493266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.493425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.493594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.493762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.493958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.494112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.494272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.494433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.494586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.494747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.494900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.495051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.495202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.495363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.495527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.495690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.495853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.496005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.496263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.496421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.496581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.496743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.496903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.497056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.497056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.497373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.497647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.497832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.498013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.498175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.498335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.498488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.498937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.499147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.499302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.499455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.499608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.499759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.499924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.500086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.500240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.500403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.500575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.500827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.501001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.501001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.501305 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.501458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.501611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.501763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.502009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.502009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.502309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.502309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.502717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.502886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.503046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.503205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.503367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.503527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.503681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.503845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.503998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.503998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.504302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.504302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.504302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.504767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.504920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.505070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.505228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.505381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.505541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.505693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.505887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.506054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.506207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.506486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.506653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.506653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.506956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.506956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.507253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.507406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.507572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.507572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.508030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.508184 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.508335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.508485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.508644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 19:00:32.509849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.509849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.511298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.511298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.511298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.511298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.511298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.511298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.511298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.511298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.512460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.512460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.512460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.512460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.512460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.512460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.512460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.512460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.513644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.513644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.513644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.514147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.514147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.514513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.515574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.516066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.516407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.516784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.517111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.517427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.517752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.524433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.524433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.524433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.524433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.524433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.524433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.524433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.524433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.525717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.525717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.525717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.525717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.525717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.525717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.525717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.525717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.527043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.527043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.527043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.527043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.527043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.527043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.527043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.527043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.530380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.530380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.530380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.530380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.530380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.530380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.530380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.530380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.531208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.531208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.531208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.531409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.531631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.532114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.533845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.533845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.533845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.533845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.533845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.534326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.534479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.534799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.535592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.535592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.535779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.536014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.536469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.536796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.537112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.537445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.537757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.538089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.538400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.538717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.539033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.539475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.539824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.540136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.540461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.540769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.541086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.541396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.541713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.542124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.542390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.542762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.543131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.543424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.543731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.544059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.544397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.544695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.545011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.545370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.545709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.546718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.547323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.547665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.547994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.548342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.548683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.548999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.549309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.549619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.549975 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.550295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.550611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.550930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.551247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.551561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.551876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.552236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.552498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.552863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.553118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.553433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.553744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.554082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.554405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.554788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.555146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.555529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.555791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.556114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.556429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.556743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.557053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.557367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.557686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.558044 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.558362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.558670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.559109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.559603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.559935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.560266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.560588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.560913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.562190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.562626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.562626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.563831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.563831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.563831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.564292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.564292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.564591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.564864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.565149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.565465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.565786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.566142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.566451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.566825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.567039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO dbcounter [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Registered counter for database nova_api Jun 02 19:00:32.567206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.567360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.567662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.567971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.568277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.568591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.568896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.569202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.569506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.569858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.570137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.570444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.570758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.571069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.571379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.571686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.572021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.572326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.572668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.572993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.573311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.573638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.574059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.574390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.574703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.575191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.575522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.575889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.576161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.576497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.576848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.577752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.578109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.578430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.578747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.579419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.579757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.580090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.580400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.580729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.581052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.581386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.581706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.582062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.584201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.584201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.584680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.585056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.585580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.586242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.586507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.586776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.587202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.587462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.587849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.588091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.sqlalchemy.engines [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:00:32.588324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.588517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.588796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.589123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.589483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.589848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.590173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.590496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.590808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:32.591172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 19:00:32.595180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writer thread running {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:00:32.653654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO dbcounter [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Registered counter for database nova_api Jun 02 19:00:32.654087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.context [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04738c04-a365-48d6-9e43-2e295188c73a(cell1) {{(pid=117777) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 19:00:32.658387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:00:32.659955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:00:32.660766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:00:32.662769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:00:32.664781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO dbcounter [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Registered counter for database nova_cell0 Jun 02 19:00:32.668927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO dbcounter [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Registered counter for database nova_cell1 Jun 02 19:00:32.674947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_db.sqlalchemy.engines [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:00:32.676201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.sqlalchemy.engines [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:00:32.677907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.sqlalchemy.engines [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:00:32.683198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writer thread running {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:00:32.683827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writer thread running {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:00:32.685500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writer thread running {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:00:32.743290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.context [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04738c04-a365-48d6-9e43-2e295188c73a(cell1) {{(pid=117776) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 19:00:32.747482 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:00:32.749216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:00:32.750169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:00:32.752190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:00:32.754277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO dbcounter [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Registered counter for database nova_cell0 Jun 02 19:00:32.759182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO dbcounter [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Registered counter for database nova_cell1 Jun 02 19:00:32.767265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_db.sqlalchemy.engines [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:00:32.769448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_db.sqlalchemy.engines [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:00:32.777450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writer thread running {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:00:32.777820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writer thread running {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:00:32.844981 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO dbcounter [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Registered counter for database nova_cell0 Jun 02 19:00:32.852469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.sqlalchemy.engines [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:00:32.857159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writer thread running {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:00:32.930329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO dbcounter [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Registered counter for database nova_cell0 Jun 02 19:00:32.937569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_db.sqlalchemy.engines [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:00:32.942338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writer thread running {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:00:33.310798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: WARNING keystonemiddleware.auth_token [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 19:00:33.319984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: WARNING keystonemiddleware.auth_token [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 19:00:33.387184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: WARNING keystonemiddleware.auth_token [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 19:00:33.396028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: WARNING keystonemiddleware.auth_token [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 19:00:33.549686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: WARNING keystonemiddleware.auth_token [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 19:00:33.556461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: WARNING keystonemiddleware.auth_token [None req-3762f016-d280-47ad-a9ed-f7bc025ab444 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 19:00:33.561901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b92f69b9c0 pid: 117777 (default app) Jun 02 19:00:33.671241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: WARNING keystonemiddleware.auth_token [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 19:00:33.677770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: WARNING keystonemiddleware.auth_token [None req-3e28ff0b-8206-4a70-b755-a537c8a7330e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 19:00:33.683472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b92f69b9c0 pid: 117776 (default app) Jun 02 19:01:16.646075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.646874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.647583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.648522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.723020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fcfe0f22-b64f-4203-998f-dae25c5a684b tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Action: 'create', calling method: .version_select at 0x7f5b7ae8e3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-406299930", "metadata": {"Type": "work"}}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fcfe0f22-b64f-4203-998f-dae25c5a684b tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Request method failure captured: Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 121 Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQj8i8lHG-NVqPUgGEv9GtCNHloSCrJmBBEHhfJp0h14rDxfjAAyplb4oLhqQUgI-i2UYxdloQIs3ZBCQxgHHrBfZEpYoz8dgIvnDewuOmr9UTjPL4BzWLNgZDR2rtAZzCJZrkHleITT2AcoCW3S6Sas9icGVmbLduJiUU4Wo_uaYAU Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:01:17.743072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: f81a7d3daa7e40cd965dc0df610fa525 Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-406299930", "metadata": {"Type": "work"}}} Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: Jun 02 19:01:17.744781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-406299930', 'metadata': {'Type': 'work'}}}} Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise error Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi '#$%' Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:17.745886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 19:01:17.747576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 19:01:17.749056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 19:01:17.749056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:17.749056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fcfe0f22-b64f-4203-998f-dae25c5a684b tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:17.749056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fcfe0f22-b64f-4203-998f-dae25c5a684b tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.108774 Jun 02 19:01:17.749056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Jun 2 19:01:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:01:17.759237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.760441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.761508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.762424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.991456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-10e16d2c-80aa-4145-8f39-089681e7fb2c tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Action: 'create', calling method: .version_select at 0x7f5b7af4ae50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-890871279", "metadata": {"Type": "work"}}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-10e16d2c-80aa-4145-8f39-089681e7fb2c tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Request method failure captured: Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 119 Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQj8i8lHG-NVqPUgGEv9GtCNHloSCrJmBBEHhfJp0h14rDxfjAAyplb4oLhqQUgI-i2UYxdloQIs3ZBCQxgHHrBfZEpYoz8dgIvnDewuOmr9UTjPL4BzWLNgZDR2rtAZzCJZrkHleITT2AcoCW3S6Sas9icGVmbLduJiUU4Wo_uaYAU Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:01:17.996866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: f81a7d3daa7e40cd965dc0df610fa525 Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-890871279", "metadata": {"Type": "work"}}} Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: Jun 02 19:01:17.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-890871279', 'metadata': {'Type': 'work'}}}} Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise error Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi '0' Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:18.000073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 19:01:18.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 19:01:18.003061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 19:01:18.003061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.003061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-10e16d2c-80aa-4145-8f39-089681e7fb2c tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:18.003061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-10e16d2c-80aa-4145-8f39-089681e7fb2c tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.244835 Jun 02 19:01:18.003061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1/2] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Jun 2 19:01:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:01:18.007443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f199fdd9-504b-4e85-b7da-276e324a57c9 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Action: 'create', calling method: .version_select at 0x7f5b7ad9e700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69977015", "metadata": {"Type": "work"}}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f199fdd9-504b-4e85-b7da-276e324a57c9 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Request method failure captured: Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 117 Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQj8i8lHG-NVqPUgGEv9GtCNHloSCrJmBBEHhfJp0h14rDxfjAAyplb4oLhqQUgI-i2UYxdloQIs3ZBCQxgHHrBfZEpYoz8dgIvnDewuOmr9UTjPL4BzWLNgZDR2rtAZzCJZrkHleITT2AcoCW3S6Sas9icGVmbLduJiUU4Wo_uaYAU Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:01:18.010134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: f81a7d3daa7e40cd965dc0df610fa525 Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69977015", "metadata": {"Type": "work"}}} Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: Jun 02 19:01:18.011699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-69977015', 'metadata': {'Type': 'work'}}}} Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise error Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi '' Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:18.012795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 19:01:18.014366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 19:01:18.015652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 19:01:18.015652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:18.016635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f199fdd9-504b-4e85-b7da-276e324a57c9 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:18.017533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f199fdd9-504b-4e85-b7da-276e324a57c9 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013968 Jun 02 19:01:18.018145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Jun 2 19:01:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:01:18.036077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e3f4e899-6f5c-485a-a3dd-5cb5df04228a tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Calling method '.version_select at 0x7f5b7b6c83a0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:18.613661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-03704009-2194-4577-8ec2-85733b5f32f6 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] Action: 'create', calling method: .version_select at 0x7f5b7ae8e790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1334275973", "metadata": {"Type": "work"}}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:19.846392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-e3f4e899-6f5c-485a-a3dd-5cb5df04228a tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] HTTP exception thrown: Volume tempest-invalid-837500655 could not be found. Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e3f4e899-6f5c-485a-a3dd-5cb5df04228a tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Request method failure captured: Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-837500655 HTTP/1.1 Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQj8i8lHG-NVqPUgGEv9GtCNHloSCrJmBBEHhfJp0h14rDxfjAAyplb4oLhqQUgI-i2UYxdloQIs3ZBCQxgHHrBfZEpYoz8dgIvnDewuOmr9UTjPL4BzWLNgZDR2rtAZzCJZrkHleITT2AcoCW3S6Sas9icGVmbLduJiUU4Wo_uaYAU Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:01:19.870358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: f81a7d3daa7e40cd965dc0df610fa525 Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Volume tempest-invalid-837500655 could not be found. Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'tempest-invalid-837500655'} Jun 02 19:01:19.873381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-837500655 could not be found. (HTTP 404) (Request-ID: req-ce127cf8-a742-4e4d-b479-ac5146a6b63e) Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:19.875040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 19:01:19.877200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-837500655 could not be found. Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:01:19.879996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-837500655 could not be found. Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-837500655 could not be found. Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e3f4e899-6f5c-485a-a3dd-5cb5df04228a tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Returning 404 to user: Volume tempest-invalid-837500655 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:19.886419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e3f4e899-6f5c-485a-a3dd-5cb5df04228a tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-837500655" status: 404 len: 98 microversion: 2.1 time: 1.852968 Jun 02 19:01:19.888907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1214 bytes} [Thu Jun 2 19:01:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-837500655 => generated 98 bytes in 1865 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 02 19:01:20.204401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1eeb4876-b59d-49f7-b002-d38ff42feed8 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Action: 'create', calling method: .version_select at 0x7f5b7acb3d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-721804092"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:21.101733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1eeb4876-b59d-49f7-b002-d38ff42feed8 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.206325 Jun 02 19:01:21.102763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 3/5] 10.222.0.15 () {60 vars in 1154 bytes} [Thu Jun 2 19:01:19 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1213 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 19:01:21.109473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f68e6dab-2cca-4300-9166-ab85768365f4 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004748 Jun 02 19:01:21.111137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 4/6] 10.222.0.15 () {58 vars in 1139 bytes} [Thu Jun 2 19:01:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 19:01:21.123191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1301d943-2050-43ec-8f4c-6430a2d6c140 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ace6310>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:21.154098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-03704009-2194-4577-8ec2-85733b5f32f6 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.985767 Jun 02 19:01:21.166597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 3/7] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Jun 2 19:01:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3000 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 19:01:21.186740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-105360f1-db15-4fcb-a4a4-c1fefbeae103 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017824 Jun 02 19:01:21.197406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1136 bytes} [Thu Jun 2 19:01:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 19:01:21.215008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea84fdbb-52de-4ac1-97cf-04bdc5d870d2 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] Calling method '.version_select at 0x7f5b7ad1f0d0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:21.277000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1301d943-2050-43ec-8f4c-6430a2d6c140 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3" status: 200 len: 344 microversion: 2.1 time: 0.161599 Jun 02 19:01:21.278408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:21 2022] GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:21.283770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-14380493-6d4d-4fd7-b7fa-cd881a2230bf tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Calling method '.version_select at 0x7f5b7ace69d0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:21.383429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-14380493-6d4d-4fd7-b7fa-cd881a2230bf tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] HTTP exception thrown: Volume 25a2642b-23ac-4192-b50b-89d2733175e6 could not be found. Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-14380493-6d4d-4fd7-b7fa-cd881a2230bf tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Request method failure captured: Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/os-volumes/25a2642b-23ac-4192-b50b-89d2733175e6 HTTP/1.1 Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQj8i8lHG-NVqPUgGEv9GtCNHloSCrJmBBEHhfJp0h14rDxfjAAyplb4oLhqQUgI-i2UYxdloQIs3ZBCQxgHHrBfZEpYoz8dgIvnDewuOmr9UTjPL4BzWLNgZDR2rtAZzCJZrkHleITT2AcoCW3S6Sas9icGVmbLduJiUU4Wo_uaYAU Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:01:21.385777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: f81a7d3daa7e40cd965dc0df610fa525 Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Volume 25a2642b-23ac-4192-b50b-89d2733175e6 could not be found. Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '25a2642b-23ac-4192-b50b-89d2733175e6'} Jun 02 19:01:21.387395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25a2642b-23ac-4192-b50b-89d2733175e6 could not be found. (HTTP 404) (Request-ID: req-07436a24-805f-4eb9-9983-d701cd898df1) Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:21.388434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 19:01:21.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25a2642b-23ac-4192-b50b-89d2733175e6 could not be found. Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 19:01:21.390724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25a2642b-23ac-4192-b50b-89d2733175e6 could not be found. Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25a2642b-23ac-4192-b50b-89d2733175e6 could not be found. Jun 02 19:01:21.392062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.394740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-14380493-6d4d-4fd7-b7fa-cd881a2230bf tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Returning 404 to user: Volume 25a2642b-23ac-4192-b50b-89d2733175e6 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:21.395844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-14380493-6d4d-4fd7-b7fa-cd881a2230bf tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/25a2642b-23ac-4192-b50b-89d2733175e6" status: 404 len: 109 microversion: 2.1 time: 0.116710 Jun 02 19:01:21.396411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 6/10] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:01:21 2022] DELETE /compute/v2.1/os-volumes/25a2642b-23ac-4192-b50b-89d2733175e6 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:01:21.401638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f8a070fb-e530-4138-a866-a2fe7d7487cd tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7ace6c10>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:21.467549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ea84fdbb-52de-4ac1-97cf-04bdc5d870d2 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc" status: 200 len: 354 microversion: 2.1 time: 0.267887 Jun 02 19:01:21.468622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 5/11] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:21 2022] GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc => generated 354 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:21.492554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea2ca57a-0a1f-433a-8266-1fcce2438943 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Calling method '.version_select at 0x7f5b7ad1f790>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:21.541076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f8a070fb-e530-4138-a866-a2fe7d7487cd tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e771827e-d713-4b0e-85fa-23b2455c05fe" status: 200 len: 350 microversion: 2.1 time: 0.142171 Jun 02 19:01:21.541776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:21 2022] GET /compute/v2.1/os-volumes/e771827e-d713-4b0e-85fa-23b2455c05fe => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:21.550872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-263ce130-1667-4f0e-bda2-80712f452d0a tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] Calling method '.version_select at 0x7f5b7ace6160>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:21.555961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-ea2ca57a-0a1f-433a-8266-1fcce2438943 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] HTTP exception thrown: Volume 73a2def4-6945-430a-9619-a8ef0fb0792d could not be found. Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea2ca57a-0a1f-433a-8266-1fcce2438943 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Request method failure captured: Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/os-volumes/73a2def4-6945-430a-9619-a8ef0fb0792d HTTP/1.1 Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQj8i8lHG-NVqPUgGEv9GtCNHloSCrJmBBEHhfJp0h14rDxfjAAyplb4oLhqQUgI-i2UYxdloQIs3ZBCQxgHHrBfZEpYoz8dgIvnDewuOmr9UTjPL4BzWLNgZDR2rtAZzCJZrkHleITT2AcoCW3S6Sas9icGVmbLduJiUU4Wo_uaYAU Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:01:21.564049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b1ed3fa8416e46b7b7f2ddb9981d2d5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: b1ed3fa8416e46b7b7f2ddb9981d2d5b Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesNegativeTest-758630086 Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: f81a7d3daa7e40cd965dc0df610fa525 Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesNegativeTest-758630086-project Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Volume 73a2def4-6945-430a-9619-a8ef0fb0792d could not be found. Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '73a2def4-6945-430a-9619-a8ef0fb0792d'} Jun 02 19:01:21.566938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73a2def4-6945-430a-9619-a8ef0fb0792d could not be found. (HTTP 404) (Request-ID: req-c324a51c-eedc-4497-a947-c1b3663ccb93) Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:21.568570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:21.572484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73a2def4-6945-430a-9619-a8ef0fb0792d could not be found. Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 19:01:21.576683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73a2def4-6945-430a-9619-a8ef0fb0792d could not be found. Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73a2def4-6945-430a-9619-a8ef0fb0792d could not be found. Jun 02 19:01:21.582934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:21.587721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea2ca57a-0a1f-433a-8266-1fcce2438943 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] Returning 404 to user: Volume 73a2def4-6945-430a-9619-a8ef0fb0792d could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:21.598757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ea2ca57a-0a1f-433a-8266-1fcce2438943 tempest-VolumesNegativeTest-758630086 tempest-VolumesNegativeTest-758630086-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/73a2def4-6945-430a-9619-a8ef0fb0792d" status: 404 len: 109 microversion: 2.1 time: 0.114377 Jun 02 19:01:21.602456 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:21 2022] GET /compute/v2.1/os-volumes/73a2def4-6945-430a-9619-a8ef0fb0792d => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:01:21.872688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-263ce130-1667-4f0e-bda2-80712f452d0a tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc" status: 200 len: 354 microversion: 2.1 time: 0.327912 Jun 02 19:01:21.873303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:21 2022] GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc => generated 354 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:21.909556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16724327-1055-43e4-8db2-32a199cd8110 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] Calling method '.version_select at 0x7f5b7ac6f550>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:22.165015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16724327-1055-43e4-8db2-32a199cd8110 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc" status: 202 len: 0 microversion: 2.1 time: 0.265143 Jun 02 19:01:22.165886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:01:21 2022] DELETE /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:01:22.178908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-db979da0-dd8e-4526-8b45-7c0e693e5566 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] Calling method '.version_select at 0x7f5b7ae8e700>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:22.270463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1625361019", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "networks": [{"uuid": "73ad2763-77e2-47e7-8c5e-146a2982759a"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:22.326106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-db979da0-dd8e-4526-8b45-7c0e693e5566 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc" status: 200 len: 353 microversion: 2.1 time: 0.153336 Jun 02 19:01:22.332196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:22 2022] GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc => generated 353 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:22.338089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd222972-0b3f-40de-8709-f8835da73c90 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac6f430>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:22.503487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd222972-0b3f-40de-8709-f8835da73c90 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3" status: 200 len: 345 microversion: 2.1 time: 0.169845 Jun 02 19:01:22.504358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 9/17] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:22 2022] GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 => generated 345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:22.542107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92ce78c6-57ba-446a-938a-03e45d95f388 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Action: 'create', calling method: .version_select at 0x7f5b7ac6fdc0>, body: {"snapshot": {"volume_id": "c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-138045099"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:22.554272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] validate_networks() for [('73ad2763-77e2-47e7-8c5e-146a2982759a', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:01:22.980005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92ce78c6-57ba-446a-938a-03e45d95f388 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.466853 Jun 02 19:01:22.981970 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 10/18] 10.222.0.15 () {60 vars in 1161 bytes} [Thu Jun 2 19:01:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:22.995549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c83ec92b-0543-4280-bfb0-008955b72071 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac6fc10>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:23.104363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c83ec92b-0543-4280-bfb0-008955b72071 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb" status: 200 len: 286 microversion: 2.1 time: 0.114335 Jun 02 19:01:23.107708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 11/19] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Jun 2 19:01:22 2022] GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb => generated 286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:23.120140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-99b25cde-d782-4873-9cb2-92c0a9f23a59 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac6f790>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:23.231811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-99b25cde-d782-4873-9cb2-92c0a9f23a59 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.114866 Jun 02 19:01:23.241037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 12/20] 10.222.0.15 () {58 vars in 1139 bytes} [Thu Jun 2 19:01:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:01:23.262879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d9b9a629-c587-4f50-ab94-887fc55266ee tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac74310>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:23.357853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d9b9a629-c587-4f50-ab94-887fc55266ee tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb" status: 200 len: 286 microversion: 2.1 time: 0.112681 Jun 02 19:01:23.361941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 13/21] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Jun 2 19:01:23 2022] GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:23.372692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-30f891d0-8fe9-4c8b-af2a-18fa8dbbd433 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] Calling method '.version_select at 0x7f5b7b6cb430>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:23.432464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-30f891d0-8fe9-4c8b-af2a-18fa8dbbd433 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] HTTP exception thrown: Volume 4a595830-6f7c-44f1-b42a-053a616cafdc could not be found. Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-30f891d0-8fe9-4c8b-af2a-18fa8dbbd433 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] Request method failure captured: Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc HTTP/1.1 Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQj-EOEiXq9SDl9mMCaUmTkyFWJlUYS1q2IgyhRD6mrE5-Io40g-Y_Ajuqd85lNg0Jxnyku-wxeQLu9y_AARD2O7uE5T8tMBF02nZLwcro1Y2mgn0VHLJKP1mmpuvxTblKVgMh3i9KICNhQSiZV1hFyg5a6gn4w8AvZ8f8OI7Pp2FqY Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: d189f695095c4d27b6b93c7419ac0bbe Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesGetTestJSON-15484707 Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:01:23.434719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d189f695095c4d27b6b93c7419ac0bbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d189f695095c4d27b6b93c7419ac0bbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d189f695095c4d27b6b93c7419ac0bbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d189f695095c4d27b6b93c7419ac0bbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesGetTestJSON-15484707 Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: d189f695095c4d27b6b93c7419ac0bbe Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesGetTestJSON-15484707 Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesGetTestJSON-15484707-project Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 79aac82943d54deb83995911fdf6f2c2 Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesGetTestJSON-15484707-project Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Volume 4a595830-6f7c-44f1-b42a-053a616cafdc could not be found. Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '4a595830-6f7c-44f1-b42a-053a616cafdc'} Jun 02 19:01:23.436287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a595830-6f7c-44f1-b42a-053a616cafdc could not be found. (HTTP 404) (Request-ID: req-98023c7b-d8e3-452c-8db5-0a94cd3e4438) Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:23.436875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:23.438440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a595830-6f7c-44f1-b42a-053a616cafdc could not be found. Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 19:01:23.439772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a595830-6f7c-44f1-b42a-053a616cafdc could not be found. Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a595830-6f7c-44f1-b42a-053a616cafdc could not be found. Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-30f891d0-8fe9-4c8b-af2a-18fa8dbbd433 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] Returning 404 to user: Volume 4a595830-6f7c-44f1-b42a-053a616cafdc could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:23.442098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-30f891d0-8fe9-4c8b-af2a-18fa8dbbd433 tempest-VolumesGetTestJSON-15484707 tempest-VolumesGetTestJSON-15484707-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc" status: 404 len: 109 microversion: 2.1 time: 0.073287 Jun 02 19:01:23.445619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 14/22] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:23 2022] GET /compute/v2.1/os-volumes/4a595830-6f7c-44f1-b42a-053a616cafdc => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:01:23.692596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ee71b2e8-af4d-4eec-a709-84665f02e4aa tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7ac6fca0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:23.810487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ee71b2e8-af4d-4eec-a709-84665f02e4aa tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fc97a79e-040e-4bce-9a3f-90e30dbadfb1" status: 200 len: 351 microversion: 2.1 time: 0.137491 Jun 02 19:01:23.812920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 15/23] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:23 2022] GET /compute/v2.1/os-volumes/fc97a79e-040e-4bce-9a3f-90e30dbadfb1 => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:24.377144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3f48d787-98fa-4a86-89ac-8be70f2318ae tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac6f940>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:24.499296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3f48d787-98fa-4a86-89ac-8be70f2318ae tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb" status: 200 len: 286 microversion: 2.1 time: 0.131169 Jun 02 19:01:24.500063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 16/24] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Jun 2 19:01:24 2022] GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:01:25.098230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:01:25.098759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:01:25.099275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:01:25.100632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:01:25.101215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:01:25.151182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:25.153233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:25.154461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:25.155555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:25.209963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Getting quotas for project 8e515ddd7313434f9e3dd34debc97877. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:01:25.237238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Getting quotas for user daefcb4d04ee4bc5b2c1a7b755077a4a and project 8e515ddd7313434f9e3dd34debc97877. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:01:25.260070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:01:25.267330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:01:25.384973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-871c1ad0-58fa-497b-a536-6096d79cf76b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.250200 Jun 02 19:01:25.385588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 9/25] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:01:25.404145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2129f0d8-75c8-4e55-b2e3-6c092d25c673 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:25.404969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2129f0d8-75c8-4e55-b2e3-6c092d25c673 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:25.514377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-beb2498b-7a9d-4fb0-95e8-691b57e28c44 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7a36b4c0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:25.730538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-beb2498b-7a9d-4fb0-95e8-691b57e28c44 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb" status: 200 len: 286 microversion: 2.1 time: 0.222254 Jun 02 19:01:25.731369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 10/26] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Jun 2 19:01:25 2022] GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb => generated 286 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:25.803845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2129f0d8-75c8-4e55-b2e3-6c092d25c673 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:25.841003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2129f0d8-75c8-4e55-b2e3-6c092d25c673 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1215 microversion: 2.1 time: 0.445969 Jun 02 19:01:25.856351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 17/27] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:25 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1215 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:26.666237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a0751af3-a695-495a-a59d-0fdd33e55342 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7a36bc10>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:26.743998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eb602211-8239-400f-ad3a-06bd8c89cd91 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac744c0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:26.846936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a0751af3-a695-495a-a59d-0fdd33e55342 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b437d69a-68e7-41f9-bbf1-94189fd52051" status: 200 len: 350 microversion: 2.1 time: 0.184516 Jun 02 19:01:26.847747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 11/28] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:26 2022] GET /compute/v2.1/os-volumes/b437d69a-68e7-41f9-bbf1-94189fd52051 => generated 350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:01:26.860125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e19bb4cd-9980-4006-9235-79352db35e19 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7a37a310>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:26.944476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-eb602211-8239-400f-ad3a-06bd8c89cd91 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb" status: 200 len: 287 microversion: 2.1 time: 0.204353 Jun 02 19:01:26.945244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 18/29] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Jun 2 19:01:26 2022] GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb => generated 287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:26.951080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7d5b0140-6811-49cf-9d36-804a50f67d17 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:26.951716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7d5b0140-6811-49cf-9d36-804a50f67d17 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:27.171920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d5b0140-6811-49cf-9d36-804a50f67d17 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:27.203931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7d5b0140-6811-49cf-9d36-804a50f67d17 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1215 microversion: 2.1 time: 0.256787 Jun 02 19:01:27.210310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 19/30] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:26 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:27.238805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-83cb4460-aaf3-4203-bbcc-cecc1cc5cb12 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac3eaf0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:27.242470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e19bb4cd-9980-4006-9235-79352db35e19 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.386398 Jun 02 19:01:27.243725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 12/31] 10.222.0.15 () {58 vars in 1133 bytes} [Thu Jun 2 19:01:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:27.258716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8188170b-bfd9-48d1-b9cf-ad974075c7e0 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7a36b9d0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:27.521374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-83cb4460-aaf3-4203-bbcc-cecc1cc5cb12 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb" status: 202 len: 0 microversion: 2.1 time: 0.308867 Jun 02 19:01:27.526707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 20/32] 10.222.0.15 () {58 vars in 1253 bytes} [Thu Jun 2 19:01:27 2022] DELETE /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:01:27.590662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edb59e87-562a-418a-8d55-b4a32dec18f5 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac3e1f0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:27.811208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-edb59e87-562a-418a-8d55-b4a32dec18f5 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] HTTP exception thrown: Snapshot e1f76108-5bfa-4f67-be4f-351e75d5d3cb could not be found. Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edb59e87-562a-418a-8d55-b4a32dec18f5 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Request method failure captured: Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb HTTP/1.1 Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQj-ggNrPPGobB9gFhFmvoMMaW8T5dQVz9s49pgYY3CHHUn-ToNk44BxAqSlQ-hqqwH3vRGqxaXYUWS1Amon_yVn10jUBV2ecVnW5XJItDioxeI5K-n1IviV33yE4Mw5StZCUpfdgMQsqT_QS8oeVpApydjeiFHf3vHfysXhnUmvE1o Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 2c5cf4734d8e430db02969affe17b102 Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:01:27.817285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c5cf4734d8e430db02969affe17b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 2c5cf4734d8e430db02969affe17b102 Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotsTestJSON-160745186-project Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 5bb0cf077f484094ae382ad949c24373 Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotsTestJSON-160745186-project Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Snapshot e1f76108-5bfa-4f67-be4f-351e75d5d3cb could not be found. Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': 'e1f76108-5bfa-4f67-be4f-351e75d5d3cb'} Jun 02 19:01:27.818403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e1f76108-5bfa-4f67-be4f-351e75d5d3cb could not be found. (HTTP 404) (Request-ID: req-41dd2529-41ea-446f-9a21-6ae95e2c92aa) Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:27.819367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:27.820714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e1f76108-5bfa-4f67-be4f-351e75d5d3cb could not be found. Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 02 19:01:27.822672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e1f76108-5bfa-4f67-be4f-351e75d5d3cb could not be found. Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e1f76108-5bfa-4f67-be4f-351e75d5d3cb could not be found. Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edb59e87-562a-418a-8d55-b4a32dec18f5 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Returning 404 to user: Snapshot e1f76108-5bfa-4f67-be4f-351e75d5d3cb could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:27.825278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-edb59e87-562a-418a-8d55-b4a32dec18f5 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb" status: 404 len: 111 microversion: 2.1 time: 0.286770 Jun 02 19:01:27.829607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 21/33] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Jun 2 19:01:27 2022] GET /compute/v2.1/os-snapshots/e1f76108-5bfa-4f67-be4f-351e75d5d3cb => generated 111 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 19:01:27.884388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1838c659-1213-4be4-95c1-465a66c1f135 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac3ed30>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:28.012665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8188170b-bfd9-48d1-b9cf-ad974075c7e0 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.758933 Jun 02 19:01:28.015348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 13/34] 10.222.0.15 () {58 vars in 1148 bytes} [Thu Jun 2 19:01:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:28.030356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b7faeccb-d11d-4ab0-8777-b58f748c4bf8 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7ace6550>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:28.148197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1838c659-1213-4be4-95c1-465a66c1f135 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3" status: 202 len: 0 microversion: 2.1 time: 0.308925 Jun 02 19:01:28.149622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 22/35] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:01:27 2022] DELETE /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:01:28.171894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-798cf648-6d77-4a35-8a4e-ec8f05227b06 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac3eee0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:28.448573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-798cf648-6d77-4a35-8a4e-ec8f05227b06 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3" status: 200 len: 344 microversion: 2.1 time: 0.282657 Jun 02 19:01:28.462335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 23/36] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:28 2022] GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 => generated 344 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:01:28.469846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dccea6dc-55a2-4f5e-b430-7afb3b4b811f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:28.471280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b7faeccb-d11d-4ab0-8777-b58f748c4bf8 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.446911 Jun 02 19:01:28.473192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 14/37] 10.222.0.15 () {58 vars in 1133 bytes} [Thu Jun 2 19:01:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:28.474947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dccea6dc-55a2-4f5e-b430-7afb3b4b811f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:28.490580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-879d4124-f76a-4cdd-b773-6458da0bd6f3 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7a37ac10>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:28.498343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dccea6dc-55a2-4f5e-b430-7afb3b4b811f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:28.507922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dccea6dc-55a2-4f5e-b430-7afb3b4b811f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:28.511575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dccea6dc-55a2-4f5e-b430-7afb3b4b811f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:28.512393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dccea6dc-55a2-4f5e-b430-7afb3b4b811f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:28.710525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-879d4124-f76a-4cdd-b773-6458da0bd6f3 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.228333 Jun 02 19:01:28.711067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 15/38] 10.222.0.15 () {58 vars in 1166 bytes} [Thu Jun 2 19:01:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:28.725197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c098637b-6f3e-4088-a496-f0da69ea8d6a tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7a37a280>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:28.906069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c098637b-6f3e-4088-a496-f0da69ea8d6a tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.185608 Jun 02 19:01:28.906476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 16/39] 10.222.0.15 () {58 vars in 1169 bytes} [Thu Jun 2 19:01:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:01:28.920669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-43f434e9-11f2-4c9e-905b-55f08aa2d4c1 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7ace6820>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:28.927326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dccea6dc-55a2-4f5e-b430-7afb3b4b811f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:28.949499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dccea6dc-55a2-4f5e-b430-7afb3b4b811f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1219 microversion: 2.1 time: 0.485866 Jun 02 19:01:28.950167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 24/40] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:28 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1219 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:29.175352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-43f434e9-11f2-4c9e-905b-55f08aa2d4c1 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.259254 Jun 02 19:01:29.175945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 17/41] 10.222.0.15 () {58 vars in 1154 bytes} [Thu Jun 2 19:01:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:29.189082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7d29c14c-567c-4bce-844e-83b9a92913d2 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7a36b9d0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:29.419861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7d29c14c-567c-4bce-844e-83b9a92913d2 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.234749 Jun 02 19:01:29.431699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 18/42] 10.222.0.15 () {58 vars in 1187 bytes} [Thu Jun 2 19:01:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:29.441010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-98c2f137-6e4a-4f44-9fe9-bae197b61e69 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] Calling method '.version_select at 0x7f5b7a36b790>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:29.595938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dc3fd60a-a83d-459b-a93f-4f014e15ba89 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Action: 'create', calling method: .version_select at 0x7f5b7abb44c0>, body: {"keypair": {"name": "tempest-keypair-989001248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf2vqcrDwmlcO8gZMA7o0Fx2ZE4Ohk1X7dVt/ce+Vyro8PTrOpy4VHbjC56YCTJ3falonG7/mbYsTqXZowerAiczKdIKcxG3topbJ2N+tANZtkVMQcrd1Yz0SMfFM0AFA=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:29.628609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-98c2f137-6e4a-4f44-9fe9-bae197b61e69 tempest-VolumesTestJSON-1248729061 tempest-VolumesTestJSON-1248729061-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.195479 Jun 02 19:01:29.629715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 19/43] 10.222.0.15 () {58 vars in 1154 bytes} [Thu Jun 2 19:01:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:29.635888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-52425baa-805b-4e46-ab2d-0f9c69225b17 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7a37af70>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:29.737135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-dc3fd60a-a83d-459b-a93f-4f014e15ba89 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Getting quotas for project a23ef70d937643f8a1c8597a8cfac596. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:01:29.765252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-dc3fd60a-a83d-459b-a93f-4f014e15ba89 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Getting quotas for user cef7ac127d2f4284a1808c580148c9e0 and project a23ef70d937643f8a1c8597a8cfac596. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:01:29.811439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-52425baa-805b-4e46-ab2d-0f9c69225b17 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3" status: 200 len: 344 microversion: 2.1 time: 0.180408 Jun 02 19:01:29.812267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 20/44] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:29 2022] GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:29.970228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d424fb16-6e29-4c05-ad75-81611498746e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:29.970850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d424fb16-6e29-4c05-ad75-81611498746e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:29.972615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dc3fd60a-a83d-459b-a93f-4f014e15ba89 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.829128 Jun 02 19:01:29.973238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 25/45] 10.222.0.15 () {62 vars in 1199 bytes} [Thu Jun 2 19:01:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 831 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 19:01:30.021450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d424fb16-6e29-4c05-ad75-81611498746e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:30.030997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d424fb16-6e29-4c05-ad75-81611498746e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:30.032066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d424fb16-6e29-4c05-ad75-81611498746e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:30.037360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d424fb16-6e29-4c05-ad75-81611498746e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:30.400137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d424fb16-6e29-4c05-ad75-81611498746e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:30.433655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d424fb16-6e29-4c05-ad75-81611498746e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1219 microversion: 2.1 time: 0.468640 Jun 02 19:01:30.435353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 21/46] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:29 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1219 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:30.827549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-01a07515-2625-412e-8b90-604c742a44d4 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ab615e0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:30.941279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-01a07515-2625-412e-8b90-604c742a44d4 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] HTTP exception thrown: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-01a07515-2625-412e-8b90-604c742a44d4 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Request method failure captured: Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 HTTP/1.1 Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQj-ggNrPPGobB9gFhFmvoMMaW8T5dQVz9s49pgYY3CHHUn-ToNk44BxAqSlQ-hqqwH3vRGqxaXYUWS1Amon_yVn10jUBV2ecVnW5XJItDioxeI5K-n1IviV33yE4Mw5StZCUpfdgMQsqT_QS8oeVpApydjeiFHf3vHfysXhnUmvE1o Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 2c5cf4734d8e430db02969affe17b102 Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:01:30.945987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c5cf4734d8e430db02969affe17b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 2c5cf4734d8e430db02969affe17b102 Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotsTestJSON-160745186-project Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 5bb0cf077f484094ae382ad949c24373 Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotsTestJSON-160745186-project Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': 'c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3'} Jun 02 19:01:30.947163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. (HTTP 404) (Request-ID: req-a41a30d8-7cb5-4499-8f0e-f43cb65ed241) Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:30.947937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:30.948961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 19:01:30.950496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-01a07515-2625-412e-8b90-604c742a44d4 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Returning 404 to user: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:30.951633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-01a07515-2625-412e-8b90-604c742a44d4 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3" status: 404 len: 109 microversion: 2.1 time: 0.127816 Jun 02 19:01:30.960092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 26/47] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:30 2022] GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:01:30.964104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a2585796-fe93-4471-b0f5-097414c78af8 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7a36b310>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:31.091052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-a2585796-fe93-4471-b0f5-097414c78af8 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] HTTP exception thrown: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a2585796-fe93-4471-b0f5-097414c78af8 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Request method failure captured: Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 HTTP/1.1 Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQj-ggNrPPGobB9gFhFmvoMMaW8T5dQVz9s49pgYY3CHHUn-ToNk44BxAqSlQ-hqqwH3vRGqxaXYUWS1Amon_yVn10jUBV2ecVnW5XJItDioxeI5K-n1IviV33yE4Mw5StZCUpfdgMQsqT_QS8oeVpApydjeiFHf3vHfysXhnUmvE1o Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 2c5cf4734d8e430db02969affe17b102 Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:01:31.093179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c5cf4734d8e430db02969affe17b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 2c5cf4734d8e430db02969affe17b102 Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesSnapshotsTestJSON-160745186-project Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 5bb0cf077f484094ae382ad949c24373 Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-160745186-project Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3'} Jun 02 19:01:31.094942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. (HTTP 404) (Request-ID: req-54b1adec-fede-4f43-aa25-9e3f11fedca1) Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:31.095604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 19:01:31.096474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 19:01:31.097393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a2585796-fe93-4471-b0f5-097414c78af8 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Returning 404 to user: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a2585796-fe93-4471-b0f5-097414c78af8 tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3" status: 404 len: 109 microversion: 2.1 time: 0.134983 Jun 02 19:01:31.098527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 22/48] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:01:30 2022] DELETE /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 19:01:31.104727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ccf1a30-5437-45af-83bd-1c0880872afa tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Calling method '.version_select at 0x7f5b7ac3e790>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:31.344867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-5ccf1a30-5437-45af-83bd-1c0880872afa tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] HTTP exception thrown: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ccf1a30-5437-45af-83bd-1c0880872afa tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Request method failure captured: Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 HTTP/1.1 Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQj-ggNrPPGobB9gFhFmvoMMaW8T5dQVz9s49pgYY3CHHUn-ToNk44BxAqSlQ-hqqwH3vRGqxaXYUWS1Amon_yVn10jUBV2ecVnW5XJItDioxeI5K-n1IviV33yE4Mw5StZCUpfdgMQsqT_QS8oeVpApydjeiFHf3vHfysXhnUmvE1o Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 2c5cf4734d8e430db02969affe17b102 Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:01:31.346928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c5cf4734d8e430db02969affe17b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c5cf4734d8e430db02969affe17b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 2c5cf4734d8e430db02969affe17b102 Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-160745186 Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotsTestJSON-160745186-project Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 5bb0cf077f484094ae382ad949c24373 Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotsTestJSON-160745186-project Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': 'c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3'} Jun 02 19:01:31.347938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. (HTTP 404) (Request-ID: req-45757d87-9033-45de-908f-707942c887ec) Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:31.348586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 19:01:31.349478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 19:01:31.351094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ccf1a30-5437-45af-83bd-1c0880872afa tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] Returning 404 to user: Volume c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ccf1a30-5437-45af-83bd-1c0880872afa tempest-VolumesSnapshotsTestJSON-160745186 tempest-VolumesSnapshotsTestJSON-160745186-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3" status: 404 len: 109 microversion: 2.1 time: 0.248093 Jun 02 19:01:31.353284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 27/49] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Jun 2 19:01:31 2022] GET /compute/v2.1/os-volumes/c5c0a11e-0e1d-4f6b-9a01-80076aa95aa3 => generated 109 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:01:31.455100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6fb570e4-b08a-4ed5-b1be-0f11dbff1dc5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:31.456748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6fb570e4-b08a-4ed5-b1be-0f11dbff1dc5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:31.499095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fb570e4-b08a-4ed5-b1be-0f11dbff1dc5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:31.499464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fb570e4-b08a-4ed5-b1be-0f11dbff1dc5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:31.500265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fb570e4-b08a-4ed5-b1be-0f11dbff1dc5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:31.511580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fb570e4-b08a-4ed5-b1be-0f11dbff1dc5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:31.883464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6fb570e4-b08a-4ed5-b1be-0f11dbff1dc5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:31.899366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6fb570e4-b08a-4ed5-b1be-0f11dbff1dc5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1211 microversion: 2.1 time: 0.450881 Jun 02 19:01:31.906475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 23/50] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:31 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1211 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:32.918278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-696ce73e-30b6-464b-bb4f-0713b10b3d14 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:32.921947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-696ce73e-30b6-464b-bb4f-0713b10b3d14 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:32.954695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-696ce73e-30b6-464b-bb4f-0713b10b3d14 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:32.955323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-696ce73e-30b6-464b-bb4f-0713b10b3d14 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:32.956168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-696ce73e-30b6-464b-bb4f-0713b10b3d14 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:32.956616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-696ce73e-30b6-464b-bb4f-0713b10b3d14 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:33.850193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-696ce73e-30b6-464b-bb4f-0713b10b3d14 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:33.875989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-696ce73e-30b6-464b-bb4f-0713b10b3d14 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1273 microversion: 2.1 time: 0.957819 Jun 02 19:01:33.879072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 28/51] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:32 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1273 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:34.382329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-147056124", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0bab12a-826d-423a-95fa-da9a185f22b6"}], "security_groups": [{"name": "tempest-securitygroup--1136857123"}], "key_name": "tempest-keypair-989001248", "user_data": "}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:34.894894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8b1b56fe-0e3c-4a0c-860f-7441d7b8ee5a tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:34.895568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8b1b56fe-0e3c-4a0c-860f-7441d7b8ee5a tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:34.905414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b1b56fe-0e3c-4a0c-860f-7441d7b8ee5a tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:34.905898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b1b56fe-0e3c-4a0c-860f-7441d7b8ee5a tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:34.906691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b1b56fe-0e3c-4a0c-860f-7441d7b8ee5a tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:34.907132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b1b56fe-0e3c-4a0c-860f-7441d7b8ee5a tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:35.139584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8b1b56fe-0e3c-4a0c-860f-7441d7b8ee5a tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:35.154614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8b1b56fe-0e3c-4a0c-860f-7441d7b8ee5a tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1273 microversion: 2.1 time: 0.258254 Jun 02 19:01:35.157042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 29/52] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:34 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:35.179520 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.251025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.928250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] validate_networks() for [('e0bab12a-826d-423a-95fa-da9a185f22b6', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:01:36.173848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e26d0260-3c9d-4d9f-97e7-818a387165cf tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:36.174490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e26d0260-3c9d-4d9f-97e7-818a387165cf tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:36.204432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e26d0260-3c9d-4d9f-97e7-818a387165cf tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:36.204889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e26d0260-3c9d-4d9f-97e7-818a387165cf tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:36.212679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e26d0260-3c9d-4d9f-97e7-818a387165cf tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:36.213323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e26d0260-3c9d-4d9f-97e7-818a387165cf tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:36.900974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e26d0260-3c9d-4d9f-97e7-818a387165cf tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:36.937764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e26d0260-3c9d-4d9f-97e7-818a387165cf tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1273 microversion: 2.1 time: 0.767968 Jun 02 19:01:36.958132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 30/53] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:36 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1273 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:37.961749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-24472fd7-75cb-4cda-aa9e-af5fba362582 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:37.963517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-24472fd7-75cb-4cda-aa9e-af5fba362582 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:37.989096 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24472fd7-75cb-4cda-aa9e-af5fba362582 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:37.996915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24472fd7-75cb-4cda-aa9e-af5fba362582 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:38.006917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24472fd7-75cb-4cda-aa9e-af5fba362582 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:38.007633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24472fd7-75cb-4cda-aa9e-af5fba362582 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:39.605132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:01:39.605862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:01:39.606111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:01:39.606519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:01:39.606933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:01:39.621731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:39.638722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:39.638722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:39.638722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:39.644227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-24472fd7-75cb-4cda-aa9e-af5fba362582 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:39.666841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-24472fd7-75cb-4cda-aa9e-af5fba362582 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 1.710268 Jun 02 19:01:39.680468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 31/54] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:37 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:39.739486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Getting quotas for project a23ef70d937643f8a1c8597a8cfac596. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:01:39.755876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Getting quotas for user cef7ac127d2f4284a1808c580148c9e0 and project a23ef70d937643f8a1c8597a8cfac596. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:01:39.784193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:01:39.786760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:01:39.849779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=8 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:39.877288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a33ea77-d0d7-4f4d-a770-97d8e99d6931 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.500969 Jun 02 19:01:39.877982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 24/55] 10.222.0.15 () {62 vars in 1187 bytes} [Thu Jun 2 19:01:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 5503 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 19:01:39.896715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6594d96a-82c8-4c62-94a8-76820ad2a995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:39.899668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6594d96a-82c8-4c62-94a8-76820ad2a995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:40.027610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6594d96a-82c8-4c62-94a8-76820ad2a995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:40.044132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6594d96a-82c8-4c62-94a8-76820ad2a995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:40.045719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6594d96a-82c8-4c62-94a8-76820ad2a995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:40.051881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6594d96a-82c8-4c62-94a8-76820ad2a995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1280 microversion: 2.20 time: 0.163833 Jun 02 19:01:40.054791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 25/56] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1280 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:40.114933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b5315f44-33b6-4584-9e6b-42cdf6720ce7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: .version_select at 0x7f5b7a30e9d0>, body: {"keypair": {"name": "tempest-keypair-1916304051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4jRPSH1YVdG03m/X27zK9puYMT6yZX2ZalAQd7CGvH5+rYmAZVX7ZRUquN5+CAWxSVxyUO1nUzvrR24WqHiXbNKuRW7ZBgA4EGxPomXSqU36Hfs+wf1UqTNMV4eXU3Fw=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:40.206672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-b5315f44-33b6-4584-9e6b-42cdf6720ce7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for project 5a66e7666ca24a079738eea09c470cdd. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:01:40.227574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-b5315f44-33b6-4584-9e6b-42cdf6720ce7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for user 4a660a47927140d6b4d0543de5e281a1 and project 5a66e7666ca24a079738eea09c470cdd. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:01:40.297291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b5315f44-33b6-4584-9e6b-42cdf6720ce7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.615175 Jun 02 19:01:40.298221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 32/57] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:01:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:40.699043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d58c83bf-7a37-4d24-a08b-d08a36c3b848 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:40.701305 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d58c83bf-7a37-4d24-a08b-d08a36c3b848 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:40.756014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d58c83bf-7a37-4d24-a08b-d08a36c3b848 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:40.757724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d58c83bf-7a37-4d24-a08b-d08a36c3b848 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:40.764468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d58c83bf-7a37-4d24-a08b-d08a36c3b848 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:40.765557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d58c83bf-7a37-4d24-a08b-d08a36c3b848 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:41.072455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4a5e968d-3c25-4388-aa21-d7d6f0787bce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:41.083177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4a5e968d-3c25-4388-aa21-d7d6f0787bce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:41.396338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4a5e968d-3c25-4388-aa21-d7d6f0787bce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:41.417121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4a5e968d-3c25-4388-aa21-d7d6f0787bce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:41.421675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4a5e968d-3c25-4388-aa21-d7d6f0787bce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:41.428081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4a5e968d-3c25-4388-aa21-d7d6f0787bce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1280 microversion: 2.20 time: 0.357856 Jun 02 19:01:41.430186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 33/58] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1280 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:41.548634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d58c83bf-7a37-4d24-a08b-d08a36c3b848 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:41.576512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d58c83bf-7a37-4d24-a08b-d08a36c3b848 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.885263 Jun 02 19:01:41.577184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 26/59] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:40 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:42.448624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:42.449790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:42.475391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:42.476219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:42.479336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:42.480355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:42.599302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-82f9db16-bad9-41cc-ba30-6ba5f1f55fab tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:42.600409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-82f9db16-bad9-41cc-ba30-6ba5f1f55fab tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:42.645900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82f9db16-bad9-41cc-ba30-6ba5f1f55fab tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:42.647393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82f9db16-bad9-41cc-ba30-6ba5f1f55fab tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:42.652873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82f9db16-bad9-41cc-ba30-6ba5f1f55fab tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:42.660327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82f9db16-bad9-41cc-ba30-6ba5f1f55fab tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:43.374506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:43.387570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:43.398669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:43.402949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1b6ecf5a-e810-4778-8b66-9e333b9408eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1284 microversion: 2.20 time: 0.958458 Jun 02 19:01:43.408758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 34/60] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1284 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:44.430034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:44.433037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:44.460026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:44.466438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:44.470375 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:44.472945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:44.818542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-82f9db16-bad9-41cc-ba30-6ba5f1f55fab tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:44.853611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-82f9db16-bad9-41cc-ba30-6ba5f1f55fab tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 2.260296 Jun 02 19:01:44.857686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 27/61] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:42 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:44.912121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:44.949446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:44.960801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:44.962884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3424c48a-ec32-4b8f-ab18-8cfbe620c747 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1338 microversion: 2.20 time: 0.542259 Jun 02 19:01:44.975812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 35/62] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1338 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:45.892887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e4c29f05-4c20-419a-8461-567632734152 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:45.894991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e4c29f05-4c20-419a-8461-567632734152 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:45.926885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4c29f05-4c20-419a-8461-567632734152 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:45.928374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4c29f05-4c20-419a-8461-567632734152 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:45.929441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4c29f05-4c20-419a-8461-567632734152 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:45.930721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4c29f05-4c20-419a-8461-567632734152 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:45.982806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:45.984026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:46.004250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:46.005003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:46.006490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:46.009270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:46.562442 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:46.574761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:46.580497 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:46.584751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f9eab5e7-31fa-4273-bbe0-1d62f7310cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1338 microversion: 2.20 time: 0.605111 Jun 02 19:01:46.586188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 36/63] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1338 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:01:46.999697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1249078087", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60bdcf03-2f93-4152-823f-c85a0a62a5ae"}], "security_groups": [{"name": "tempest-securitygroup--660293801"}], "key_name": "tempest-keypair-1916304051", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:47.066979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:47.669702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e4c29f05-4c20-419a-8461-567632734152 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:47.691332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e4c29f05-4c20-419a-8461-567632734152 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 1.820390 Jun 02 19:01:47.708675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 28/64] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:45 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:47.715372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:47.716351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:47.724567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:47.725230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:47.726540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:47.727224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:47.826898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] validate_networks() for [('60bdcf03-2f93-4152-823f-c85a0a62a5ae', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:01:47.954214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:47.967972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:47.974592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:47.975896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-56de3c3e-3b4d-4472-93e7-ebcb359e1e9c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1338 microversion: 2.20 time: 0.265747 Jun 02 19:01:47.990290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 29/65] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1338 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:48.720884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-29e9eb63-66d4-4029-b350-499bfa0e53f5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:48.723306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-29e9eb63-66d4-4029-b350-499bfa0e53f5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:48.727768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:48.739637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29e9eb63-66d4-4029-b350-499bfa0e53f5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:48.740436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29e9eb63-66d4-4029-b350-499bfa0e53f5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:48.742357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29e9eb63-66d4-4029-b350-499bfa0e53f5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:48.744032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29e9eb63-66d4-4029-b350-499bfa0e53f5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:48.751583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=41 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:49.139059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-29e9eb63-66d4-4029-b350-499bfa0e53f5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:49.153230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-29e9eb63-66d4-4029-b350-499bfa0e53f5 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.447081 Jun 02 19:01:49.153893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 30/66] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:48 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:49.191307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:49.194108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:49.216025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:49.216487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:49.217298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:49.217734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:49.705996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:50.026630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:50.047570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:50.054961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:50.057169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47d19e2a-614f-420a-a93a-e7d84d429caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.891572 Jun 02 19:01:50.073080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 31/67] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:50.095162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=8 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:50.572934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:01:50.574238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:01:50.574900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:01:50.576475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:01:50.576966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:01:50.605043 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:50.606314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:50.610534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:50.611867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:50.719153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for project 5a66e7666ca24a079738eea09c470cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:01:50.731730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for user 4a660a47927140d6b4d0543de5e281a1 and project 5a66e7666ca24a079738eea09c470cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:01:50.746756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-d1eaa872-5c58-4dc9-b30c-a1dc749d714c req-ddd83113-8afb-4dc7-af45-754e1f335083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d84c32a3-34d0-4b69-b460-8227b00aa799", "tag": "b1eba833-64bd-484c-a46c-273cbe1d276e"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:50.758626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:01:50.768234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:01:50.777490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d1eaa872-5c58-4dc9-b30c-a1dc749d714c req-ddd83113-8afb-4dc7-af45-754e1f335083 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:50.778328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d1eaa872-5c58-4dc9-b30c-a1dc749d714c req-ddd83113-8afb-4dc7-af45-754e1f335083 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:50.820532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-d1eaa872-5c58-4dc9-b30c-a1dc749d714c req-ddd83113-8afb-4dc7-af45-754e1f335083 service nova] Creating event network-changed:b1eba833-64bd-484c-a46c-273cbe1d276e for instance d84c32a3-34d0-4b69-b460-8227b00aa799 on hv-cinder-79760 Jun 02 19:01:50.821501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d1eaa872-5c58-4dc9-b30c-a1dc749d714c req-ddd83113-8afb-4dc7-af45-754e1f335083 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 19:01:50.823940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f443265a-045d-4a56-8ce0-1d7122ff091c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:50.824885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f443265a-045d-4a56-8ce0-1d7122ff091c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:50.826550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f443265a-045d-4a56-8ce0-1d7122ff091c None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:50.828231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f443265a-045d-4a56-8ce0-1d7122ff091c None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:50.844455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.compute.rpcapi [None req-f443265a-045d-4a56-8ce0-1d7122ff091c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 19:01:50.846425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f443265a-045d-4a56-8ce0-1d7122ff091c None None] Releasing lock "compute-rpcapi-router" {{(pid=117776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 19:01:50.884078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f443265a-045d-4a56-8ce0-1d7122ff091c None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.808747 Jun 02 19:01:50.885488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 32/68] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:50.895347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cba3239d-df85-4416-8d09-bdd73b492c34 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:50.896210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cba3239d-df85-4416-8d09-bdd73b492c34 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:50.922175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ceb1d98-1448-4997-8eec-600db1205e3a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.930269 Jun 02 19:01:50.930765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 37/69] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:01:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 3940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 19:01:50.938193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-71d0724a-0ee2-49de-ba6d-4411aafe058b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:50.944454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-71d0724a-0ee2-49de-ba6d-4411aafe058b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:50.947057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cba3239d-df85-4416-8d09-bdd73b492c34 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:50.949289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cba3239d-df85-4416-8d09-bdd73b492c34 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:50.954775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cba3239d-df85-4416-8d09-bdd73b492c34 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:50.956382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cba3239d-df85-4416-8d09-bdd73b492c34 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:51.323026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-71d0724a-0ee2-49de-ba6d-4411aafe058b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:51.344431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-71d0724a-0ee2-49de-ba6d-4411aafe058b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1242 microversion: 2.1 time: 0.411788 Jun 02 19:01:51.345038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 38/70] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:50 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1242 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:51.369860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:51.374519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:51.409896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:51.410364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:51.413463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:51.415790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:51.978462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cba3239d-df85-4416-8d09-bdd73b492c34 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:51.988537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cba3239d-df85-4416-8d09-bdd73b492c34 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 1.100644 Jun 02 19:01:51.989132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 33/71] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:50 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:52.017369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:52.030587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:52.032517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:52.035985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f333195f-8363-4a14-bd1e-74115968f7c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.674922 Jun 02 19:01:52.036883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 39/72] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:52.181318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-edd8ad23-dd41-4f5b-b679-15662703ca0a req-ab0ee4eb-0842-492b-b603-949007b8c8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2f3bad-3acd-4fe8-87bb-29f1424ea788", "tag": "907b11e3-1dc7-4e4c-9786-5e63f5dd0812"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:01:52.203777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-edd8ad23-dd41-4f5b-b679-15662703ca0a req-ab0ee4eb-0842-492b-b603-949007b8c8e4 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:52.205021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-edd8ad23-dd41-4f5b-b679-15662703ca0a req-ab0ee4eb-0842-492b-b603-949007b8c8e4 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:52.232255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-edd8ad23-dd41-4f5b-b679-15662703ca0a req-ab0ee4eb-0842-492b-b603-949007b8c8e4 service nova] Creating event network-changed:907b11e3-1dc7-4e4c-9786-5e63f5dd0812 for instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 on hv-cinder-79760 Jun 02 19:01:52.240811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-edd8ad23-dd41-4f5b-b679-15662703ca0a req-ab0ee4eb-0842-492b-b603-949007b8c8e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238378 Jun 02 19:01:52.241857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 34/73] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:01:52.365039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-22da9be2-23ea-48e5-8768-266f934cb7dc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:52.365998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-22da9be2-23ea-48e5-8768-266f934cb7dc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:52.387602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22da9be2-23ea-48e5-8768-266f934cb7dc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:52.388367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22da9be2-23ea-48e5-8768-266f934cb7dc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:52.389373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22da9be2-23ea-48e5-8768-266f934cb7dc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:52.389814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22da9be2-23ea-48e5-8768-266f934cb7dc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:52.474346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-22da9be2-23ea-48e5-8768-266f934cb7dc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:52.482575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-22da9be2-23ea-48e5-8768-266f934cb7dc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1246 microversion: 2.1 time: 0.123766 Jun 02 19:01:52.483486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 40/74] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:52 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:53.006499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-456d8c66-0025-47f7-b5ae-0e235fd85262 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:53.007934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-456d8c66-0025-47f7-b5ae-0e235fd85262 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:53.015259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-456d8c66-0025-47f7-b5ae-0e235fd85262 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:53.015721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-456d8c66-0025-47f7-b5ae-0e235fd85262 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:53.016599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-456d8c66-0025-47f7-b5ae-0e235fd85262 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:53.016862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-456d8c66-0025-47f7-b5ae-0e235fd85262 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:53.076363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:53.077125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:53.090122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:53.090479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:53.091281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:53.092058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:53.238771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-456d8c66-0025-47f7-b5ae-0e235fd85262 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:53.250588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-456d8c66-0025-47f7-b5ae-0e235fd85262 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.248454 Jun 02 19:01:53.251179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 35/75] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:53 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:53.329306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:53.343020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:53.345477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:53.346973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b0be0ea9-087c-46b3-8c6a-f0fd0a478ccb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.289887 Jun 02 19:01:53.348016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 41/76] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:01:53.504682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-95f576a2-3cc6-4a95-958b-7e0880d3b569 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:53.506307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-95f576a2-3cc6-4a95-958b-7e0880d3b569 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:53.516451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95f576a2-3cc6-4a95-958b-7e0880d3b569 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:53.517595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95f576a2-3cc6-4a95-958b-7e0880d3b569 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:53.518819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95f576a2-3cc6-4a95-958b-7e0880d3b569 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:53.519600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95f576a2-3cc6-4a95-958b-7e0880d3b569 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:53.639727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-95f576a2-3cc6-4a95-958b-7e0880d3b569 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:53.656169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-95f576a2-3cc6-4a95-958b-7e0880d3b569 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1246 microversion: 2.1 time: 0.157978 Jun 02 19:01:53.657772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 36/77] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:53 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1246 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:54.282420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-abf565d5-e99f-4a5a-b7e6-26faa7c3de5e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:54.283538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-abf565d5-e99f-4a5a-b7e6-26faa7c3de5e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:54.300956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abf565d5-e99f-4a5a-b7e6-26faa7c3de5e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:54.303321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abf565d5-e99f-4a5a-b7e6-26faa7c3de5e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:54.305315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abf565d5-e99f-4a5a-b7e6-26faa7c3de5e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:54.306477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abf565d5-e99f-4a5a-b7e6-26faa7c3de5e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:54.367523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:54.368200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:54.388056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:54.388703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:54.389962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:54.390573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:54.696008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:54.704917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-abf565d5-e99f-4a5a-b7e6-26faa7c3de5e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:54.710298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:54.716943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:54.719513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-567a77ec-8f7b-4152-90c9-ea5f143e6df6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.357077 Jun 02 19:01:54.724167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 37/78] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:01:54.738741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0beb0eb1-0013-407f-ad44-909ceaaa255f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:54.739371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0beb0eb1-0013-407f-ad44-909ceaaa255f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:54.744296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-abf565d5-e99f-4a5a-b7e6-26faa7c3de5e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.466660 Jun 02 19:01:54.747178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 42/79] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:54 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:54.764295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0beb0eb1-0013-407f-ad44-909ceaaa255f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:54.764751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0beb0eb1-0013-407f-ad44-909ceaaa255f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:54.765533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0beb0eb1-0013-407f-ad44-909ceaaa255f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:54.766001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0beb0eb1-0013-407f-ad44-909ceaaa255f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:54.964084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0beb0eb1-0013-407f-ad44-909ceaaa255f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:54.975725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0beb0eb1-0013-407f-ad44-909ceaaa255f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1246 microversion: 2.1 time: 0.250401 Jun 02 19:01:54.976325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 38/80] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:54 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1246 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:55.759747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:55.760931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:55.769713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b11f30bf-b751-4287-bc9c-ebb9a3a10697 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:55.771231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b11f30bf-b751-4287-bc9c-ebb9a3a10697 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:55.785075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b11f30bf-b751-4287-bc9c-ebb9a3a10697 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:55.787231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:55.787764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:55.789701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b11f30bf-b751-4287-bc9c-ebb9a3a10697 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:55.790786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:55.792466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:55.794950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b11f30bf-b751-4287-bc9c-ebb9a3a10697 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:55.798354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b11f30bf-b751-4287-bc9c-ebb9a3a10697 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:56.114793 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:56.129572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:56.132149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:56.134791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-976dac69-f27f-4b66-813b-475dbbcc507a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.381071 Jun 02 19:01:56.141938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 43/81] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:56.156843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-62d06af8-5d42-4ddd-a1b9-f250b1dc3da3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:56.157838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-62d06af8-5d42-4ddd-a1b9-f250b1dc3da3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:56.172606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62d06af8-5d42-4ddd-a1b9-f250b1dc3da3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:56.174518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62d06af8-5d42-4ddd-a1b9-f250b1dc3da3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:56.177391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62d06af8-5d42-4ddd-a1b9-f250b1dc3da3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:56.182839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62d06af8-5d42-4ddd-a1b9-f250b1dc3da3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:56.241012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b11f30bf-b751-4287-bc9c-ebb9a3a10697 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:56.254440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b11f30bf-b751-4287-bc9c-ebb9a3a10697 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.487674 Jun 02 19:01:56.256388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 39/82] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:55 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:56.281950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-62d06af8-5d42-4ddd-a1b9-f250b1dc3da3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:56.290947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-62d06af8-5d42-4ddd-a1b9-f250b1dc3da3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1300 microversion: 2.1 time: 0.147422 Jun 02 19:01:56.292025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 44/83] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:56 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1300 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:57.162438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:57.163251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:57.182605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:57.183162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:57.184832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:57.185283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:57.272732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cf5e03cc-4aa0-4fd4-9552-cb701deeb90e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:57.273296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cf5e03cc-4aa0-4fd4-9552-cb701deeb90e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:57.279576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf5e03cc-4aa0-4fd4-9552-cb701deeb90e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:57.280747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf5e03cc-4aa0-4fd4-9552-cb701deeb90e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:57.281506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf5e03cc-4aa0-4fd4-9552-cb701deeb90e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:57.282112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf5e03cc-4aa0-4fd4-9552-cb701deeb90e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:57.285380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=87 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:57.390665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:57.399663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:57.401165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:57.402546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a88fa865-704e-44b2-8898-4b88ab920866 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.246303 Jun 02 19:01:57.403338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 40/84] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:57.408177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a59afae5-9e10-4218-b1d6-a519b25f2479 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:57.408786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a59afae5-9e10-4218-b1d6-a519b25f2479 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:57.415820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a59afae5-9e10-4218-b1d6-a519b25f2479 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:57.416284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a59afae5-9e10-4218-b1d6-a519b25f2479 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:57.417059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a59afae5-9e10-4218-b1d6-a519b25f2479 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:57.417590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a59afae5-9e10-4218-b1d6-a519b25f2479 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:57.444764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cf5e03cc-4aa0-4fd4-9552-cb701deeb90e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:57.453675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cf5e03cc-4aa0-4fd4-9552-cb701deeb90e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.184982 Jun 02 19:01:57.454356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 45/85] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:57 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:57.492238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a59afae5-9e10-4218-b1d6-a519b25f2479 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:57.500701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a59afae5-9e10-4218-b1d6-a519b25f2479 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1300 microversion: 2.1 time: 0.096533 Jun 02 19:01:57.501291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 41/86] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:57 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:58.421538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:58.422191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:58.428839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:58.429320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:58.430141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:58.430579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:58.470623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-133356db-7755-4f4c-9f89-843004a987ff tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:58.472125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-133356db-7755-4f4c-9f89-843004a987ff tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:58.478543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-133356db-7755-4f4c-9f89-843004a987ff tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:58.478950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-133356db-7755-4f4c-9f89-843004a987ff tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:58.479993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-133356db-7755-4f4c-9f89-843004a987ff tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:58.480503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-133356db-7755-4f4c-9f89-843004a987ff tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:58.642106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:58.662027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:58.665041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:58.672163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7e571e55-adf5-4663-9370-e002c2bf3f59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.250018 Jun 02 19:01:58.672163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 46/87] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:01:58.672431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-133356db-7755-4f4c-9f89-843004a987ff tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:58.676616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef02460b-f817-4be0-9a5e-5b422633ac22 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:58.677370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef02460b-f817-4be0-9a5e-5b422633ac22 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:58.684808 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef02460b-f817-4be0-9a5e-5b422633ac22 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:58.685395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef02460b-f817-4be0-9a5e-5b422633ac22 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:58.686296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef02460b-f817-4be0-9a5e-5b422633ac22 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:58.686934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef02460b-f817-4be0-9a5e-5b422633ac22 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:58.688363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-133356db-7755-4f4c-9f89-843004a987ff tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.221643 Jun 02 19:01:58.688958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 42/88] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:58 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:58.765971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef02460b-f817-4be0-9a5e-5b422633ac22 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:01:58.773954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef02460b-f817-4be0-9a5e-5b422633ac22 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1300 microversion: 2.1 time: 0.103961 Jun 02 19:01:58.774534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 47/89] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:58 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:59.698544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:59.699744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:59.712205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b999ba24-44ce-4b10-98fb-8e065bd26572 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:01:59.713403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b999ba24-44ce-4b10-98fb-8e065bd26572 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:01:59.721229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:59.724060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:59.725104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:59.725939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b999ba24-44ce-4b10-98fb-8e065bd26572 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:59.726763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:59.727356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b999ba24-44ce-4b10-98fb-8e065bd26572 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:01:59.731766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b999ba24-44ce-4b10-98fb-8e065bd26572 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:01:59.732611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b999ba24-44ce-4b10-98fb-8e065bd26572 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:00.077272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b999ba24-44ce-4b10-98fb-8e065bd26572 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:00.099940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:00.108176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b999ba24-44ce-4b10-98fb-8e065bd26572 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.400621 Jun 02 19:02:00.109377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:00.110974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:00.111902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 48/90] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:01:59 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:00.112145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9b1bd1ca-309c-4bf1-954f-00f2533fe76e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.420758 Jun 02 19:02:00.112653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 43/91] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:01:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:02:00.120033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78af5a62-0959-4e7d-9163-de9db5aebcec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:00.120880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78af5a62-0959-4e7d-9163-de9db5aebcec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:00.127683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78af5a62-0959-4e7d-9163-de9db5aebcec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:00.128131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78af5a62-0959-4e7d-9163-de9db5aebcec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:00.129086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78af5a62-0959-4e7d-9163-de9db5aebcec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:00.129663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78af5a62-0959-4e7d-9163-de9db5aebcec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:00.241127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-78af5a62-0959-4e7d-9163-de9db5aebcec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:00.252840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78af5a62-0959-4e7d-9163-de9db5aebcec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1300 microversion: 2.1 time: 0.139107 Jun 02 19:02:00.255160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 44/92] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:00 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:00.677063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:00.684127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-63dbe6da-2ccf-4405-99cb-45b5a0db03df req-7d21eaac-40ca-40ab-a64d-3a27412e6ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84c32a3-34d0-4b69-b460-8227b00aa799", "name": "network-vif-plugged", "status": "completed", "tag": "b1eba833-64bd-484c-a46c-273cbe1d276e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:00.712462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-63dbe6da-2ccf-4405-99cb-45b5a0db03df req-7d21eaac-40ca-40ab-a64d-3a27412e6ede service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:00.713244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-63dbe6da-2ccf-4405-99cb-45b5a0db03df req-7d21eaac-40ca-40ab-a64d-3a27412e6ede service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:00.756972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-63dbe6da-2ccf-4405-99cb-45b5a0db03df req-7d21eaac-40ca-40ab-a64d-3a27412e6ede service nova] Creating event network-vif-plugged:b1eba833-64bd-484c-a46c-273cbe1d276e for instance d84c32a3-34d0-4b69-b460-8227b00aa799 on hv-cinder-79760 Jun 02 19:02:00.757840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-63dbe6da-2ccf-4405-99cb-45b5a0db03df req-7d21eaac-40ca-40ab-a64d-3a27412e6ede service nova] Acquired lock "compute-rpcapi-router" {{(pid=117777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 19:02:00.760449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7030fd95-ad1d-4ac5-ac8a-1e4d53835aa5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:00.761441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7030fd95-ad1d-4ac5-ac8a-1e4d53835aa5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:00.763246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7030fd95-ad1d-4ac5-ac8a-1e4d53835aa5 None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:00.764329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7030fd95-ad1d-4ac5-ac8a-1e4d53835aa5 None None] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:00.785892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.compute.rpcapi [None req-7030fd95-ad1d-4ac5-ac8a-1e4d53835aa5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 19:02:00.787108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7030fd95-ad1d-4ac5-ac8a-1e4d53835aa5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 19:02:00.807154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7030fd95-ad1d-4ac5-ac8a-1e4d53835aa5 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218410 Jun 02 19:02:00.808202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 49/93] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:02:01.163576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d0b6de2-16a0-4f84-9942-0c037686fbf9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:01.165152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d0b6de2-16a0-4f84-9942-0c037686fbf9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:01.169333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:01.170071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:01.171373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.173086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0b6de2-16a0-4f84-9942-0c037686fbf9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:01.173878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0b6de2-16a0-4f84-9942-0c037686fbf9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:01.175248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0b6de2-16a0-4f84-9942-0c037686fbf9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:01.175951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0b6de2-16a0-4f84-9942-0c037686fbf9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:01.177387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:01.177871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:01.178656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:01.179107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:01.343602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=14 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.493357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d0b6de2-16a0-4f84-9942-0c037686fbf9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:01.498485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:01.507102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d0b6de2-16a0-4f84-9942-0c037686fbf9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.347898 Jun 02 19:02:01.507806 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 45/94] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:01 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:01.513152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-16cd291d-2fcc-4c0c-9587-5a7ba7f8826f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:01.514234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-16cd291d-2fcc-4c0c-9587-5a7ba7f8826f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:01.516155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:01.518117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:01.519522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e53e74d8-c80a-4d81-bef6-092e48de23e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.354620 Jun 02 19:02:01.520098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 50/95] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:02:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:02:01.522034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16cd291d-2fcc-4c0c-9587-5a7ba7f8826f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:01.522800 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16cd291d-2fcc-4c0c-9587-5a7ba7f8826f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:01.524021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16cd291d-2fcc-4c0c-9587-5a7ba7f8826f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:01.524695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16cd291d-2fcc-4c0c-9587-5a7ba7f8826f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:01.705061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-16cd291d-2fcc-4c0c-9587-5a7ba7f8826f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:01.714776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-16cd291d-2fcc-4c0c-9587-5a7ba7f8826f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.205628 Jun 02 19:02:01.716138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 46/96] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:01 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:02.526078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b8d21074-befe-45b8-9755-1b33d0c5c25e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:02.527624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b8d21074-befe-45b8-9755-1b33d0c5c25e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:02.535575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8d21074-befe-45b8-9755-1b33d0c5c25e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:02.536400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8d21074-befe-45b8-9755-1b33d0c5c25e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:02.537416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8d21074-befe-45b8-9755-1b33d0c5c25e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:02.538029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8d21074-befe-45b8-9755-1b33d0c5c25e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:02.547271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:02.547991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:02.557138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:02.559702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:02.560458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:02.561014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:02.846299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b8d21074-befe-45b8-9755-1b33d0c5c25e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:02.854540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b8d21074-befe-45b8-9755-1b33d0c5c25e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.333439 Jun 02 19:02:02.855475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 51/97] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:02 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:02.877681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:02.881516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ffd3a4e-03e0-4033-b411-d8f530e63d0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:02.881682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.885744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ffd3a4e-03e0-4033-b411-d8f530e63d0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:02.894448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:02.895993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:02.897160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-713c084c-39cb-4742-9912-fd079e0a1d50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.356766 Jun 02 19:02:02.897714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 47/98] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:02:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:02:02.905075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ffd3a4e-03e0-4033-b411-d8f530e63d0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:02.905762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ffd3a4e-03e0-4033-b411-d8f530e63d0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:02.906824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ffd3a4e-03e0-4033-b411-d8f530e63d0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:02.908693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ffd3a4e-03e0-4033-b411-d8f530e63d0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:03.001974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-dbd5b14a-a727-47a2-9130-5496bf368719 req-eeb5a4ff-a9c0-4c41-b1b4-b3507e5be07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2f3bad-3acd-4fe8-87bb-29f1424ea788", "name": "network-vif-plugged", "status": "completed", "tag": "907b11e3-1dc7-4e4c-9786-5e63f5dd0812"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:03.020179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-dbd5b14a-a727-47a2-9130-5496bf368719 req-eeb5a4ff-a9c0-4c41-b1b4-b3507e5be07c service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:03.021208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-dbd5b14a-a727-47a2-9130-5496bf368719 req-eeb5a4ff-a9c0-4c41-b1b4-b3507e5be07c service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:03.039689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-dbd5b14a-a727-47a2-9130-5496bf368719 req-eeb5a4ff-a9c0-4c41-b1b4-b3507e5be07c service nova] Creating event network-vif-plugged:907b11e3-1dc7-4e4c-9786-5e63f5dd0812 for instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 on hv-cinder-79760 Jun 02 19:02:03.049583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-dbd5b14a-a727-47a2-9130-5496bf368719 req-eeb5a4ff-a9c0-4c41-b1b4-b3507e5be07c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054429 Jun 02 19:02:03.051451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 48/99] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:02:03.154720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0ffd3a4e-03e0-4033-b411-d8f530e63d0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:03.164153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ffd3a4e-03e0-4033-b411-d8f530e63d0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.301008 Jun 02 19:02:03.164762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 52/100] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:02 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:03.548554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-2b69a567-f943-45d1-975e-66c42d8e1dbf req-09456aac-159f-4f61-9c36-584eb924bf78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cada17e-c4a7-434f-adc8-fea531c47cd8", "tag": "46c45669-3669-4e67-9482-9b7f07ba9355"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:03.562889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-2b69a567-f943-45d1-975e-66c42d8e1dbf req-09456aac-159f-4f61-9c36-584eb924bf78 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:03.564665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-2b69a567-f943-45d1-975e-66c42d8e1dbf req-09456aac-159f-4f61-9c36-584eb924bf78 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:03.591460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-2b69a567-f943-45d1-975e-66c42d8e1dbf req-09456aac-159f-4f61-9c36-584eb924bf78 service nova] Creating event network-changed:46c45669-3669-4e67-9482-9b7f07ba9355 for instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 on hv-cinder-79760 Jun 02 19:02:03.598588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-2b69a567-f943-45d1-975e-66c42d8e1dbf req-09456aac-159f-4f61-9c36-584eb924bf78 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055736 Jun 02 19:02:03.599202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 49/101] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:02:03.872487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81108a98-34a2-4665-871c-f12135366326 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:03.873197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81108a98-34a2-4665-871c-f12135366326 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:03.879590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81108a98-34a2-4665-871c-f12135366326 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:03.880101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81108a98-34a2-4665-871c-f12135366326 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:03.880799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81108a98-34a2-4665-871c-f12135366326 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:03.881235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81108a98-34a2-4665-871c-f12135366326 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:03.924117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:03.924732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:03.931437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:03.931880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:03.932650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:03.933114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:04.068211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81108a98-34a2-4665-871c-f12135366326 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:04.075907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81108a98-34a2-4665-871c-f12135366326 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.207354 Jun 02 19:02:04.076499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 53/102] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:03 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:04.101004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:04.110457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:04.111959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:04.113077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c85618ec-5a37-4df9-a85f-1a583a44b42d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.193363 Jun 02 19:02:04.113614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 50/103] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:02:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:02:04.183800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c4207aae-6f9f-4c0b-a972-d6ca7f00c2b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:04.184404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c4207aae-6f9f-4c0b-a972-d6ca7f00c2b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:04.190552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4207aae-6f9f-4c0b-a972-d6ca7f00c2b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:04.191006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4207aae-6f9f-4c0b-a972-d6ca7f00c2b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:04.191751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4207aae-6f9f-4c0b-a972-d6ca7f00c2b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:04.192174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4207aae-6f9f-4c0b-a972-d6ca7f00c2b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:04.333473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c4207aae-6f9f-4c0b-a972-d6ca7f00c2b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:04.341619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c4207aae-6f9f-4c0b-a972-d6ca7f00c2b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.163549 Jun 02 19:02:04.342233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 54/104] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:04 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:05.095084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15e236ef-7cfb-45e3-8a90-5f434bd0210b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:05.095654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-15e236ef-7cfb-45e3-8a90-5f434bd0210b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:05.102308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e236ef-7cfb-45e3-8a90-5f434bd0210b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:05.102755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e236ef-7cfb-45e3-8a90-5f434bd0210b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:05.103535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e236ef-7cfb-45e3-8a90-5f434bd0210b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:05.103969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e236ef-7cfb-45e3-8a90-5f434bd0210b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:05.131479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:05.132117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:05.139209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:05.139627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:05.140658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:05.141098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:05.250539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-15e236ef-7cfb-45e3-8a90-5f434bd0210b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:05.258973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15e236ef-7cfb-45e3-8a90-5f434bd0210b tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.167742 Jun 02 19:02:05.259525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 51/105] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:05 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:05.360222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f2a2e659-f287-4426-b9db-bb2695eb7059 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:05.360958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f2a2e659-f287-4426-b9db-bb2695eb7059 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:05.367372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2a2e659-f287-4426-b9db-bb2695eb7059 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:05.367880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2a2e659-f287-4426-b9db-bb2695eb7059 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:05.368737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2a2e659-f287-4426-b9db-bb2695eb7059 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:05.369173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2a2e659-f287-4426-b9db-bb2695eb7059 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:05.489878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:05.507526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:05.509564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:05.511132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16a2f0e8-7a4d-4409-8b72-be404165d60e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.383795 Jun 02 19:02:05.512291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 55/106] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:02:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:02:05.584964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f2a2e659-f287-4426-b9db-bb2695eb7059 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:05.607192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f2a2e659-f287-4426-b9db-bb2695eb7059 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.251377 Jun 02 19:02:05.609215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 52/107] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:05 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:06.277489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fef29172-4d4e-4572-9ddc-bf3bb0a5723e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:06.278077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fef29172-4d4e-4572-9ddc-bf3bb0a5723e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:06.284716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fef29172-4d4e-4572-9ddc-bf3bb0a5723e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:06.285164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fef29172-4d4e-4572-9ddc-bf3bb0a5723e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:06.285972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fef29172-4d4e-4572-9ddc-bf3bb0a5723e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:06.286404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fef29172-4d4e-4572-9ddc-bf3bb0a5723e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:06.437141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fef29172-4d4e-4572-9ddc-bf3bb0a5723e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:06.445185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fef29172-4d4e-4572-9ddc-bf3bb0a5723e tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.171875 Jun 02 19:02:06.445764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 56/108] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:06 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:06.531426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:06.531973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:06.538390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:06.538841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:06.539606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:06.540041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:06.629474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-74978131-57d4-4727-8cee-895f6569c0d9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:06.630546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-74978131-57d4-4727-8cee-895f6569c0d9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:06.640773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74978131-57d4-4727-8cee-895f6569c0d9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:06.641492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74978131-57d4-4727-8cee-895f6569c0d9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:06.642807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74978131-57d4-4727-8cee-895f6569c0d9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:06.643474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74978131-57d4-4727-8cee-895f6569c0d9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:06.673632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:06.682467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:06.683980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:06.685103 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-28f1e701-f520-4e8b-982a-43505885e930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.158505 Jun 02 19:02:06.685688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 53/109] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:02:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:02:06.814324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-74978131-57d4-4727-8cee-895f6569c0d9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:06.822546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-74978131-57d4-4727-8cee-895f6569c0d9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.200029 Jun 02 19:02:06.823123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 57/110] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:06 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:07.462403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d18038a-7067-44ef-8250-8b64a2ac7cbc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:07.463021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d18038a-7067-44ef-8250-8b64a2ac7cbc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:07.470411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d18038a-7067-44ef-8250-8b64a2ac7cbc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:07.470856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d18038a-7067-44ef-8250-8b64a2ac7cbc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:07.471628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d18038a-7067-44ef-8250-8b64a2ac7cbc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:07.472056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d18038a-7067-44ef-8250-8b64a2ac7cbc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:07.708320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:07.709436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:07.720956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:07.721748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:07.725788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:07.725788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:07.799002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d18038a-7067-44ef-8250-8b64a2ac7cbc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:07.813854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d18038a-7067-44ef-8250-8b64a2ac7cbc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.354805 Jun 02 19:02:07.814766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 54/111] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:07 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:07.840451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d9d4f948-e240-4337-8c2e-b030ecbbe14a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:07.841068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d9d4f948-e240-4337-8c2e-b030ecbbe14a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:07.847721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9d4f948-e240-4337-8c2e-b030ecbbe14a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:07.848194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9d4f948-e240-4337-8c2e-b030ecbbe14a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:07.849027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9d4f948-e240-4337-8c2e-b030ecbbe14a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:07.849462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9d4f948-e240-4337-8c2e-b030ecbbe14a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:07.915042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:07.925065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:07.926655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:07.927853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-06a1e6c0-3c93-45ec-8a70-14019f192395 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.226640 Jun 02 19:02:07.928732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 58/112] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:02:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:02:08.211947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d9d4f948-e240-4337-8c2e-b030ecbbe14a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:08.220989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d9d4f948-e240-4337-8c2e-b030ecbbe14a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.384535 Jun 02 19:02:08.221761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 55/113] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:07 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:08.831848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d296c7b2-5b2e-4329-a7e8-151a0fa654dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:08.832401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d296c7b2-5b2e-4329-a7e8-151a0fa654dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:08.842719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d296c7b2-5b2e-4329-a7e8-151a0fa654dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:08.843613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d296c7b2-5b2e-4329-a7e8-151a0fa654dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:08.845212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d296c7b2-5b2e-4329-a7e8-151a0fa654dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:08.846271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d296c7b2-5b2e-4329-a7e8-151a0fa654dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:08.949067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:08.950795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:08.973718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:08.974658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:08.982944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:08.983934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:09.135489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d296c7b2-5b2e-4329-a7e8-151a0fa654dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:09.154457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d296c7b2-5b2e-4329-a7e8-151a0fa654dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1315 microversion: 2.1 time: 0.325696 Jun 02 19:02:09.165302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 59/114] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:08 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:09.240650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cc21e812-5529-420e-9cd8-4a063425bd7e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:09.241462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cc21e812-5529-420e-9cd8-4a063425bd7e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:09.252922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc21e812-5529-420e-9cd8-4a063425bd7e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:09.253258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:09.253636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc21e812-5529-420e-9cd8-4a063425bd7e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:09.254802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc21e812-5529-420e-9cd8-4a063425bd7e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:09.255294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc21e812-5529-420e-9cd8-4a063425bd7e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:09.263876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:09.265911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:09.267367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-200544d4-5ee9-46ad-beca-08a235c74c48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1406 microversion: 2.20 time: 0.324056 Jun 02 19:02:09.268122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 56/115] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:02:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:02:09.439259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cc21e812-5529-420e-9cd8-4a063425bd7e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:09.448642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cc21e812-5529-420e-9cd8-4a063425bd7e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.212478 Jun 02 19:02:09.458386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 60/116] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:09 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:10.172087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-984d1b08-4129-4007-8881-328e164fd507 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:10.172668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-984d1b08-4129-4007-8881-328e164fd507 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:10.180848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-984d1b08-4129-4007-8881-328e164fd507 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:10.181358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-984d1b08-4129-4007-8881-328e164fd507 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:10.182246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-984d1b08-4129-4007-8881-328e164fd507 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:10.182781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-984d1b08-4129-4007-8881-328e164fd507 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:10.285731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:10.286332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:10.293555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:10.294072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:10.294871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:10.295308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:10.326824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-984d1b08-4129-4007-8881-328e164fd507 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:10.338109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-984d1b08-4129-4007-8881-328e164fd507 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1501 microversion: 2.1 time: 0.169723 Jun 02 19:02:10.339235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 57/117] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:10 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:10.444572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:10.453973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:10.455567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:10.456798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9dd3e96-3677-4cc1-a9d1-e3c7e7b4d419 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1598 microversion: 2.20 time: 0.175092 Jun 02 19:02:10.457579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 61/118] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:02:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:02:10.468931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-565a34bc-5eb5-499a-8650-bc577481aa10 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:10.469584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-565a34bc-5eb5-499a-8650-bc577481aa10 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:10.481987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-565a34bc-5eb5-499a-8650-bc577481aa10 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:10.482240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-efd6dc09-753e-4cfc-8e78-4d7d1580d8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:10.482905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-565a34bc-5eb5-499a-8650-bc577481aa10 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:10.483087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-efd6dc09-753e-4cfc-8e78-4d7d1580d8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:10.483913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-565a34bc-5eb5-499a-8650-bc577481aa10 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:10.484429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-565a34bc-5eb5-499a-8650-bc577481aa10 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:10.490353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efd6dc09-753e-4cfc-8e78-4d7d1580d8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:10.491212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efd6dc09-753e-4cfc-8e78-4d7d1580d8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:10.492261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efd6dc09-753e-4cfc-8e78-4d7d1580d8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:10.493036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efd6dc09-753e-4cfc-8e78-4d7d1580d8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:10.524341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:10.669457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-efd6dc09-753e-4cfc-8e78-4d7d1580d8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.193653 Jun 02 19:02:10.671855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 62/119] 10.222.0.15 () {60 vars in 1315 bytes} [Thu Jun 2 19:02:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:02:10.683570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-565a34bc-5eb5-499a-8650-bc577481aa10 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:10.691917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-565a34bc-5eb5-499a-8650-bc577481aa10 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.227908 Jun 02 19:02:10.692504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 58/120] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:10 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:11.707491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:11.725337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e4cab11d-f1ff-49e7-be2f-93049cd15cfa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:11.727036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e4cab11d-f1ff-49e7-be2f-93049cd15cfa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:11.739935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4cab11d-f1ff-49e7-be2f-93049cd15cfa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:11.741439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4cab11d-f1ff-49e7-be2f-93049cd15cfa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:11.743777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4cab11d-f1ff-49e7-be2f-93049cd15cfa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:11.744770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4cab11d-f1ff-49e7-be2f-93049cd15cfa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:12.108566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e4cab11d-f1ff-49e7-be2f-93049cd15cfa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:12.126206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e4cab11d-f1ff-49e7-be2f-93049cd15cfa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.419892 Jun 02 19:02:12.127326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 63/121] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:11 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:12.368640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-afdd162a-e0ce-44d4-b7ec-b5a83893ef0c req-87645c93-0488-48f3-9bd9-43963181f010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2f3bad-3acd-4fe8-87bb-29f1424ea788", "tag": "907b11e3-1dc7-4e4c-9786-5e63f5dd0812"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:12.380470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-afdd162a-e0ce-44d4-b7ec-b5a83893ef0c req-87645c93-0488-48f3-9bd9-43963181f010 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:12.380925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-afdd162a-e0ce-44d4-b7ec-b5a83893ef0c req-87645c93-0488-48f3-9bd9-43963181f010 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:12.396725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-afdd162a-e0ce-44d4-b7ec-b5a83893ef0c req-87645c93-0488-48f3-9bd9-43963181f010 service nova] Creating event network-changed:907b11e3-1dc7-4e4c-9786-5e63f5dd0812 for instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 on hv-cinder-79760 Jun 02 19:02:12.405279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-afdd162a-e0ce-44d4-b7ec-b5a83893ef0c req-87645c93-0488-48f3-9bd9-43963181f010 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041650 Jun 02 19:02:12.408586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 59/122] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:02:13.144213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8040bb4c-712b-4915-a6b5-f0f4e9ea1260 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:13.144830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8040bb4c-712b-4915-a6b5-f0f4e9ea1260 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:13.160710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8040bb4c-712b-4915-a6b5-f0f4e9ea1260 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:13.160710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8040bb4c-712b-4915-a6b5-f0f4e9ea1260 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:13.160710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8040bb4c-712b-4915-a6b5-f0f4e9ea1260 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:13.160944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8040bb4c-712b-4915-a6b5-f0f4e9ea1260 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:13.503565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8040bb4c-712b-4915-a6b5-f0f4e9ea1260 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:13.515233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8040bb4c-712b-4915-a6b5-f0f4e9ea1260 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.374514 Jun 02 19:02:13.516525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 64/123] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:13 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:14.311694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1bdd792a-e510-4e53-bde8-fab9184df1b9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52e35946-e858-4eee-b8b1-29845de55b6b"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:14.312895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1bdd792a-e510-4e53-bde8-fab9184df1b9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:14.328379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1bdd792a-e510-4e53-bde8-fab9184df1b9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:14.332796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1bdd792a-e510-4e53-bde8-fab9184df1b9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:14.334914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1bdd792a-e510-4e53-bde8-fab9184df1b9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:14.335604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1bdd792a-e510-4e53-bde8-fab9184df1b9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:14.550406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0933ca91-086f-4c18-a2ba-1a365a9495a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:14.552861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0933ca91-086f-4c18-a2ba-1a365a9495a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:14.564538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0933ca91-086f-4c18-a2ba-1a365a9495a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:14.564995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0933ca91-086f-4c18-a2ba-1a365a9495a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:14.565757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0933ca91-086f-4c18-a2ba-1a365a9495a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:14.566217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0933ca91-086f-4c18-a2ba-1a365a9495a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:14.824688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0933ca91-086f-4c18-a2ba-1a365a9495a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:14.835709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0933ca91-086f-4c18-a2ba-1a365a9495a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.298926 Jun 02 19:02:14.836843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 65/124] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:14 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:15.092316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1bdd792a-e510-4e53-bde8-fab9184df1b9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "POST /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783874 Jun 02 19:02:15.093492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 60/125] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:02:14 2022] POST /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:02:15.858186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c1d54d69-547a-4205-8596-a9c8851e6dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:15.861424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c1d54d69-547a-4205-8596-a9c8851e6dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:15.872163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c1d54d69-547a-4205-8596-a9c8851e6dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:15.872996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c1d54d69-547a-4205-8596-a9c8851e6dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:15.874364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c1d54d69-547a-4205-8596-a9c8851e6dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:15.875354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c1d54d69-547a-4205-8596-a9c8851e6dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:16.096045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c1d54d69-547a-4205-8596-a9c8851e6dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:16.106090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c1d54d69-547a-4205-8596-a9c8851e6dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.254397 Jun 02 19:02:16.115949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 66/126] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:15 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:17.130133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fbe8d2b8-b23f-4656-9d1a-1936f64bf5aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:17.132795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fbe8d2b8-b23f-4656-9d1a-1936f64bf5aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:17.145116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbe8d2b8-b23f-4656-9d1a-1936f64bf5aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:17.145780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbe8d2b8-b23f-4656-9d1a-1936f64bf5aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:17.147039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbe8d2b8-b23f-4656-9d1a-1936f64bf5aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:17.147623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbe8d2b8-b23f-4656-9d1a-1936f64bf5aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:17.388502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fbe8d2b8-b23f-4656-9d1a-1936f64bf5aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:17.439130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fbe8d2b8-b23f-4656-9d1a-1936f64bf5aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.316164 Jun 02 19:02:17.442458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 61/127] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:17 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:17.628741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-1a7b466d-44bb-4236-965b-e143ebf9bdaf req-43b137f9-7974-4383-9609-eb89120ae96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cada17e-c4a7-434f-adc8-fea531c47cd8", "name": "network-vif-plugged", "status": "completed", "tag": "46c45669-3669-4e67-9482-9b7f07ba9355"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:17.650091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:17.675242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-1a7b466d-44bb-4236-965b-e143ebf9bdaf req-43b137f9-7974-4383-9609-eb89120ae96d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:17.676307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-1a7b466d-44bb-4236-965b-e143ebf9bdaf req-43b137f9-7974-4383-9609-eb89120ae96d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:17.705478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-1a7b466d-44bb-4236-965b-e143ebf9bdaf req-43b137f9-7974-4383-9609-eb89120ae96d service nova] Creating event network-vif-plugged:46c45669-3669-4e67-9482-9b7f07ba9355 for instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 on hv-cinder-79760 Jun 02 19:02:17.718817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-1a7b466d-44bb-4236-965b-e143ebf9bdaf req-43b137f9-7974-4383-9609-eb89120ae96d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098539 Jun 02 19:02:17.721651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 67/128] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:02:18.461953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-01ed7c20-7521-467f-b7c5-62a27398c574 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:18.462604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-01ed7c20-7521-467f-b7c5-62a27398c574 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:18.472266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01ed7c20-7521-467f-b7c5-62a27398c574 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:18.473185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01ed7c20-7521-467f-b7c5-62a27398c574 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:18.475330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01ed7c20-7521-467f-b7c5-62a27398c574 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:18.475935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01ed7c20-7521-467f-b7c5-62a27398c574 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:18.670791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-01ed7c20-7521-467f-b7c5-62a27398c574 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:18.681178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-01ed7c20-7521-467f-b7c5-62a27398c574 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.226575 Jun 02 19:02:18.682207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 62/129] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:18 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:19.699807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9606e6d1-eb45-4d00-b5fe-4306f64de673 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:19.700519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9606e6d1-eb45-4d00-b5fe-4306f64de673 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:19.708116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9606e6d1-eb45-4d00-b5fe-4306f64de673 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:19.708724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9606e6d1-eb45-4d00-b5fe-4306f64de673 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:19.709583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9606e6d1-eb45-4d00-b5fe-4306f64de673 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:19.710133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9606e6d1-eb45-4d00-b5fe-4306f64de673 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:19.876601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9606e6d1-eb45-4d00-b5fe-4306f64de673 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:19.885821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9606e6d1-eb45-4d00-b5fe-4306f64de673 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.190260 Jun 02 19:02:19.886664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 68/130] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:19 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:20.905067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9c2c4025-25a1-4120-9030-342611ed9c2c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:20.906454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9c2c4025-25a1-4120-9030-342611ed9c2c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:20.909207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=66 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.915432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c2c4025-25a1-4120-9030-342611ed9c2c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:20.916355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c2c4025-25a1-4120-9030-342611ed9c2c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:20.917519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c2c4025-25a1-4120-9030-342611ed9c2c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:20.918176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c2c4025-25a1-4120-9030-342611ed9c2c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:21.132858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9c2c4025-25a1-4120-9030-342611ed9c2c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:21.142529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9c2c4025-25a1-4120-9030-342611ed9c2c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.241506 Jun 02 19:02:21.143118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 63/131] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:20 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:22.161087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5b03a091-1214-492a-9bac-bd972f1a5195 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:22.161846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5b03a091-1214-492a-9bac-bd972f1a5195 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:22.170617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b03a091-1214-492a-9bac-bd972f1a5195 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:22.172107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b03a091-1214-492a-9bac-bd972f1a5195 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:22.178938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b03a091-1214-492a-9bac-bd972f1a5195 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:22.180395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b03a091-1214-492a-9bac-bd972f1a5195 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:22.345805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5b03a091-1214-492a-9bac-bd972f1a5195 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:22.354944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5b03a091-1214-492a-9bac-bd972f1a5195 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1367 microversion: 2.1 time: 0.196785 Jun 02 19:02:22.355515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 69/132] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:22 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:23.372951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a1c52dd3-9d3f-4d7e-b617-1e1b4034e564 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:23.374121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a1c52dd3-9d3f-4d7e-b617-1e1b4034e564 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:23.391675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1c52dd3-9d3f-4d7e-b617-1e1b4034e564 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:23.392121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1c52dd3-9d3f-4d7e-b617-1e1b4034e564 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:23.392907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1c52dd3-9d3f-4d7e-b617-1e1b4034e564 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:23.393358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1c52dd3-9d3f-4d7e-b617-1e1b4034e564 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:23.766919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a1c52dd3-9d3f-4d7e-b617-1e1b4034e564 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:23.796170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a1c52dd3-9d3f-4d7e-b617-1e1b4034e564 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1558 microversion: 2.1 time: 0.426551 Jun 02 19:02:23.806872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 64/133] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:23 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1558 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:23.834892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ec82bd1d-20c5-4b6d-ae9c-50272adf08ed tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:23.836540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ec82bd1d-20c5-4b6d-ae9c-50272adf08ed tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:23.872122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec82bd1d-20c5-4b6d-ae9c-50272adf08ed tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:23.875026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec82bd1d-20c5-4b6d-ae9c-50272adf08ed tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:23.878715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec82bd1d-20c5-4b6d-ae9c-50272adf08ed tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:23.880890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec82bd1d-20c5-4b6d-ae9c-50272adf08ed tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:24.189661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ec82bd1d-20c5-4b6d-ae9c-50272adf08ed tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.363169 Jun 02 19:02:24.190271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 70/134] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Jun 2 19:02:23 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-interface => generated 285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:02:24.229663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fc1ca4e0-9954-48fc-be38-b300d5064dd9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:24.230534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fc1ca4e0-9954-48fc-be38-b300d5064dd9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:24.264264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc1ca4e0-9954-48fc-be38-b300d5064dd9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:24.265058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc1ca4e0-9954-48fc-be38-b300d5064dd9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:24.271619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc1ca4e0-9954-48fc-be38-b300d5064dd9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:24.274234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc1ca4e0-9954-48fc-be38-b300d5064dd9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:24.298836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:24.405075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fc1ca4e0-9954-48fc-be38-b300d5064dd9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:02:24.746730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fc1ca4e0-9954-48fc-be38-b300d5064dd9 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 204 len: 0 microversion: 2.1 time: 0.530646 Jun 02 19:02:24.748291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 65/135] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:02:24 2022] DELETE /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:24.762406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-956bdcdc-ffc8-4265-b19b-937aba7a19dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:24.764055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-956bdcdc-ffc8-4265-b19b-937aba7a19dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:24.777364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-956bdcdc-ffc8-4265-b19b-937aba7a19dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:24.778618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-956bdcdc-ffc8-4265-b19b-937aba7a19dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:24.790164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-956bdcdc-ffc8-4265-b19b-937aba7a19dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:24.790164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-956bdcdc-ffc8-4265-b19b-937aba7a19dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:25.647840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-956bdcdc-ffc8-4265-b19b-937aba7a19dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:25.674700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-956bdcdc-ffc8-4265-b19b-937aba7a19dd tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1553 microversion: 2.1 time: 0.920615 Jun 02 19:02:25.676056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 71/136] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:24 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1553 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:26.431973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-f6321ccb-e364-48cc-9d4a-bd90dba3c085 req-32a98f0a-5b82-4c1c-bb01-94cb40a24627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cada17e-c4a7-434f-adc8-fea531c47cd8", "tag": "46c45669-3669-4e67-9482-9b7f07ba9355"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:26.451045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f6321ccb-e364-48cc-9d4a-bd90dba3c085 req-32a98f0a-5b82-4c1c-bb01-94cb40a24627 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:26.454726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f6321ccb-e364-48cc-9d4a-bd90dba3c085 req-32a98f0a-5b82-4c1c-bb01-94cb40a24627 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:26.468351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-f6321ccb-e364-48cc-9d4a-bd90dba3c085 req-32a98f0a-5b82-4c1c-bb01-94cb40a24627 service nova] Creating event network-changed:46c45669-3669-4e67-9482-9b7f07ba9355 for instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 on hv-cinder-79760 Jun 02 19:02:26.477274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-f6321ccb-e364-48cc-9d4a-bd90dba3c085 req-32a98f0a-5b82-4c1c-bb01-94cb40a24627 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049172 Jun 02 19:02:26.481040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 66/137] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:02:26.694385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8e6292ae-362a-4e22-8db0-a251b22076a7 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:26.695732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8e6292ae-362a-4e22-8db0-a251b22076a7 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:26.722088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e6292ae-362a-4e22-8db0-a251b22076a7 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:26.723175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e6292ae-362a-4e22-8db0-a251b22076a7 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:26.726264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e6292ae-362a-4e22-8db0-a251b22076a7 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:26.727097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e6292ae-362a-4e22-8db0-a251b22076a7 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:27.006019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8e6292ae-362a-4e22-8db0-a251b22076a7 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:27.015849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8e6292ae-362a-4e22-8db0-a251b22076a7 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1553 microversion: 2.1 time: 0.326335 Jun 02 19:02:27.026262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 72/138] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:26 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1553 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:28.038180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d18052a3-ebd2-4601-baa4-fd7546c93059 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:28.041202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d18052a3-ebd2-4601-baa4-fd7546c93059 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:28.089989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d18052a3-ebd2-4601-baa4-fd7546c93059 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:28.094774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d18052a3-ebd2-4601-baa4-fd7546c93059 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:28.104366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d18052a3-ebd2-4601-baa4-fd7546c93059 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:28.105308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d18052a3-ebd2-4601-baa4-fd7546c93059 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:28.525333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d18052a3-ebd2-4601-baa4-fd7546c93059 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:28.561215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d18052a3-ebd2-4601-baa4-fd7546c93059 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1553 microversion: 2.1 time: 0.524045 Jun 02 19:02:28.577829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 67/139] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:28 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1553 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:29.079587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-82e764d2-37b1-4d8a-8682-2f7ac325c0ad req-e0a18bf5-5d7c-4589-bebc-b2413555bf12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84c32a3-34d0-4b69-b460-8227b00aa799", "name": "network-vif-deleted", "tag": "b1eba833-64bd-484c-a46c-273cbe1d276e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:29.112834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-82e764d2-37b1-4d8a-8682-2f7ac325c0ad req-e0a18bf5-5d7c-4589-bebc-b2413555bf12 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:29.117120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-82e764d2-37b1-4d8a-8682-2f7ac325c0ad req-e0a18bf5-5d7c-4589-bebc-b2413555bf12 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:29.170546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-82e764d2-37b1-4d8a-8682-2f7ac325c0ad req-e0a18bf5-5d7c-4589-bebc-b2413555bf12 service nova] Creating event network-vif-deleted:b1eba833-64bd-484c-a46c-273cbe1d276e for instance d84c32a3-34d0-4b69-b460-8227b00aa799 on hv-cinder-79760 Jun 02 19:02:29.187803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-82e764d2-37b1-4d8a-8682-2f7ac325c0ad req-e0a18bf5-5d7c-4589-bebc-b2413555bf12 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111901 Jun 02 19:02:29.191159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 73/140] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:02:29.593289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:29.594032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:29.609084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:29.610550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:29.611385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:29.618101 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:29.728413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:29.728950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:29.729637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lazy-loading 'fault' on Instance uuid d84c32a3-34d0-4b69-b460-8227b00aa799 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:02:29.843927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daefcb4d04ee4bc5b2c1a7b755077a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e515ddd7313434f9e3dd34debc97877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:29.856912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fea4e8e6-d7a1-4f64-abf5-c1eefe70514f tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 200 len: 1351 microversion: 2.1 time: 0.267652 Jun 02 19:02:29.869203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 68/141] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:29 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 1351 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:30.880170 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:30.881048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:30.888995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:30.889483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:30.890396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:30.890828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:30.907425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] HTTP exception thrown: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Request method failure captured: Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 HTTP/1.1 Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkB3JMqxK1nJOXu4tM6coZ62wP-RTBsDDglNp8EqxjQ66LGpmMCL8FhQYDylaTgX26vPhRJHW32oHCGj1pKFnwfHLmqVVymC_Ty0lUtzdik6EI4txQdbG_WB1S_Rnlnn7QcHad6cY7Cmuapoh-65UTMlaqpudR5le2LiFCePMXUBrw Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 8e515ddd7313434f9e3dd34debc97877 Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:02:30.913318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 8e515ddd7313434f9e3dd34debc97877 Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-DeleteServersTestJSON-527192601-project Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: daefcb4d04ee4bc5b2c1a7b755077a4a Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-DeleteServersTestJSON-527192601-project Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:30.915909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': 'd84c32a3-34d0-4b69-b460-8227b00aa799'} Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:02:30.916818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:30.918765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:30.920135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Returning 404 to user: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:02:30.920135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-91dc661f-d77c-4dc7-8882-045743c8e3dc tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 404 len: 111 microversion: 2.1 time: 0.039510 Jun 02 19:02:30.920135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 74/142] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:30 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:02:31.096065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:31.097011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:31.106904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:31.107660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:31.110174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:31.110727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:31.130586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] HTTP exception thrown: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Request method failure captured: Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799/os-volume_attachments HTTP/1.1 Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkB3JMqxK1nJOXu4tM6coZ62wP-RTBsDDglNp8EqxjQ66LGpmMCL8FhQYDylaTgX26vPhRJHW32oHCGj1pKFnwfHLmqVVymC_Ty0lUtzdik6EI4txQdbG_WB1S_Rnlnn7QcHad6cY7Cmuapoh-65UTMlaqpudR5le2LiFCePMXUBrw Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 8e515ddd7313434f9e3dd34debc97877 Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:02:31.137098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 8e515ddd7313434f9e3dd34debc97877 Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-DeleteServersTestJSON-527192601-project Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: daefcb4d04ee4bc5b2c1a7b755077a4a Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-DeleteServersTestJSON-527192601-project Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:31.138759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'server_id': 'd84c32a3-34d0-4b69-b460-8227b00aa799'} Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:02:31.139515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:31.140581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:31.141623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Returning 404 to user: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:02:31.141623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d1d3d70c-984b-400a-a020-984da77d6ea8 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047469 Jun 02 19:02:31.141623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 69/143] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:02:31 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:02:32.141270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2050026198", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "networks": [{"uuid": "f5122744-0839-4dba-bb86-bf8f0535738f"}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:32.222908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] validate_networks() for [('f5122744-0839-4dba-bb86-bf8f0535738f', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:02:32.476842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:32.477576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:32.488288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:32.488965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:32.489961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:32.490913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:32.509322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] HTTP exception thrown: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Request method failure captured: Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 HTTP/1.1 Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkB3JMqxK1nJOXu4tM6coZ62wP-RTBsDDglNp8EqxjQ66LGpmMCL8FhQYDylaTgX26vPhRJHW32oHCGj1pKFnwfHLmqVVymC_Ty0lUtzdik6EI4txQdbG_WB1S_Rnlnn7QcHad6cY7Cmuapoh-65UTMlaqpudR5le2LiFCePMXUBrw Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 8e515ddd7313434f9e3dd34debc97877 Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:02:32.512991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 8e515ddd7313434f9e3dd34debc97877 Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-DeleteServersTestJSON-527192601-project Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: daefcb4d04ee4bc5b2c1a7b755077a4a Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-DeleteServersTestJSON-527192601-project Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.514308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd84c32a3-34d0-4b69-b460-8227b00aa799'} Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:02:32.514945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.516240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.519609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Returning 404 to user: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:02:32.521120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a2c0a35e-7dc3-483b-85be-374c8d22adc3 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 404 len: 111 microversion: 2.1 time: 0.048490 Jun 02 19:02:32.522136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 70/144] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:02:32 2022] DELETE /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:02:32.536265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:32.537286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] [instance: d84c32a3-34d0-4b69-b460-8227b00aa799] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:32.548394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:32.550497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:32.552481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:32.553010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:32.572827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] HTTP exception thrown: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Request method failure captured: Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 HTTP/1.1 Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkB3JMqxK1nJOXu4tM6coZ62wP-RTBsDDglNp8EqxjQ66LGpmMCL8FhQYDylaTgX26vPhRJHW32oHCGj1pKFnwfHLmqVVymC_Ty0lUtzdik6EI4txQdbG_WB1S_Rnlnn7QcHad6cY7Cmuapoh-65UTMlaqpudR5le2LiFCePMXUBrw Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 8e515ddd7313434f9e3dd34debc97877 Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:02:32.574438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e515ddd7313434f9e3dd34debc97877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 8e515ddd7313434f9e3dd34debc97877 Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-DeleteServersTestJSON-527192601 Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-DeleteServersTestJSON-527192601-project Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: daefcb4d04ee4bc5b2c1a7b755077a4a Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-DeleteServersTestJSON-527192601-project Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.576117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd84c32a3-34d0-4b69-b460-8227b00aa799'} Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:02:32.576787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. Jun 02 19:02:32.578623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:02:32.580242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] Returning 404 to user: Instance d84c32a3-34d0-4b69-b460-8227b00aa799 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:02:32.580242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f3813cee-040a-415c-8b8d-31d091bc2a26 tempest-DeleteServersTestJSON-527192601 tempest-DeleteServersTestJSON-527192601-project] 10.222.0.15 "GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799" status: 404 len: 111 microversion: 2.1 time: 0.047010 Jun 02 19:02:32.580242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 71/145] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:32 2022] GET /compute/v2.1/servers/d84c32a3-34d0-4b69-b460-8227b00aa799 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:02:32.709372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:02:32.709813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:02:32.710295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:02:32.710692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:02:32.711090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:02:32.720587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:32.721035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:32.721892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:32.722449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:32.744767 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Getting quotas for project 9f56ecf8c55d4db69eaa62e872d9f169. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:02:32.750681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Getting quotas for user 7de00142413f4f57b4782279bc826f4f and project 9f56ecf8c55d4db69eaa62e872d9f169. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:02:32.768968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:02:32.771484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:02:32.820937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b34725e7-1478-4efa-b765-93b094a2805d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683583 Jun 02 19:02:32.821562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 75/146] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:02:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:02:32.833239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a885b8a-8b4f-46b5-b2fd-6bbaaaabc412 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:32.836399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a885b8a-8b4f-46b5-b2fd-6bbaaaabc412 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:32.910045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2a885b8a-8b4f-46b5-b2fd-6bbaaaabc412 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:32.919071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a885b8a-8b4f-46b5-b2fd-6bbaaaabc412 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1214 microversion: 2.1 time: 0.090082 Jun 02 19:02:32.920267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 72/147] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:32 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:33.939728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bb4f9dd9-9fff-49ad-ac4d-dfa8f3cf161c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:33.940483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bb4f9dd9-9fff-49ad-ac4d-dfa8f3cf161c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:33.948211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb4f9dd9-9fff-49ad-ac4d-dfa8f3cf161c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:33.948803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb4f9dd9-9fff-49ad-ac4d-dfa8f3cf161c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:33.949695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb4f9dd9-9fff-49ad-ac4d-dfa8f3cf161c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:33.950365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb4f9dd9-9fff-49ad-ac4d-dfa8f3cf161c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:34.021364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bb4f9dd9-9fff-49ad-ac4d-dfa8f3cf161c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:34.032878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bb4f9dd9-9fff-49ad-ac4d-dfa8f3cf161c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1266 microversion: 2.1 time: 0.096005 Jun 02 19:02:34.032878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 76/148] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:33 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:35.049418 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78226fa0-7198-4ff2-a6de-4138ded4dbc6 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:35.049912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78226fa0-7198-4ff2-a6de-4138ded4dbc6 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:35.059954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78226fa0-7198-4ff2-a6de-4138ded4dbc6 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:35.060446 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78226fa0-7198-4ff2-a6de-4138ded4dbc6 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:35.061220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78226fa0-7198-4ff2-a6de-4138ded4dbc6 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:35.061655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78226fa0-7198-4ff2-a6de-4138ded4dbc6 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:35.306525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-78226fa0-7198-4ff2-a6de-4138ded4dbc6 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:35.315027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78226fa0-7198-4ff2-a6de-4138ded4dbc6 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.269785 Jun 02 19:02:35.315612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 73/149] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:35 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:36.193623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-84286326-dc9b-40ea-a4cd-fe493afd2524 req-859fca90-6884-4c42-8170-b25faf8d3f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760b1652-d34f-4b2f-9b98-4968cf872927", "tag": "b6cd110e-57b2-4c17-983e-a9624cfea7eb"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:36.212064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-84286326-dc9b-40ea-a4cd-fe493afd2524 req-859fca90-6884-4c42-8170-b25faf8d3f8f service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:36.212595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-84286326-dc9b-40ea-a4cd-fe493afd2524 req-859fca90-6884-4c42-8170-b25faf8d3f8f service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:36.235688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-84286326-dc9b-40ea-a4cd-fe493afd2524 req-859fca90-6884-4c42-8170-b25faf8d3f8f service nova] Creating event network-changed:b6cd110e-57b2-4c17-983e-a9624cfea7eb for instance 760b1652-d34f-4b2f-9b98-4968cf872927 on hv-cinder-79760 Jun 02 19:02:36.249653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-84286326-dc9b-40ea-a4cd-fe493afd2524 req-859fca90-6884-4c42-8170-b25faf8d3f8f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059414 Jun 02 19:02:36.256216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 77/150] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:02:36.333433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2bc2b68a-061b-44b9-bb1e-eef5cb236b70 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:36.334808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2bc2b68a-061b-44b9-bb1e-eef5cb236b70 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:36.344555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2bc2b68a-061b-44b9-bb1e-eef5cb236b70 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:36.345267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2bc2b68a-061b-44b9-bb1e-eef5cb236b70 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:36.350296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2bc2b68a-061b-44b9-bb1e-eef5cb236b70 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:36.350784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2bc2b68a-061b-44b9-bb1e-eef5cb236b70 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:36.676949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2bc2b68a-061b-44b9-bb1e-eef5cb236b70 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:36.698969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2bc2b68a-061b-44b9-bb1e-eef5cb236b70 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.369576 Jun 02 19:02:36.703300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 74/151] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:36 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:37.718235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4ca32b26-990e-4f7d-aa04-cc8d9aea8a2f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:37.722511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4ca32b26-990e-4f7d-aa04-cc8d9aea8a2f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:37.742694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ca32b26-990e-4f7d-aa04-cc8d9aea8a2f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:37.743237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ca32b26-990e-4f7d-aa04-cc8d9aea8a2f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:37.744145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ca32b26-990e-4f7d-aa04-cc8d9aea8a2f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:37.745162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ca32b26-990e-4f7d-aa04-cc8d9aea8a2f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:38.041141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4ca32b26-990e-4f7d-aa04-cc8d9aea8a2f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:38.052134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4ca32b26-990e-4f7d-aa04-cc8d9aea8a2f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.339368 Jun 02 19:02:38.052727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 78/152] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:37 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:39.075299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a8811aa8-520e-4fcc-991d-436e8c54a1fa tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:39.075902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a8811aa8-520e-4fcc-991d-436e8c54a1fa tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:39.094035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8811aa8-520e-4fcc-991d-436e8c54a1fa tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:39.094488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8811aa8-520e-4fcc-991d-436e8c54a1fa tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:39.095259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8811aa8-520e-4fcc-991d-436e8c54a1fa tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:39.095693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8811aa8-520e-4fcc-991d-436e8c54a1fa tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:39.373503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a8811aa8-520e-4fcc-991d-436e8c54a1fa tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:39.413729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a8811aa8-520e-4fcc-991d-436e8c54a1fa tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.341132 Jun 02 19:02:39.417139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 75/153] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:39 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:40.443587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9474d1a-d9ed-441a-8495-6a33f0a1b647 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:40.445039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9474d1a-d9ed-441a-8495-6a33f0a1b647 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:40.461866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9474d1a-d9ed-441a-8495-6a33f0a1b647 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:40.463581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9474d1a-d9ed-441a-8495-6a33f0a1b647 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:40.465254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9474d1a-d9ed-441a-8495-6a33f0a1b647 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:40.466085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9474d1a-d9ed-441a-8495-6a33f0a1b647 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:40.809183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9474d1a-d9ed-441a-8495-6a33f0a1b647 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:40.811889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=82 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:40.821124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9474d1a-d9ed-441a-8495-6a33f0a1b647 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.382741 Jun 02 19:02:40.831770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 79/154] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:40 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:41.841379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0dba54c6-f254-467b-8be3-bbf88f89f765 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:41.843063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0dba54c6-f254-467b-8be3-bbf88f89f765 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:41.880136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0dba54c6-f254-467b-8be3-bbf88f89f765 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:41.883860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0dba54c6-f254-467b-8be3-bbf88f89f765 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:41.885066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0dba54c6-f254-467b-8be3-bbf88f89f765 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:41.887161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0dba54c6-f254-467b-8be3-bbf88f89f765 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:42.231734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0dba54c6-f254-467b-8be3-bbf88f89f765 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:42.242030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0dba54c6-f254-467b-8be3-bbf88f89f765 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.406657 Jun 02 19:02:42.257053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 76/155] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:41 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:42.591567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-298497912", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:42.652372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] validate_networks() for [('7fa5403b-35dd-490e-b179-061107594334', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:02:42.732151 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:42.759900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:43.172044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:02:43.172719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:02:43.173381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:02:43.174805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:02:43.175409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:02:43.203936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:43.204380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:43.205230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:43.205691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:43.253193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Getting quotas for project e2d79077c0654e55973512bc6d36a9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:02:43.259131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Getting quotas for user 4eda4b85484844ab8b424a1a42a97704 and project e2d79077c0654e55973512bc6d36a9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:02:43.274181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:02:43.286145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:02:43.291962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7badd8b6-8bfe-469e-87bb-c371c72e86b1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:43.293738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7badd8b6-8bfe-469e-87bb-c371c72e86b1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:43.323132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:43.334692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7badd8b6-8bfe-469e-87bb-c371c72e86b1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:43.336230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7badd8b6-8bfe-469e-87bb-c371c72e86b1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:43.342070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7badd8b6-8bfe-469e-87bb-c371c72e86b1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:43.346223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7badd8b6-8bfe-469e-87bb-c371c72e86b1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:43.389529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f5998438-11f1-4b3f-8758-cdf74593f916 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.996886 Jun 02 19:02:43.390260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 80/156] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:02:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:02:43.403810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d6c51e5f-6640-4f2b-b8d6-174e74fc1529 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:43.404422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d6c51e5f-6640-4f2b-b8d6-174e74fc1529 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:43.534695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d6c51e5f-6640-4f2b-b8d6-174e74fc1529 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:43.542030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d6c51e5f-6640-4f2b-b8d6-174e74fc1529 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1221 microversion: 2.1 time: 0.142626 Jun 02 19:02:43.543488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 81/157] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:43 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:43.795625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7badd8b6-8bfe-469e-87bb-c371c72e86b1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:43.820456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7badd8b6-8bfe-469e-87bb-c371c72e86b1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.543428 Jun 02 19:02:43.828888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1191744600", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:43.837975 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 77/158] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:43 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:43.968401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] validate_networks() for [('7fa5403b-35dd-490e-b179-061107594334', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:02:44.811846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-bc0532ac-997f-4236-94cf-0f49b2950e18 req-f96c2c67-dce3-439e-8b41-1f9d570a3132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760b1652-d34f-4b2f-9b98-4968cf872927", "name": "network-vif-plugged", "status": "completed", "tag": "b6cd110e-57b2-4c17-983e-a9624cfea7eb"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:44.845618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-bc0532ac-997f-4236-94cf-0f49b2950e18 req-f96c2c67-dce3-439e-8b41-1f9d570a3132 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:44.847366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-bc0532ac-997f-4236-94cf-0f49b2950e18 req-f96c2c67-dce3-439e-8b41-1f9d570a3132 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:44.878819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-bc0532ac-997f-4236-94cf-0f49b2950e18 req-f96c2c67-dce3-439e-8b41-1f9d570a3132 service nova] Creating event network-vif-plugged:b6cd110e-57b2-4c17-983e-a9624cfea7eb for instance 760b1652-d34f-4b2f-9b98-4968cf872927 on hv-cinder-79760 Jun 02 19:02:44.902822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-bc0532ac-997f-4236-94cf-0f49b2950e18 req-f96c2c67-dce3-439e-8b41-1f9d570a3132 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095166 Jun 02 19:02:44.903647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 78/159] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:02:44.909685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0a37d181-ea2f-40d0-9475-1bc9a47fe85f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:44.923091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0a37d181-ea2f-40d0-9475-1bc9a47fe85f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:44.935837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0a37d181-ea2f-40d0-9475-1bc9a47fe85f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:44.937463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0a37d181-ea2f-40d0-9475-1bc9a47fe85f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:44.938650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0a37d181-ea2f-40d0-9475-1bc9a47fe85f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:44.939261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0a37d181-ea2f-40d0-9475-1bc9a47fe85f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:45.123950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:02:45.124512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:02:45.125009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:02:45.125421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:02:45.125992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:02:45.142444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:45.166053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:45.167736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:45.172259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:45.285709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0a37d181-ea2f-40d0-9475-1bc9a47fe85f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:45.288886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Getting quotas for project e2d79077c0654e55973512bc6d36a9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:02:45.300934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0a37d181-ea2f-40d0-9475-1bc9a47fe85f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.395367 Jun 02 19:02:45.304910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 79/160] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:44 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:45.340866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Getting quotas for user 4eda4b85484844ab8b424a1a42a97704 and project e2d79077c0654e55973512bc6d36a9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:02:45.377637 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:02:45.392822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:02:45.495696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-84a7746f-7da8-4c08-88f9-579817e35900 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.677265 Jun 02 19:02:45.506203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 82/161] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:02:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:02:45.513605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fc10e5f8-7812-4a69-8171-09a8c09afb9f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:45.515227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fc10e5f8-7812-4a69-8171-09a8c09afb9f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:45.633660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fc10e5f8-7812-4a69-8171-09a8c09afb9f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:45.641256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fc10e5f8-7812-4a69-8171-09a8c09afb9f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1222 microversion: 2.1 time: 0.137145 Jun 02 19:02:45.642891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 80/162] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:45 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:46.334133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4ce29522-1f9c-4869-b0ac-86bb405048b7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:46.336839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4ce29522-1f9c-4869-b0ac-86bb405048b7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:46.355426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ce29522-1f9c-4869-b0ac-86bb405048b7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:46.358303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ce29522-1f9c-4869-b0ac-86bb405048b7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:46.359372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ce29522-1f9c-4869-b0ac-86bb405048b7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:46.359941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ce29522-1f9c-4869-b0ac-86bb405048b7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:46.659856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89993efd-1140-45d6-8f4d-2fbe9a21da96 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:46.660483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-89993efd-1140-45d6-8f4d-2fbe9a21da96 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:46.669693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89993efd-1140-45d6-8f4d-2fbe9a21da96 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:46.676774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89993efd-1140-45d6-8f4d-2fbe9a21da96 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:46.683965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89993efd-1140-45d6-8f4d-2fbe9a21da96 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:46.684960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89993efd-1140-45d6-8f4d-2fbe9a21da96 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:46.858006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-89993efd-1140-45d6-8f4d-2fbe9a21da96 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:46.869183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-89993efd-1140-45d6-8f4d-2fbe9a21da96 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1226 microversion: 2.1 time: 0.213216 Jun 02 19:02:46.872301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 81/163] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:46 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1226 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:46.927444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4ce29522-1f9c-4869-b0ac-86bb405048b7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:46.938621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4ce29522-1f9c-4869-b0ac-86bb405048b7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1314 microversion: 2.1 time: 0.608494 Jun 02 19:02:46.950416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 83/164] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:46 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:47.890977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3de23d32-1cbb-4613-afbc-86d04801d8ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:47.891571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3de23d32-1cbb-4613-afbc-86d04801d8ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:47.906509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3de23d32-1cbb-4613-afbc-86d04801d8ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:47.907752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3de23d32-1cbb-4613-afbc-86d04801d8ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:47.909174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3de23d32-1cbb-4613-afbc-86d04801d8ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:47.911238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3de23d32-1cbb-4613-afbc-86d04801d8ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:47.964585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2ace6dfd-f2e1-4da1-b8e5-b3d9e4c46de0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:47.965204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2ace6dfd-f2e1-4da1-b8e5-b3d9e4c46de0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:47.989966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=9 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.991871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2ace6dfd-f2e1-4da1-b8e5-b3d9e4c46de0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:48.015703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2ace6dfd-f2e1-4da1-b8e5-b3d9e4c46de0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:48.021760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2ace6dfd-f2e1-4da1-b8e5-b3d9e4c46de0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:48.033328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2ace6dfd-f2e1-4da1-b8e5-b3d9e4c46de0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:48.104623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3de23d32-1cbb-4613-afbc-86d04801d8ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:48.121350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3de23d32-1cbb-4613-afbc-86d04801d8ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1274 microversion: 2.1 time: 0.234152 Jun 02 19:02:48.124951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 82/165] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:47 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:48.480274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2ace6dfd-f2e1-4da1-b8e5-b3d9e4c46de0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:48.518453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2ace6dfd-f2e1-4da1-b8e5-b3d9e4c46de0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1498 microversion: 2.1 time: 0.565762 Jun 02 19:02:48.522820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 84/166] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:47 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1498 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:49.140170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2c1fd9c4-1e48-41db-82f0-dad0ea94bd6f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:49.140959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2c1fd9c4-1e48-41db-82f0-dad0ea94bd6f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:49.165767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c1fd9c4-1e48-41db-82f0-dad0ea94bd6f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:49.174266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c1fd9c4-1e48-41db-82f0-dad0ea94bd6f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:49.175440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c1fd9c4-1e48-41db-82f0-dad0ea94bd6f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:49.181590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c1fd9c4-1e48-41db-82f0-dad0ea94bd6f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:49.303521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9574398-fea4-4749-98f3-faa5f65f5ae4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:49.304330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9574398-fea4-4749-98f3-faa5f65f5ae4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:49.329914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9574398-fea4-4749-98f3-faa5f65f5ae4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:49.330832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9574398-fea4-4749-98f3-faa5f65f5ae4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:49.332748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9574398-fea4-4749-98f3-faa5f65f5ae4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:49.333445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9574398-fea4-4749-98f3-faa5f65f5ae4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:49.398283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2c1fd9c4-1e48-41db-82f0-dad0ea94bd6f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:49.410100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2c1fd9c4-1e48-41db-82f0-dad0ea94bd6f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1280 microversion: 2.1 time: 0.274813 Jun 02 19:02:49.412375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 83/167] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:49 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:49.412798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9574398-fea4-4749-98f3-faa5f65f5ae4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:02:49.659839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9574398-fea4-4749-98f3-faa5f65f5ae4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "DELETE /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 204 len: 0 microversion: 2.1 time: 0.362323 Jun 02 19:02:49.662825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 85/168] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:02:49 2022] DELETE /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:49.670699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f14063f-2691-4059-857d-e11142b34c84 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:49.671608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5f14063f-2691-4059-857d-e11142b34c84 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:49.687645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f14063f-2691-4059-857d-e11142b34c84 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:49.690316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f14063f-2691-4059-857d-e11142b34c84 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:49.691220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f14063f-2691-4059-857d-e11142b34c84 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:49.691772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f14063f-2691-4059-857d-e11142b34c84 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:50.044734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f14063f-2691-4059-857d-e11142b34c84 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:50.064361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5f14063f-2691-4059-857d-e11142b34c84 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1504 microversion: 2.1 time: 0.396852 Jun 02 19:02:50.077975 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 84/169] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:49 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:50.434473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-75857eeb-bd9b-418e-88a3-cee7b6356a4a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:50.435201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-75857eeb-bd9b-418e-88a3-cee7b6356a4a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:50.456899 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-75857eeb-bd9b-418e-88a3-cee7b6356a4a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:50.457358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-75857eeb-bd9b-418e-88a3-cee7b6356a4a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:50.458179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-75857eeb-bd9b-418e-88a3-cee7b6356a4a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:50.458787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-75857eeb-bd9b-418e-88a3-cee7b6356a4a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:50.734276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-75857eeb-bd9b-418e-88a3-cee7b6356a4a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:50.744707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-75857eeb-bd9b-418e-88a3-cee7b6356a4a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.314413 Jun 02 19:02:50.745839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 86/170] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:50 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:51.082457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-635deb60-702a-442e-bbbc-128bbfc88030 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:51.083876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-635deb60-702a-442e-bbbc-128bbfc88030 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:51.086813 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.100680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-635deb60-702a-442e-bbbc-128bbfc88030 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:51.101503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-635deb60-702a-442e-bbbc-128bbfc88030 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:51.102508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-635deb60-702a-442e-bbbc-128bbfc88030 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:51.105554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-635deb60-702a-442e-bbbc-128bbfc88030 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:51.115997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.737206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-635deb60-702a-442e-bbbc-128bbfc88030 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:51.746416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-635deb60-702a-442e-bbbc-128bbfc88030 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1504 microversion: 2.1 time: 0.668390 Jun 02 19:02:51.747293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 85/171] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:51 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1504 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:51.767458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-98a7a48f-476e-4e33-b485-f8121a350f71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:51.773953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-98a7a48f-476e-4e33-b485-f8121a350f71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:51.786287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98a7a48f-476e-4e33-b485-f8121a350f71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:51.787065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98a7a48f-476e-4e33-b485-f8121a350f71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:51.788346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98a7a48f-476e-4e33-b485-f8121a350f71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:51.789149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98a7a48f-476e-4e33-b485-f8121a350f71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:52.139999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-6e4dffd7-b4af-4c2f-81f4-c7dc1f885d8e req-a825eb5d-e5b6-4c32-867f-e118ca06ad90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc057ea-7c78-4621-9e75-8f9654f6157c", "tag": "7bd66668-c08e-4f9a-8f25-71d8c0bf8627"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:52.157042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-6e4dffd7-b4af-4c2f-81f4-c7dc1f885d8e req-a825eb5d-e5b6-4c32-867f-e118ca06ad90 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:52.163078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-6e4dffd7-b4af-4c2f-81f4-c7dc1f885d8e req-a825eb5d-e5b6-4c32-867f-e118ca06ad90 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:52.190994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-6e4dffd7-b4af-4c2f-81f4-c7dc1f885d8e req-a825eb5d-e5b6-4c32-867f-e118ca06ad90 service nova] Creating event network-changed:7bd66668-c08e-4f9a-8f25-71d8c0bf8627 for instance 9dc057ea-7c78-4621-9e75-8f9654f6157c on hv-cinder-79760 Jun 02 19:02:52.199992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-6e4dffd7-b4af-4c2f-81f4-c7dc1f885d8e req-a825eb5d-e5b6-4c32-867f-e118ca06ad90 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065148 Jun 02 19:02:52.202648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 86/172] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:02:52.492770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-98a7a48f-476e-4e33-b485-f8121a350f71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:52.511319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-98a7a48f-476e-4e33-b485-f8121a350f71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.750005 Jun 02 19:02:52.523211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 87/173] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:51 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:52.557178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-5ea72a17-e6fc-4a0c-8600-b772907f0be6 req-03d86a8a-51cc-4c92-b4fe-6db25d8c2bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760b1652-d34f-4b2f-9b98-4968cf872927", "name": "network-vif-deleted", "tag": "b6cd110e-57b2-4c17-983e-a9624cfea7eb"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:52.567439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-5ea72a17-e6fc-4a0c-8600-b772907f0be6 req-03d86a8a-51cc-4c92-b4fe-6db25d8c2bf9 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:52.568069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-5ea72a17-e6fc-4a0c-8600-b772907f0be6 req-03d86a8a-51cc-4c92-b4fe-6db25d8c2bf9 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:52.588943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-5ea72a17-e6fc-4a0c-8600-b772907f0be6 req-03d86a8a-51cc-4c92-b4fe-6db25d8c2bf9 service nova] Creating event network-vif-deleted:b6cd110e-57b2-4c17-983e-a9624cfea7eb for instance 760b1652-d34f-4b2f-9b98-4968cf872927 on hv-cinder-79760 Jun 02 19:02:52.603922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-5ea72a17-e6fc-4a0c-8600-b772907f0be6 req-03d86a8a-51cc-4c92-b4fe-6db25d8c2bf9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051407 Jun 02 19:02:52.608658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 87/174] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:02:52.767200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:52.768055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:52.777821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:52.778772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:52.781574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:52.782206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:52.897740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:52.898221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:52.898693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lazy-loading 'fault' on Instance uuid 760b1652-d34f-4b2f-9b98-4968cf872927 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:02:53.024381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:53.039496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8b654ae8-ba0d-4480-b87a-f6c26825c7b2 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 200 len: 1304 microversion: 2.1 time: 0.277321 Jun 02 19:02:53.041016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 88/175] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:52 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 1304 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:53.544314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-77b18eb6-26a6-4d63-9d9d-9367e7401a95 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:53.545634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-77b18eb6-26a6-4d63-9d9d-9367e7401a95 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:53.552648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77b18eb6-26a6-4d63-9d9d-9367e7401a95 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:53.553377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77b18eb6-26a6-4d63-9d9d-9367e7401a95 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:53.554790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77b18eb6-26a6-4d63-9d9d-9367e7401a95 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:53.555394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77b18eb6-26a6-4d63-9d9d-9367e7401a95 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:53.898904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-77b18eb6-26a6-4d63-9d9d-9367e7401a95 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:53.921354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-77b18eb6-26a6-4d63-9d9d-9367e7401a95 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.393263 Jun 02 19:02:53.932061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 88/176] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:53 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:54.059742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:54.060363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 760b1652-d34f-4b2f-9b98-4968cf872927] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:54.080007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:54.080908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:54.081921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:54.082511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:54.106269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] HTTP exception thrown: Instance 760b1652-d34f-4b2f-9b98-4968cf872927 could not be found. Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Request method failure captured: Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 HTTP/1.1 Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQlFLQaVQqY39k5dlTo_t9lahJyyAP2Ee_p1WLP4Kri1UkOUaPnmoaiPamKABRO5R0WXRJSemrkvPEZCWBfHw_2wI6cDjjZx9dM9IsnXPuN9-4Zx29JLvXi5MibXH15Im_kIbFO0Rs0K4cq6cKYyK40Od2B-flUSMB3kEFvIJauMdG4 Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 9f56ecf8c55d4db69eaa62e872d9f169 Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesActionsTest-1650200502 Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:02:54.108134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f56ecf8c55d4db69eaa62e872d9f169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f56ecf8c55d4db69eaa62e872d9f169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f56ecf8c55d4db69eaa62e872d9f169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f56ecf8c55d4db69eaa62e872d9f169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesActionsTest-1650200502 Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 9f56ecf8c55d4db69eaa62e872d9f169 Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesActionsTest-1650200502 Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesActionsTest-1650200502-project Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 7de00142413f4f57b4782279bc826f4f Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesActionsTest-1650200502-project Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 760b1652-d34f-4b2f-9b98-4968cf872927 could not be found. Jun 02 19:02:54.109679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '760b1652-d34f-4b2f-9b98-4968cf872927'} Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760b1652-d34f-4b2f-9b98-4968cf872927 could not be found. Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:02:54.110421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760b1652-d34f-4b2f-9b98-4968cf872927 could not be found. Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760b1652-d34f-4b2f-9b98-4968cf872927 could not be found. Jun 02 19:02:54.113891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:02:54.115629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Returning 404 to user: Instance 760b1652-d34f-4b2f-9b98-4968cf872927 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:02:54.119649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-756a07d7-05fe-4367-ab67-a74759d674c1 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927" status: 404 len: 111 microversion: 2.1 time: 0.054183 Jun 02 19:02:54.120439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 89/177] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:54 2022] GET /compute/v2.1/servers/760b1652-d34f-4b2f-9b98-4968cf872927 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:02:54.304113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-c521a880-4111-44dc-bc62-7ab3d520503c req-17712da3-c2ab-4289-ab3b-1c149607f14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64c4128-397d-4c23-bdd1-a288b7627bba", "tag": "2ea7d55f-1945-4da5-8db7-67bf31ec73ce"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:54.306262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-303286274", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "networks": [{"uuid": "f5122744-0839-4dba-bb86-bf8f0535738f"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:02:54.328792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c521a880-4111-44dc-bc62-7ab3d520503c req-17712da3-c2ab-4289-ab3b-1c149607f14c service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:54.329229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c521a880-4111-44dc-bc62-7ab3d520503c req-17712da3-c2ab-4289-ab3b-1c149607f14c service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:54.356231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-c521a880-4111-44dc-bc62-7ab3d520503c req-17712da3-c2ab-4289-ab3b-1c149607f14c service nova] Creating event network-changed:2ea7d55f-1945-4da5-8db7-67bf31ec73ce for instance c64c4128-397d-4c23-bdd1-a288b7627bba on hv-cinder-79760 Jun 02 19:02:54.375504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-c521a880-4111-44dc-bc62-7ab3d520503c req-17712da3-c2ab-4289-ab3b-1c149607f14c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074416 Jun 02 19:02:54.379577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 90/178] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:02:54.400811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] validate_networks() for [('f5122744-0839-4dba-bb86-bf8f0535738f', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:02:54.945251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ded20660-43a0-4287-837d-f282ad309b8c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:54.946444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ded20660-43a0-4287-837d-f282ad309b8c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:54.982639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ded20660-43a0-4287-837d-f282ad309b8c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:54.983403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ded20660-43a0-4287-837d-f282ad309b8c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:54.985392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ded20660-43a0-4287-837d-f282ad309b8c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:54.986039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ded20660-43a0-4287-837d-f282ad309b8c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:55.049542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:02:55.050245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:02:55.053054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:02:55.053562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:02:55.054227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:02:55.078509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:55.079359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:55.081594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:55.082320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:55.113301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Getting quotas for project 9f56ecf8c55d4db69eaa62e872d9f169. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:02:55.124826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Getting quotas for user 7de00142413f4f57b4782279bc826f4f and project 9f56ecf8c55d4db69eaa62e872d9f169. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:02:55.139851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:02:55.142679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:02:55.220466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.250269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-82175ba0-94eb-4e21-8f69-ad848676027e tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956407 Jun 02 19:02:55.253657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 89/179] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:02:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:02:55.269147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5583f0b3-d5df-48fb-ad09-9756be870b83 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:55.274876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ded20660-43a0-4287-837d-f282ad309b8c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:55.281640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5583f0b3-d5df-48fb-ad09-9756be870b83 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:55.285990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ded20660-43a0-4287-837d-f282ad309b8c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.348490 Jun 02 19:02:55.286582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 91/180] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:54 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:55.374943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5583f0b3-d5df-48fb-ad09-9756be870b83 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:55.390859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5583f0b3-d5df-48fb-ad09-9756be870b83 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1213 microversion: 2.1 time: 0.126063 Jun 02 19:02:55.392014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 90/181] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:55 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:56.303724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0694987d-bfbb-4f2b-9909-a926e885e885 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:56.305282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0694987d-bfbb-4f2b-9909-a926e885e885 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:56.311309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=14 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.319350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0694987d-bfbb-4f2b-9909-a926e885e885 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:56.320148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0694987d-bfbb-4f2b-9909-a926e885e885 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:56.321890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0694987d-bfbb-4f2b-9909-a926e885e885 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:56.322572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0694987d-bfbb-4f2b-9909-a926e885e885 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:56.411695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6acb6a66-b7f1-4238-8c3f-0af37935bcdc tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:56.412614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6acb6a66-b7f1-4238-8c3f-0af37935bcdc tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:56.424911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6acb6a66-b7f1-4238-8c3f-0af37935bcdc tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:56.426743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6acb6a66-b7f1-4238-8c3f-0af37935bcdc tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:56.428823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6acb6a66-b7f1-4238-8c3f-0af37935bcdc tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:56.429509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6acb6a66-b7f1-4238-8c3f-0af37935bcdc tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:56.605143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6acb6a66-b7f1-4238-8c3f-0af37935bcdc tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:56.615588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6acb6a66-b7f1-4238-8c3f-0af37935bcdc tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1217 microversion: 2.1 time: 0.208325 Jun 02 19:02:56.619911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 91/182] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:56 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:56.631494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0694987d-bfbb-4f2b-9909-a926e885e885 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:56.640209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0694987d-bfbb-4f2b-9909-a926e885e885 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.340548 Jun 02 19:02:56.641124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:56 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:57.640686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-44fcddec-7ccd-4adf-b2c0-fce2f05b7ca4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:57.642068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-44fcddec-7ccd-4adf-b2c0-fce2f05b7ca4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:57.649345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44fcddec-7ccd-4adf-b2c0-fce2f05b7ca4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:57.652438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44fcddec-7ccd-4adf-b2c0-fce2f05b7ca4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:57.653685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44fcddec-7ccd-4adf-b2c0-fce2f05b7ca4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:57.654388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44fcddec-7ccd-4adf-b2c0-fce2f05b7ca4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:57.659248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-889a02a9-4998-492f-896e-1a84451f678c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:57.659862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-889a02a9-4998-492f-896e-1a84451f678c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:57.671149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-889a02a9-4998-492f-896e-1a84451f678c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:57.676648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-889a02a9-4998-492f-896e-1a84451f678c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:57.678296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-889a02a9-4998-492f-896e-1a84451f678c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:57.678756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-889a02a9-4998-492f-896e-1a84451f678c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:57.752704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-44fcddec-7ccd-4adf-b2c0-fce2f05b7ca4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:57.765223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-44fcddec-7ccd-4adf-b2c0-fce2f05b7ca4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1217 microversion: 2.1 time: 0.128672 Jun 02 19:02:57.769934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 92/184] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:57 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:57.782992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e04759f2-9787-471d-b907-737b13ee8e30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:57.784499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e04759f2-9787-471d-b907-737b13ee8e30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:57.803699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e04759f2-9787-471d-b907-737b13ee8e30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:57.804085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e04759f2-9787-471d-b907-737b13ee8e30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:57.805053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e04759f2-9787-471d-b907-737b13ee8e30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:57.810355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e04759f2-9787-471d-b907-737b13ee8e30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:57.874937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e04759f2-9787-471d-b907-737b13ee8e30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/ips" status: 200 len: 152 microversion: 2.20 time: 0.103769 Jun 02 19:02:57.878754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 93/185] 10.222.0.15 () {60 vars in 1288 bytes} [Thu Jun 2 19:02:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/ips => generated 152 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:02:58.090041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-889a02a9-4998-492f-896e-1a84451f678c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:58.102112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-889a02a9-4998-492f-896e-1a84451f678c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.447349 Jun 02 19:02:58.113192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 93/186] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:57 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:58.787053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a29d120e-ae24-41ce-88fa-bb4fb59b68ef tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:58.787738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a29d120e-ae24-41ce-88fa-bb4fb59b68ef tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:58.807911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a29d120e-ae24-41ce-88fa-bb4fb59b68ef tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:58.808597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a29d120e-ae24-41ce-88fa-bb4fb59b68ef tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:58.809558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a29d120e-ae24-41ce-88fa-bb4fb59b68ef tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:58.810203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a29d120e-ae24-41ce-88fa-bb4fb59b68ef tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:58.923713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a29d120e-ae24-41ce-88fa-bb4fb59b68ef tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:58.935555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a29d120e-ae24-41ce-88fa-bb4fb59b68ef tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1265 microversion: 2.1 time: 0.153547 Jun 02 19:02:58.936118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 94/187] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:58 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:59.135541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-407cdab3-4f33-4cb6-b5bc-be639afc422d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:59.136238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-407cdab3-4f33-4cb6-b5bc-be639afc422d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:59.144959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-407cdab3-4f33-4cb6-b5bc-be639afc422d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:59.145735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-407cdab3-4f33-4cb6-b5bc-be639afc422d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:59.146805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-407cdab3-4f33-4cb6-b5bc-be639afc422d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:59.147243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-407cdab3-4f33-4cb6-b5bc-be639afc422d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:59.384875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-407cdab3-4f33-4cb6-b5bc-be639afc422d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:02:59.411174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-407cdab3-4f33-4cb6-b5bc-be639afc422d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.279764 Jun 02 19:02:59.424332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 94/188] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:59 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:59.955712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-587ba295-8a99-4dae-b6bb-e25157300828 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:02:59.956710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-587ba295-8a99-4dae-b6bb-e25157300828 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:02:59.968851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-587ba295-8a99-4dae-b6bb-e25157300828 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:59.969832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-587ba295-8a99-4dae-b6bb-e25157300828 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:02:59.970967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-587ba295-8a99-4dae-b6bb-e25157300828 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:02:59.971997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-587ba295-8a99-4dae-b6bb-e25157300828 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:00.100465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-587ba295-8a99-4dae-b6bb-e25157300828 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:00.113919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-587ba295-8a99-4dae-b6bb-e25157300828 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1265 microversion: 2.1 time: 0.163633 Jun 02 19:03:00.114994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 95/189] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:02:59 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:00.433071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e89b90e3-680f-4ea8-980a-5e2f0c579642 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:00.433919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e89b90e3-680f-4ea8-980a-5e2f0c579642 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:00.445008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e89b90e3-680f-4ea8-980a-5e2f0c579642 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:00.448206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e89b90e3-680f-4ea8-980a-5e2f0c579642 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:00.449324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e89b90e3-680f-4ea8-980a-5e2f0c579642 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:00.450778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e89b90e3-680f-4ea8-980a-5e2f0c579642 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:00.665649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e89b90e3-680f-4ea8-980a-5e2f0c579642 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:00.674272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e89b90e3-680f-4ea8-980a-5e2f0c579642 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.247933 Jun 02 19:03:00.674862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 95/190] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:00 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:01.133612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-518da7ed-b46f-4306-b315-3c38f0290519 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:01.134405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-518da7ed-b46f-4306-b315-3c38f0290519 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:01.142699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-518da7ed-b46f-4306-b315-3c38f0290519 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:01.143155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-518da7ed-b46f-4306-b315-3c38f0290519 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:01.143933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-518da7ed-b46f-4306-b315-3c38f0290519 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:01.144513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-518da7ed-b46f-4306-b315-3c38f0290519 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:01.273529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-518da7ed-b46f-4306-b315-3c38f0290519 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:01.284272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-518da7ed-b46f-4306-b315-3c38f0290519 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1265 microversion: 2.1 time: 0.155634 Jun 02 19:03:01.285560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 96/191] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:01 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:01.692356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7ebadf64-e023-433a-9355-f03b145559cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:01.693677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7ebadf64-e023-433a-9355-f03b145559cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:01.709262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ebadf64-e023-433a-9355-f03b145559cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:01.709980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ebadf64-e023-433a-9355-f03b145559cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:01.712136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ebadf64-e023-433a-9355-f03b145559cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:01.715511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ebadf64-e023-433a-9355-f03b145559cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:02.164296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7ebadf64-e023-433a-9355-f03b145559cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:02.173643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7ebadf64-e023-433a-9355-f03b145559cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.485676 Jun 02 19:03:02.181048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 96/192] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:01 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:02.302063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-77483f57-7e62-4e13-918f-b5f6247cec7b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:02.302799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-77483f57-7e62-4e13-918f-b5f6247cec7b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:02.320229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77483f57-7e62-4e13-918f-b5f6247cec7b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:02.327889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77483f57-7e62-4e13-918f-b5f6247cec7b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:02.328854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77483f57-7e62-4e13-918f-b5f6247cec7b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:02.330894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77483f57-7e62-4e13-918f-b5f6247cec7b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:02.544597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-77483f57-7e62-4e13-918f-b5f6247cec7b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:02.559798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-77483f57-7e62-4e13-918f-b5f6247cec7b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1271 microversion: 2.1 time: 0.256376 Jun 02 19:03:02.561470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 97/193] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:02 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:02.650245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-677930af-e46d-4307-95e6-40c6cab63141 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:02.651243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-677930af-e46d-4307-95e6-40c6cab63141 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:02.670918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-677930af-e46d-4307-95e6-40c6cab63141 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:02.674037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-677930af-e46d-4307-95e6-40c6cab63141 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:02.678817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-677930af-e46d-4307-95e6-40c6cab63141 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:02.680329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-677930af-e46d-4307-95e6-40c6cab63141 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:02.767250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-677930af-e46d-4307-95e6-40c6cab63141 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lazy-loading 'flavor' on Instance uuid 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:03:02.994758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.201114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-247934b4-9285-4b18-8c2d-7e367cc45910 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:03.203530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-247934b4-9285-4b18-8c2d-7e367cc45910 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:03.216329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-247934b4-9285-4b18-8c2d-7e367cc45910 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:03.217122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-247934b4-9285-4b18-8c2d-7e367cc45910 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:03.218315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-247934b4-9285-4b18-8c2d-7e367cc45910 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:03.218995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-247934b4-9285-4b18-8c2d-7e367cc45910 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:03.517079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-677930af-e46d-4307-95e6-40c6cab63141 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "POST /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/action" status: 202 len: 0 microversion: 2.20 time: 0.870945 Jun 02 19:03:03.523024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 97/194] 10.222.0.15 () {62 vars in 1318 bytes} [Thu Jun 2 19:03:02 2022] POST /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/action => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:03:03.533442 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:03.534727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:03.547946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:03.548884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:03.551807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:03.553045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:04.296120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-247934b4-9285-4b18-8c2d-7e367cc45910 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:04.322883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-247934b4-9285-4b18-8c2d-7e367cc45910 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 1.128036 Jun 02 19:03:04.330020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 98/195] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:03 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:04.373438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47d511ed-cf57-42d1-8597-91edb16d783b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:04.374679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47d511ed-cf57-42d1-8597-91edb16d783b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:04.388926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d511ed-cf57-42d1-8597-91edb16d783b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:04.389910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d511ed-cf57-42d1-8597-91edb16d783b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:04.391118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d511ed-cf57-42d1-8597-91edb16d783b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:04.391760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d511ed-cf57-42d1-8597-91edb16d783b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:04.849452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:04.867474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:04.872707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:04.875817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0442f565-943a-4f14-bbd6-5fbd5649682b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 1.349138 Jun 02 19:03:04.876784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 98/196] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:04.888042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-be054763-2b2a-40f2-9b78-ef2456ab4e83 req-6a3ccd4a-5960-4eff-8a6c-8ebb63db2e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc057ea-7c78-4621-9e75-8f9654f6157c", "name": "network-vif-plugged", "status": "completed", "tag": "7bd66668-c08e-4f9a-8f25-71d8c0bf8627"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:04.922841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-be054763-2b2a-40f2-9b78-ef2456ab4e83 req-6a3ccd4a-5960-4eff-8a6c-8ebb63db2e5b service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:04.923471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-be054763-2b2a-40f2-9b78-ef2456ab4e83 req-6a3ccd4a-5960-4eff-8a6c-8ebb63db2e5b service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:04.938326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-be054763-2b2a-40f2-9b78-ef2456ab4e83 req-6a3ccd4a-5960-4eff-8a6c-8ebb63db2e5b service nova] Creating event network-vif-plugged:7bd66668-c08e-4f9a-8f25-71d8c0bf8627 for instance 9dc057ea-7c78-4621-9e75-8f9654f6157c on hv-cinder-79760 Jun 02 19:03:04.946734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-be054763-2b2a-40f2-9b78-ef2456ab4e83 req-6a3ccd4a-5960-4eff-8a6c-8ebb63db2e5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068359 Jun 02 19:03:04.948183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 99/197] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:05.021830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47d511ed-cf57-42d1-8597-91edb16d783b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:05.030655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47d511ed-cf57-42d1-8597-91edb16d783b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.671592 Jun 02 19:03:05.038556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 99/198] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:04 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:05.302793 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-918954df-7f54-4fbe-8522-2fa180289a9d req-0a4e83ec-3c43-40ff-9506-a36852394e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e", "tag": "8d876c1b-9971-41b0-a027-91e28ed2b52a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:05.331445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-918954df-7f54-4fbe-8522-2fa180289a9d req-0a4e83ec-3c43-40ff-9506-a36852394e66 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:05.331907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-918954df-7f54-4fbe-8522-2fa180289a9d req-0a4e83ec-3c43-40ff-9506-a36852394e66 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:05.349905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-974e75d0-2755-4b54-add9-83e616d3acbf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:05.350513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-974e75d0-2755-4b54-add9-83e616d3acbf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:05.356594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.376057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-974e75d0-2755-4b54-add9-83e616d3acbf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:05.378929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-974e75d0-2755-4b54-add9-83e616d3acbf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:05.379519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-918954df-7f54-4fbe-8522-2fa180289a9d req-0a4e83ec-3c43-40ff-9506-a36852394e66 service nova] Creating event network-changed:8d876c1b-9971-41b0-a027-91e28ed2b52a for instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e on hv-cinder-79760 Jun 02 19:03:05.380528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-974e75d0-2755-4b54-add9-83e616d3acbf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:05.381117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-974e75d0-2755-4b54-add9-83e616d3acbf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:05.383425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=10 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.398006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-918954df-7f54-4fbe-8522-2fa180289a9d req-0a4e83ec-3c43-40ff-9506-a36852394e66 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101660 Jun 02 19:03:05.398809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 100/199] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:03:05.896153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:05.896842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:05.905466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:05.905938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:05.906722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:05.907144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:06.372273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-974e75d0-2755-4b54-add9-83e616d3acbf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:06.382793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-974e75d0-2755-4b54-add9-83e616d3acbf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 1.039120 Jun 02 19:03:06.385980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 100/200] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:05 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:06.410037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8b4d3f0b-e0ec-4dc3-a06f-2d92c2e49a9a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:06.423421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8b4d3f0b-e0ec-4dc3-a06f-2d92c2e49a9a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:06.440850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:06.450399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b4d3f0b-e0ec-4dc3-a06f-2d92c2e49a9a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:06.452112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:06.453897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:06.455411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d078283b-a21f-4a82-b24d-2b5c429fe387 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.563638 Jun 02 19:03:06.469887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b4d3f0b-e0ec-4dc3-a06f-2d92c2e49a9a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:06.469887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b4d3f0b-e0ec-4dc3-a06f-2d92c2e49a9a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:06.469887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b4d3f0b-e0ec-4dc3-a06f-2d92c2e49a9a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:06.472437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 101/201] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:06.702642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8b4d3f0b-e0ec-4dc3-a06f-2d92c2e49a9a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:06.720268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8b4d3f0b-e0ec-4dc3-a06f-2d92c2e49a9a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.323279 Jun 02 19:03:06.720518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 101/202] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:06 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:07.009168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-0426a7ac-f0c3-418a-803d-17463b9b1aca req-f0068a6a-2c75-46d2-bdb1-477d0d07b79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64c4128-397d-4c23-bdd1-a288b7627bba", "name": "network-vif-plugged", "status": "completed", "tag": "2ea7d55f-1945-4da5-8db7-67bf31ec73ce"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:07.022287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-0426a7ac-f0c3-418a-803d-17463b9b1aca req-f0068a6a-2c75-46d2-bdb1-477d0d07b79f service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:07.022715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-0426a7ac-f0c3-418a-803d-17463b9b1aca req-f0068a6a-2c75-46d2-bdb1-477d0d07b79f service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:07.037046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-0426a7ac-f0c3-418a-803d-17463b9b1aca req-f0068a6a-2c75-46d2-bdb1-477d0d07b79f service nova] Creating event network-vif-plugged:2ea7d55f-1945-4da5-8db7-67bf31ec73ce for instance c64c4128-397d-4c23-bdd1-a288b7627bba on hv-cinder-79760 Jun 02 19:03:07.066146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-0426a7ac-f0c3-418a-803d-17463b9b1aca req-f0068a6a-2c75-46d2-bdb1-477d0d07b79f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060352 Jun 02 19:03:07.069349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 102/203] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:07.409341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f34ff840-c08f-4b58-a26b-ad7b43f8ba1f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:07.410104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f34ff840-c08f-4b58-a26b-ad7b43f8ba1f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:07.423677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f34ff840-c08f-4b58-a26b-ad7b43f8ba1f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:07.430090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f34ff840-c08f-4b58-a26b-ad7b43f8ba1f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:07.432649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f34ff840-c08f-4b58-a26b-ad7b43f8ba1f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:07.433301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f34ff840-c08f-4b58-a26b-ad7b43f8ba1f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:07.474382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:07.478491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:07.485673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:07.486150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:07.486909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:07.487340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:07.762361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:07.764626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f34ff840-c08f-4b58-a26b-ad7b43f8ba1f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:07.773120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f34ff840-c08f-4b58-a26b-ad7b43f8ba1f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.367650 Jun 02 19:03:07.775180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 102/204] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:07 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:07.780085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-42720609-d6d5-4860-a7a5-944942b0e2e7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:07.781001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-42720609-d6d5-4860-a7a5-944942b0e2e7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:07.788644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42720609-d6d5-4860-a7a5-944942b0e2e7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:07.789642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42720609-d6d5-4860-a7a5-944942b0e2e7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:07.790768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42720609-d6d5-4860-a7a5-944942b0e2e7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:07.791472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42720609-d6d5-4860-a7a5-944942b0e2e7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:07.795818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:07.798891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:07.801208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7c5c4a16-9a74-4ca8-8f7c-91f719c4d155 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.331496 Jun 02 19:03:07.802391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 103/205] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:07.977414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-42720609-d6d5-4860-a7a5-944942b0e2e7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:07.985875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-42720609-d6d5-4860-a7a5-944942b0e2e7 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.209671 Jun 02 19:03:07.987388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 103/206] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:07 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:08.795217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dc520557-f14b-474c-b50c-2af8b968e10c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:08.797403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dc520557-f14b-474c-b50c-2af8b968e10c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:08.810399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc520557-f14b-474c-b50c-2af8b968e10c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:08.811258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc520557-f14b-474c-b50c-2af8b968e10c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:08.812839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc520557-f14b-474c-b50c-2af8b968e10c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:08.813609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc520557-f14b-474c-b50c-2af8b968e10c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:08.833488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:08.837373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:08.845976 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:08.847344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:08.847755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:08.848383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:09.083888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:09.095983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:09.097901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:09.099470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3fbf77fe-0f86-4fb0-ac51-051d7e05ab44 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.279017 Jun 02 19:03:09.111702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 104/207] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:09.117177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9c73b5c9-8eff-44ad-870c-6ca1f98e9e99 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:09.118242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9c73b5c9-8eff-44ad-870c-6ca1f98e9e99 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:09.125780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c73b5c9-8eff-44ad-870c-6ca1f98e9e99 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:09.126649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c73b5c9-8eff-44ad-870c-6ca1f98e9e99 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:09.127650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c73b5c9-8eff-44ad-870c-6ca1f98e9e99 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:09.128379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c73b5c9-8eff-44ad-870c-6ca1f98e9e99 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:09.133687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:09.143328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dc520557-f14b-474c-b50c-2af8b968e10c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:09.155693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dc520557-f14b-474c-b50c-2af8b968e10c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.366947 Jun 02 19:03:09.165419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 104/208] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:08 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:09.292027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9c73b5c9-8eff-44ad-870c-6ca1f98e9e99 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:09.302178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9c73b5c9-8eff-44ad-870c-6ca1f98e9e99 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.188867 Jun 02 19:03:09.303241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 105/209] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:09 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:10.119556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:10.120165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:10.127627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:10.128317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:10.130691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:10.131331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:10.177672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5b8b121e-0eef-4c9d-bf1e-dea12f9b64f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:10.179535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5b8b121e-0eef-4c9d-bf1e-dea12f9b64f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:10.192857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b8b121e-0eef-4c9d-bf1e-dea12f9b64f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:10.196208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b8b121e-0eef-4c9d-bf1e-dea12f9b64f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:10.197302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b8b121e-0eef-4c9d-bf1e-dea12f9b64f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:10.198424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b8b121e-0eef-4c9d-bf1e-dea12f9b64f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:10.337872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:10.347461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:10.349788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:10.353212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d96c98ce-e657-4951-b714-d8bccdf4c779 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.237688 Jun 02 19:03:10.354180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 105/210] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:10.360180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-624df47a-20d4-4c7c-8d0a-71adb6c44014 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:10.361315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-624df47a-20d4-4c7c-8d0a-71adb6c44014 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:10.373216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-624df47a-20d4-4c7c-8d0a-71adb6c44014 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:10.373664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-624df47a-20d4-4c7c-8d0a-71adb6c44014 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:10.374481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-624df47a-20d4-4c7c-8d0a-71adb6c44014 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:10.375107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-624df47a-20d4-4c7c-8d0a-71adb6c44014 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:10.426328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5b8b121e-0eef-4c9d-bf1e-dea12f9b64f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:10.434885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5b8b121e-0eef-4c9d-bf1e-dea12f9b64f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.265771 Jun 02 19:03:10.440073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 106/211] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:10 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:10.566708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-624df47a-20d4-4c7c-8d0a-71adb6c44014 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:10.575027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-624df47a-20d4-4c7c-8d0a-71adb6c44014 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.219140 Jun 02 19:03:10.575762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 106/212] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:10 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:11.386003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:11.388075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:11.400168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:11.407846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:11.408695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:11.409140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:11.457687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-795955ab-67bc-4c11-a349-5f6ec0424997 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:11.458423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-795955ab-67bc-4c11-a349-5f6ec0424997 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:11.466303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-795955ab-67bc-4c11-a349-5f6ec0424997 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:11.466902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-795955ab-67bc-4c11-a349-5f6ec0424997 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:11.467844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-795955ab-67bc-4c11-a349-5f6ec0424997 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:11.468417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-795955ab-67bc-4c11-a349-5f6ec0424997 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:11.838690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:11.847247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-795955ab-67bc-4c11-a349-5f6ec0424997 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:11.854905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:11.857029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-795955ab-67bc-4c11-a349-5f6ec0424997 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1322 microversion: 2.1 time: 0.403837 Jun 02 19:03:11.857935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 107/213] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:11 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:11.859031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:11.860908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b49800b2-df9c-416b-9c04-ce2fe6879d3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.491800 Jun 02 19:03:11.862192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 107/214] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:11.872672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-10c0b770-f7ae-40a0-8a48-585d086c0991 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:11.874472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-10c0b770-f7ae-40a0-8a48-585d086c0991 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:11.883794 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10c0b770-f7ae-40a0-8a48-585d086c0991 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:11.884516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10c0b770-f7ae-40a0-8a48-585d086c0991 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:11.885429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10c0b770-f7ae-40a0-8a48-585d086c0991 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:11.886024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10c0b770-f7ae-40a0-8a48-585d086c0991 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:12.068826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-10c0b770-f7ae-40a0-8a48-585d086c0991 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:12.080472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-10c0b770-f7ae-40a0-8a48-585d086c0991 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.219497 Jun 02 19:03:12.080472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 108/215] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:11 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:12.875189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-86df2300-8bd8-4a3f-ad9f-f418fdc59e83 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:12.876545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-86df2300-8bd8-4a3f-ad9f-f418fdc59e83 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:12.885738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:12.887874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:12.890999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86df2300-8bd8-4a3f-ad9f-f418fdc59e83 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:12.892762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86df2300-8bd8-4a3f-ad9f-f418fdc59e83 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:12.893679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86df2300-8bd8-4a3f-ad9f-f418fdc59e83 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:12.896130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:12.896817 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86df2300-8bd8-4a3f-ad9f-f418fdc59e83 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:12.897516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:12.899806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:12.901460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:13.180499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:13.186669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-86df2300-8bd8-4a3f-ad9f-f418fdc59e83 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:13.190667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:13.192620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:13.194683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b67f4c88-bf73-4528-b9cc-9ab5a3966397 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.317059 Jun 02 19:03:13.195841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 109/216] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:13.201997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-096fbf85-879b-4482-982a-a2087b99d80d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:13.202591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-86df2300-8bd8-4a3f-ad9f-f418fdc59e83 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1516 microversion: 2.1 time: 0.332594 Jun 02 19:03:13.203007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-096fbf85-879b-4482-982a-a2087b99d80d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:13.214138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 108/217] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:12 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1516 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:13.221952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-096fbf85-879b-4482-982a-a2087b99d80d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:13.222685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-096fbf85-879b-4482-982a-a2087b99d80d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:13.223801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-096fbf85-879b-4482-982a-a2087b99d80d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:13.224479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-096fbf85-879b-4482-982a-a2087b99d80d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:13.224721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fb0a0c54-e10c-42f4-9088-bb49587e30c3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:13.226263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fb0a0c54-e10c-42f4-9088-bb49587e30c3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:13.247925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb0a0c54-e10c-42f4-9088-bb49587e30c3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:13.248415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb0a0c54-e10c-42f4-9088-bb49587e30c3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:13.249231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb0a0c54-e10c-42f4-9088-bb49587e30c3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:13.253233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb0a0c54-e10c-42f4-9088-bb49587e30c3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:13.288370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-fb0a0c54-e10c-42f4-9088-bb49587e30c3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lazy-loading 'flavor' on Instance uuid c64c4128-397d-4c23-bdd1-a288b7627bba {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:03:13.403982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-096fbf85-879b-4482-982a-a2087b99d80d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:13.412233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-096fbf85-879b-4482-982a-a2087b99d80d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.215030 Jun 02 19:03:13.414311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 110/218] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:13 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:13.477058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fb0a0c54-e10c-42f4-9088-bb49587e30c3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba/action" status: 200 len: 32 microversion: 2.1 time: 0.259325 Jun 02 19:03:13.478699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 109/219] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:03:13 2022] POST /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 19:03:13.489392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-be3bab90-bf4f-4e64-808f-3305fdf5658a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:13.490128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-be3bab90-bf4f-4e64-808f-3305fdf5658a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:13.507321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be3bab90-bf4f-4e64-808f-3305fdf5658a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:13.507321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be3bab90-bf4f-4e64-808f-3305fdf5658a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:13.508181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be3bab90-bf4f-4e64-808f-3305fdf5658a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:13.508615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be3bab90-bf4f-4e64-808f-3305fdf5658a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:13.859831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-be3bab90-bf4f-4e64-808f-3305fdf5658a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:13.905329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-be3bab90-bf4f-4e64-808f-3305fdf5658a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.404287 Jun 02 19:03:13.905329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 111/220] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:13 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:13.922302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f60e60c7-c1ca-4a64-a265-92e8e1449204 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:13.922982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f60e60c7-c1ca-4a64-a265-92e8e1449204 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:13.936806 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f60e60c7-c1ca-4a64-a265-92e8e1449204 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:13.937280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f60e60c7-c1ca-4a64-a265-92e8e1449204 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:13.938145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f60e60c7-c1ca-4a64-a265-92e8e1449204 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:13.938580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f60e60c7-c1ca-4a64-a265-92e8e1449204 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:14.011636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f60e60c7-c1ca-4a64-a265-92e8e1449204 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/ips" status: 200 len: 150 microversion: 2.1 time: 0.096094 Jun 02 19:03:14.012234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 110/221] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:03:13 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/ips => generated 150 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:14.217788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:14.218671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:14.230017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:14.233989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:14.235923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:14.236600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:14.434342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4eb3000-4111-4cb3-aa91-df8cdd94d11d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:14.435153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c4eb3000-4111-4cb3-aa91-df8cdd94d11d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:14.458368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4eb3000-4111-4cb3-aa91-df8cdd94d11d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:14.458837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4eb3000-4111-4cb3-aa91-df8cdd94d11d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:14.462426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4eb3000-4111-4cb3-aa91-df8cdd94d11d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:14.462908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4eb3000-4111-4cb3-aa91-df8cdd94d11d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:14.611781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:14.627530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:14.631063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:14.635843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f5f6ab62-4fbe-4e51-b418-8c502cc329ca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.422806 Jun 02 19:03:14.640651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 112/222] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:14.913516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aafe57c7-3be0-4a34-b6b0-4509ec9e678f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:14.914449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aafe57c7-3be0-4a34-b6b0-4509ec9e678f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:14.931229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aafe57c7-3be0-4a34-b6b0-4509ec9e678f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:14.933331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aafe57c7-3be0-4a34-b6b0-4509ec9e678f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:14.934783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aafe57c7-3be0-4a34-b6b0-4509ec9e678f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:14.935669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aafe57c7-3be0-4a34-b6b0-4509ec9e678f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:14.937572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c4eb3000-4111-4cb3-aa91-df8cdd94d11d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:14.949872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c4eb3000-4111-4cb3-aa91-df8cdd94d11d tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.521077 Jun 02 19:03:14.954308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 111/223] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:14 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:15.143762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aafe57c7-3be0-4a34-b6b0-4509ec9e678f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:15.151972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7bbf0f9c-f484-4d8a-9178-75d0ad3d3972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Action: 'create', calling method: .version_select at 0x7f5b7986d790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-53525394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4gVMr29lvo74nhQNoAYCrNN5CgK56hoFsauv/YW6x8lQuzBkboz0UROCFaazydnL7/pw9yVlkHSUftfvq742balUnHVxzjL5H9P0wzrYUE113BNyD7eL4DWp2MmX+skw=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:15.156999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aafe57c7-3be0-4a34-b6b0-4509ec9e678f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.247964 Jun 02 19:03:15.157577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 113/224] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:14 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:15.189453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-7bbf0f9c-f484-4d8a-9178-75d0ad3d3972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Getting quotas for project 3cefe0d5fbae4b6ca7578bf08f275bac. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:03:15.193913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-7bbf0f9c-f484-4d8a-9178-75d0ad3d3972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Getting quotas for user 9791fd04ff4045578041a3c7f613f495 and project 3cefe0d5fbae4b6ca7578bf08f275bac. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:03:15.248524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7bbf0f9c-f484-4d8a-9178-75d0ad3d3972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.102719 Jun 02 19:03:15.249848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 112/225] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:03:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:15.380140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-462064226", "imageRef": "c17bf7a5-122c-4099-964a-7a6dffa9ed13", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-53525394", "networks": [{"uuid": "97560cc1-3faa-4576-abc8-67754121f304"}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:15.439995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] validate_networks() for [('97560cc1-3faa-4576-abc8-67754121f304', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:03:15.658778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:15.659415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:15.670789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:15.671513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:15.672468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:15.673066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.181586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:16.198983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:16.200861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:16.203524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-be2bfd88-4483-4a42-af8e-02a6ee36f383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.549109 Jun 02 19:03:16.205419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 113/226] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:16.213547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-ff1b671d-16b8-4ebd-9810-72ff810562ac req-403a5061-dc63-4f62-82a9-c7ebaf7b615a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e", "name": "network-vif-plugged", "status": "completed", "tag": "8d876c1b-9971-41b0-a027-91e28ed2b52a"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:16.227181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ff1b671d-16b8-4ebd-9810-72ff810562ac req-403a5061-dc63-4f62-82a9-c7ebaf7b615a service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.227989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ff1b671d-16b8-4ebd-9810-72ff810562ac req-403a5061-dc63-4f62-82a9-c7ebaf7b615a service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.230584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:03:16.231614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:03:16.232292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:03:16.232929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:03:16.233530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:03:16.243833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.245095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-ff1b671d-16b8-4ebd-9810-72ff810562ac req-403a5061-dc63-4f62-82a9-c7ebaf7b615a service nova] Creating event network-vif-plugged:8d876c1b-9971-41b0-a027-91e28ed2b52a for instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e on hv-cinder-79760 Jun 02 19:03:16.245550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.247604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.248346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.250784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-ff1b671d-16b8-4ebd-9810-72ff810562ac req-403a5061-dc63-4f62-82a9-c7ebaf7b615a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043904 Jun 02 19:03:16.251475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 114/227] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:16.257759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-794c8b30-a64c-4d51-8b36-8a6aaf36f30b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77197eb9-d3d2-4d14-950a-aac26709c4fa"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:16.259365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-794c8b30-a64c-4d51-8b36-8a6aaf36f30b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:16.267866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-794c8b30-a64c-4d51-8b36-8a6aaf36f30b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.268597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-794c8b30-a64c-4d51-8b36-8a6aaf36f30b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.269717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-794c8b30-a64c-4d51-8b36-8a6aaf36f30b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.270458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-794c8b30-a64c-4d51-8b36-8a6aaf36f30b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.291483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Getting quotas for project 3cefe0d5fbae4b6ca7578bf08f275bac. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:03:16.297085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Getting quotas for user 9791fd04ff4045578041a3c7f613f495 and project 3cefe0d5fbae4b6ca7578bf08f275bac. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:03:16.335572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:03:16.343669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c17bf7a5-122c-4099-964a-7a6dffa9ed13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:03:16.412617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-612e2416-c443-4a14-90d6-5cd19aec8bab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036954 Jun 02 19:03:16.413592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 114/228] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:03:16.422544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-985dc3ce-fa43-4401-8af1-9a2e51ea4e42 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:16.423466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-985dc3ce-fa43-4401-8af1-9a2e51ea4e42 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:16.453932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-985dc3ce-fa43-4401-8af1-9a2e51ea4e42 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.454713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-985dc3ce-fa43-4401-8af1-9a2e51ea4e42 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.465881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-985dc3ce-fa43-4401-8af1-9a2e51ea4e42 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.467101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-985dc3ce-fa43-4401-8af1-9a2e51ea4e42 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.497710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:16.660261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-794c8b30-a64c-4d51-8b36-8a6aaf36f30b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407331 Jun 02 19:03:16.660988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 115/229] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:03:16 2022] POST /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:16.700811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b992aa51-e4bf-4579-8922-55ee97bd1d62 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:16.702202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b992aa51-e4bf-4579-8922-55ee97bd1d62 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:16.713390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b992aa51-e4bf-4579-8922-55ee97bd1d62 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.716309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b992aa51-e4bf-4579-8922-55ee97bd1d62 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.722045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b992aa51-e4bf-4579-8922-55ee97bd1d62 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:16.722677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b992aa51-e4bf-4579-8922-55ee97bd1d62 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:16.880207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-985dc3ce-fa43-4401-8af1-9a2e51ea4e42 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:16.889817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-985dc3ce-fa43-4401-8af1-9a2e51ea4e42 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.474623 Jun 02 19:03:16.890405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 115/230] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:16 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:16.896866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b2e3e23d-61ad-4987-a3b1-2ecf23e132c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:16.897826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b2e3e23d-61ad-4987-a3b1-2ecf23e132c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:16.972253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b2e3e23d-61ad-4987-a3b1-2ecf23e132c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:16.983917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b2e3e23d-61ad-4987-a3b1-2ecf23e132c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1256 microversion: 2.1 time: 0.091393 Jun 02 19:03:16.985051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 116/231] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1256 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:17.024093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b992aa51-e4bf-4579-8922-55ee97bd1d62 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:17.033299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b992aa51-e4bf-4579-8922-55ee97bd1d62 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.370310 Jun 02 19:03:17.034401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 116/232] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:16 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:17.231790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:17.232472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:17.243663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:17.244318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:17.245264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:17.246038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:17.423267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:17.433659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:17.435557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:17.437138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-abdcc33e-7656-4bbd-b6e1-a7c6c9e2052f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.214414 Jun 02 19:03:17.437693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 117/233] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:17.906296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c50c6d99-176c-400a-b5b1-8e9a4bc4e2cf tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:17.907014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c50c6d99-176c-400a-b5b1-8e9a4bc4e2cf tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:17.913780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c50c6d99-176c-400a-b5b1-8e9a4bc4e2cf tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:17.914520 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c50c6d99-176c-400a-b5b1-8e9a4bc4e2cf tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:17.915360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c50c6d99-176c-400a-b5b1-8e9a4bc4e2cf tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:17.915804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c50c6d99-176c-400a-b5b1-8e9a4bc4e2cf tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:18.002395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dfa69bf3-461f-496a-bc8e-d4b1051ab56a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:18.003388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dfa69bf3-461f-496a-bc8e-d4b1051ab56a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:18.011054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfa69bf3-461f-496a-bc8e-d4b1051ab56a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:18.011504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfa69bf3-461f-496a-bc8e-d4b1051ab56a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:18.012275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfa69bf3-461f-496a-bc8e-d4b1051ab56a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:18.012704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfa69bf3-461f-496a-bc8e-d4b1051ab56a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:18.113241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c50c6d99-176c-400a-b5b1-8e9a4bc4e2cf tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:18.115730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dfa69bf3-461f-496a-bc8e-d4b1051ab56a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:18.127286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dfa69bf3-461f-496a-bc8e-d4b1051ab56a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1308 microversion: 2.1 time: 0.128970 Jun 02 19:03:18.128725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 118/234] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:18.129142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c50c6d99-176c-400a-b5b1-8e9a4bc4e2cf tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1313 microversion: 2.1 time: 0.224280 Jun 02 19:03:18.144009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-263ae617-d4f9-4a6e-b211-cbcb770bf839 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:18.144715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-263ae617-d4f9-4a6e-b211-cbcb770bf839 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:18.145000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 117/235] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:17 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:18.146899 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.154523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-263ae617-d4f9-4a6e-b211-cbcb770bf839 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:18.154802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-263ae617-d4f9-4a6e-b211-cbcb770bf839 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:18.155576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-263ae617-d4f9-4a6e-b211-cbcb770bf839 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:18.156008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-263ae617-d4f9-4a6e-b211-cbcb770bf839 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:18.347698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-263ae617-d4f9-4a6e-b211-cbcb770bf839 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:18.361637 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-263ae617-d4f9-4a6e-b211-cbcb770bf839 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.231236 Jun 02 19:03:18.362306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 119/236] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:18 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:18.457049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:18.457670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:18.464163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:18.464630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:18.465411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:18.466214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:18.753253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:18.765404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:18.767653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:18.769472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8add47c4-64ac-47b7-afae-4d11b2176c0f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.316329 Jun 02 19:03:18.781862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 118/237] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:19.152966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d62cce0-dd5f-46de-af1f-a9194b6a2215 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:19.154006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-27ee6a22-fcad-4f69-a752-5c9b3bacbab7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:19.154799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d62cce0-dd5f-46de-af1f-a9194b6a2215 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:19.155590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-27ee6a22-fcad-4f69-a752-5c9b3bacbab7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:19.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d62cce0-dd5f-46de-af1f-a9194b6a2215 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:19.170062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27ee6a22-fcad-4f69-a752-5c9b3bacbab7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:19.170701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27ee6a22-fcad-4f69-a752-5c9b3bacbab7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:19.171345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d62cce0-dd5f-46de-af1f-a9194b6a2215 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:19.173241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d62cce0-dd5f-46de-af1f-a9194b6a2215 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:19.173653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27ee6a22-fcad-4f69-a752-5c9b3bacbab7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:19.174333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27ee6a22-fcad-4f69-a752-5c9b3bacbab7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:19.178445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d62cce0-dd5f-46de-af1f-a9194b6a2215 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:19.338470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-27ee6a22-fcad-4f69-a752-5c9b3bacbab7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:19.347582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-27ee6a22-fcad-4f69-a752-5c9b3bacbab7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1314 microversion: 2.1 time: 0.199550 Jun 02 19:03:19.348270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:19.380485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3fb468ff-b728-4440-a6e7-2504dd896e36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:19.381142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3fb468ff-b728-4440-a6e7-2504dd896e36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:19.394300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3fb468ff-b728-4440-a6e7-2504dd896e36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:19.394759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3fb468ff-b728-4440-a6e7-2504dd896e36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:19.395544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3fb468ff-b728-4440-a6e7-2504dd896e36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:19.395983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3fb468ff-b728-4440-a6e7-2504dd896e36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:19.762111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d62cce0-dd5f-46de-af1f-a9194b6a2215 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:19.776709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d62cce0-dd5f-46de-af1f-a9194b6a2215 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1498 microversion: 2.1 time: 0.633105 Jun 02 19:03:19.777931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 119/239] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:19 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1498 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:19.790062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:19.794750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:19.832890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:19.833451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:19.834330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:19.839888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:19.912631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.928436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3fb468ff-b728-4440-a6e7-2504dd896e36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:19.942892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3fb468ff-b728-4440-a6e7-2504dd896e36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.566231 Jun 02 19:03:19.943498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 121/240] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:19 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:20.172206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:20.195666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:20.222096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:20.222096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e8aee04c-e5f5-42ab-90da-c7673cf21e86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.433059 Jun 02 19:03:20.229545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 120/241] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:20.366443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e2877c20-96c3-46a8-8049-3896d52e10be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:20.367050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e2877c20-96c3-46a8-8049-3896d52e10be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:20.384743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2877c20-96c3-46a8-8049-3896d52e10be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:20.389163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2877c20-96c3-46a8-8049-3896d52e10be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:20.390284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2877c20-96c3-46a8-8049-3896d52e10be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:20.390738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2877c20-96c3-46a8-8049-3896d52e10be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:20.874517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a4a99786-b825-4ae9-b6d0-79e03c2e084c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:20.875369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a4a99786-b825-4ae9-b6d0-79e03c2e084c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:20.919857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4a99786-b825-4ae9-b6d0-79e03c2e084c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:20.922566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4a99786-b825-4ae9-b6d0-79e03c2e084c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:20.923556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4a99786-b825-4ae9-b6d0-79e03c2e084c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:20.924016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4a99786-b825-4ae9-b6d0-79e03c2e084c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:20.959516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e2877c20-96c3-46a8-8049-3896d52e10be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:20.976728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e2877c20-96c3-46a8-8049-3896d52e10be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.614426 Jun 02 19:03:20.991980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 122/242] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:21.006578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-699373fb-6e69-498a-a11a-aa89ac71f2e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:21.008938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-699373fb-6e69-498a-a11a-aa89ac71f2e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:21.017828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a4a99786-b825-4ae9-b6d0-79e03c2e084c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:03:21.031263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-699373fb-6e69-498a-a11a-aa89ac71f2e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:21.032107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-699373fb-6e69-498a-a11a-aa89ac71f2e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:21.033338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-699373fb-6e69-498a-a11a-aa89ac71f2e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:21.034385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-699373fb-6e69-498a-a11a-aa89ac71f2e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:21.212436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:21.236229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a4a99786-b825-4ae9-b6d0-79e03c2e084c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 204 len: 0 microversion: 2.1 time: 0.365618 Jun 02 19:03:21.242116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 121/243] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:03:20 2022] DELETE /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 19:03:21.255613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d42b0a22-2c47-4dba-a446-9f0ca8351b5a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:21.256789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d42b0a22-2c47-4dba-a446-9f0ca8351b5a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:21.264954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d42b0a22-2c47-4dba-a446-9f0ca8351b5a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:21.265408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d42b0a22-2c47-4dba-a446-9f0ca8351b5a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:21.266401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d42b0a22-2c47-4dba-a446-9f0ca8351b5a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:21.267045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d42b0a22-2c47-4dba-a446-9f0ca8351b5a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:21.400428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-699373fb-6e69-498a-a11a-aa89ac71f2e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:21.413024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-699373fb-6e69-498a-a11a-aa89ac71f2e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.419707 Jun 02 19:03:21.427067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 123/244] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:20 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:21.444775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:21.445876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:21.461823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:21.462529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:21.463483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:21.464057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:21.617750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d42b0a22-2c47-4dba-a446-9f0ca8351b5a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:21.635994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d42b0a22-2c47-4dba-a446-9f0ca8351b5a tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.390935 Jun 02 19:03:21.643006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 122/245] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:21 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:21.840335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:21.853501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:21.859686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:21.861215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-23f72047-82e2-4177-acaa-a0824a725643 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.423005 Jun 02 19:03:21.862265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 124/246] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:22.004102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78a4fa15-f299-4d5c-beba-b9cf437038fd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:22.005505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78a4fa15-f299-4d5c-beba-b9cf437038fd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:22.016355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78a4fa15-f299-4d5c-beba-b9cf437038fd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:22.019968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78a4fa15-f299-4d5c-beba-b9cf437038fd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:22.021728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78a4fa15-f299-4d5c-beba-b9cf437038fd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:22.022731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78a4fa15-f299-4d5c-beba-b9cf437038fd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:22.296303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-78a4fa15-f299-4d5c-beba-b9cf437038fd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:22.304974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78a4fa15-f299-4d5c-beba-b9cf437038fd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.308486 Jun 02 19:03:22.305563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 123/247] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:22.440968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2f75a491-8eff-4443-acbb-8c687af6db35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:22.441641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2f75a491-8eff-4443-acbb-8c687af6db35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:22.448226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f75a491-8eff-4443-acbb-8c687af6db35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:22.448759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f75a491-8eff-4443-acbb-8c687af6db35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:22.449638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f75a491-8eff-4443-acbb-8c687af6db35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:22.450234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f75a491-8eff-4443-acbb-8c687af6db35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:22.639012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2f75a491-8eff-4443-acbb-8c687af6db35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:22.648027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2f75a491-8eff-4443-acbb-8c687af6db35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.212703 Jun 02 19:03:22.648027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 125/248] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:22 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:22.662492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e668a3d6-fc62-4878-94f3-7c582a95d491 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:22.663506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e668a3d6-fc62-4878-94f3-7c582a95d491 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:22.671450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e668a3d6-fc62-4878-94f3-7c582a95d491 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:22.672069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e668a3d6-fc62-4878-94f3-7c582a95d491 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:22.672680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e668a3d6-fc62-4878-94f3-7c582a95d491 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:22.673126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e668a3d6-fc62-4878-94f3-7c582a95d491 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:22.890919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:22.891541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:22.912323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:22.919687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:22.920549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:22.920984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:22.995136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e668a3d6-fc62-4878-94f3-7c582a95d491 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:23.007885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e668a3d6-fc62-4878-94f3-7c582a95d491 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.350451 Jun 02 19:03:23.009388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 124/249] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:22 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:23.140426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:23.152603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:23.154940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:23.156582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6e4f032b-769b-4731-8cca-2eb4a4cf1b2c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.278099 Jun 02 19:03:23.165177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 126/250] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:23.322897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e6ae6197-8bdd-4c4f-84ef-373e810dd572 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:23.323522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e6ae6197-8bdd-4c4f-84ef-373e810dd572 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:23.330854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6ae6197-8bdd-4c4f-84ef-373e810dd572 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:23.331538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6ae6197-8bdd-4c4f-84ef-373e810dd572 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:23.334010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6ae6197-8bdd-4c4f-84ef-373e810dd572 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:23.334010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6ae6197-8bdd-4c4f-84ef-373e810dd572 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:23.501425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e6ae6197-8bdd-4c4f-84ef-373e810dd572 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:23.510685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e6ae6197-8bdd-4c4f-84ef-373e810dd572 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.191960 Jun 02 19:03:23.512094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 125/251] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:23.673210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b8713eb-e211-49ec-ac36-c4c59e6b80ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:23.674053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b8713eb-e211-49ec-ac36-c4c59e6b80ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:23.693409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b8713eb-e211-49ec-ac36-c4c59e6b80ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:23.693881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b8713eb-e211-49ec-ac36-c4c59e6b80ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:23.695913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b8713eb-e211-49ec-ac36-c4c59e6b80ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:23.696544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b8713eb-e211-49ec-ac36-c4c59e6b80ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:23.931016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3b8713eb-e211-49ec-ac36-c4c59e6b80ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:23.941111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b8713eb-e211-49ec-ac36-c4c59e6b80ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.277742 Jun 02 19:03:23.941910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 127/252] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:23 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:24.026980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f035beee-53c1-4d99-9f6d-e66b5157624b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:24.030309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f035beee-53c1-4d99-9f6d-e66b5157624b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:24.041138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f035beee-53c1-4d99-9f6d-e66b5157624b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:24.042249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f035beee-53c1-4d99-9f6d-e66b5157624b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:24.043493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f035beee-53c1-4d99-9f6d-e66b5157624b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:24.045024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f035beee-53c1-4d99-9f6d-e66b5157624b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:24.184146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:24.184146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:24.201849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:24.203354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:24.205063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:24.205605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:24.304895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f035beee-53c1-4d99-9f6d-e66b5157624b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:24.320881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f035beee-53c1-4d99-9f6d-e66b5157624b tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.298725 Jun 02 19:03:24.335046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 126/253] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:24 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:24.497354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:24.508633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:24.511406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:24.512613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6cb89b63-4a05-4b04-8d82-ca9068575c3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.340219 Jun 02 19:03:24.513176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 128/254] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:24.537811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-de3ddff2-18d9-4a3b-8dd3-24b0a89dfe1b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:24.538589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-de3ddff2-18d9-4a3b-8dd3-24b0a89dfe1b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:24.547749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de3ddff2-18d9-4a3b-8dd3-24b0a89dfe1b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:24.548596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de3ddff2-18d9-4a3b-8dd3-24b0a89dfe1b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:24.549621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de3ddff2-18d9-4a3b-8dd3-24b0a89dfe1b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:24.550283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de3ddff2-18d9-4a3b-8dd3-24b0a89dfe1b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:24.733378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-de3ddff2-18d9-4a3b-8dd3-24b0a89dfe1b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:24.740502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-de3ddff2-18d9-4a3b-8dd3-24b0a89dfe1b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.207937 Jun 02 19:03:24.741084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 127/255] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:24.963795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b6169cbd-6e57-42c7-940b-b19b1498cac3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:24.964668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b6169cbd-6e57-42c7-940b-b19b1498cac3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:24.974879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6169cbd-6e57-42c7-940b-b19b1498cac3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:24.975621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6169cbd-6e57-42c7-940b-b19b1498cac3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:24.977243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6169cbd-6e57-42c7-940b-b19b1498cac3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:24.978067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6169cbd-6e57-42c7-940b-b19b1498cac3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:25.195836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b6169cbd-6e57-42c7-940b-b19b1498cac3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:25.204834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b6169cbd-6e57-42c7-940b-b19b1498cac3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.246259 Jun 02 19:03:25.205285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 129/256] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:24 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:25.339309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c9dceb1d-1313-47f8-a3a0-025c8f43f0cb tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:25.340081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c9dceb1d-1313-47f8-a3a0-025c8f43f0cb tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:25.341888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:25.348752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c9dceb1d-1313-47f8-a3a0-025c8f43f0cb tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:25.349533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c9dceb1d-1313-47f8-a3a0-025c8f43f0cb tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:25.355717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c9dceb1d-1313-47f8-a3a0-025c8f43f0cb tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:25.356215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c9dceb1d-1313-47f8-a3a0-025c8f43f0cb tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:25.536871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:25.537928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:25.552564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:25.556367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:25.557988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:25.561344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:25.588951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c9dceb1d-1313-47f8-a3a0-025c8f43f0cb tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:25.610047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c9dceb1d-1313-47f8-a3a0-025c8f43f0cb tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.263747 Jun 02 19:03:25.610921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 128/257] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:25 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:25.759242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6136db52-20c9-4554-8e1b-811926de8b3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:25.760039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6136db52-20c9-4554-8e1b-811926de8b3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:25.771451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6136db52-20c9-4554-8e1b-811926de8b3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:25.772047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6136db52-20c9-4554-8e1b-811926de8b3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:25.773086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6136db52-20c9-4554-8e1b-811926de8b3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:25.773784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6136db52-20c9-4554-8e1b-811926de8b3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:25.804673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:25.847347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:25.851200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:25.854050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-54d1e4fa-511e-451e-962e-d335b0f3cd81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.322000 Jun 02 19:03:25.865948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 130/258] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:25.937335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6136db52-20c9-4554-8e1b-811926de8b3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:25.945349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6136db52-20c9-4554-8e1b-811926de8b3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.190777 Jun 02 19:03:25.945954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 129/259] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:26.224434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9e19a725-9cef-4b3b-b856-3e229d435f61 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:26.226086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9e19a725-9cef-4b3b-b856-3e229d435f61 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:26.234751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e19a725-9cef-4b3b-b856-3e229d435f61 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:26.237989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e19a725-9cef-4b3b-b856-3e229d435f61 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:26.239019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e19a725-9cef-4b3b-b856-3e229d435f61 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:26.239468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e19a725-9cef-4b3b-b856-3e229d435f61 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:26.264246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:26.397285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9e19a725-9cef-4b3b-b856-3e229d435f61 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:26.405205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9e19a725-9cef-4b3b-b856-3e229d435f61 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.186288 Jun 02 19:03:26.405775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 131/260] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:26 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:26.628213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f402fd06-7d5b-42c7-bc2d-44d4fe289409 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:26.628836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f402fd06-7d5b-42c7-bc2d-44d4fe289409 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:26.636532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f402fd06-7d5b-42c7-bc2d-44d4fe289409 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:26.637282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f402fd06-7d5b-42c7-bc2d-44d4fe289409 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:26.638603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f402fd06-7d5b-42c7-bc2d-44d4fe289409 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:26.639281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f402fd06-7d5b-42c7-bc2d-44d4fe289409 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:26.880626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:26.882060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:26.887380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f402fd06-7d5b-42c7-bc2d-44d4fe289409 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:26.893196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:26.894506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:26.896272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:26.897543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:26.904438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f402fd06-7d5b-42c7-bc2d-44d4fe289409 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.280541 Jun 02 19:03:26.907149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 130/261] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:26 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:26.966770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-282ca624-3455-4208-87f6-d4f1098eef27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:26.967895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-282ca624-3455-4208-87f6-d4f1098eef27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:26.979609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=8 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:26.986464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-282ca624-3455-4208-87f6-d4f1098eef27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:26.987396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-282ca624-3455-4208-87f6-d4f1098eef27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:26.988793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-282ca624-3455-4208-87f6-d4f1098eef27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:26.989620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-282ca624-3455-4208-87f6-d4f1098eef27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:27.310859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:27.324410 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:27.326551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:27.329980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-282ca624-3455-4208-87f6-d4f1098eef27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:27.338960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-282ca624-3455-4208-87f6-d4f1098eef27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.379004 Jun 02 19:03:27.340510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e76f4eed-d034-421a-89aa-344a6ff2abf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.468541 Jun 02 19:03:27.341748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 131/262] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:27.342495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 132/263] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:27.428205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dd58a1ff-07b4-47ad-b550-a831f901b377 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:27.429396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dd58a1ff-07b4-47ad-b550-a831f901b377 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:27.438327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd58a1ff-07b4-47ad-b550-a831f901b377 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:27.439000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd58a1ff-07b4-47ad-b550-a831f901b377 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:27.440040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd58a1ff-07b4-47ad-b550-a831f901b377 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:27.440841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd58a1ff-07b4-47ad-b550-a831f901b377 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:27.702260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dd58a1ff-07b4-47ad-b550-a831f901b377 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:27.715919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dd58a1ff-07b4-47ad-b550-a831f901b377 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.295794 Jun 02 19:03:27.717607 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 132/264] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:27 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:27.923996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7593e79d-acf8-4a4d-a3bd-ae037fe1eb66 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:27.924797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7593e79d-acf8-4a4d-a3bd-ae037fe1eb66 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:27.932486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7593e79d-acf8-4a4d-a3bd-ae037fe1eb66 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:27.933062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7593e79d-acf8-4a4d-a3bd-ae037fe1eb66 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:27.934067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7593e79d-acf8-4a4d-a3bd-ae037fe1eb66 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:27.934502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7593e79d-acf8-4a4d-a3bd-ae037fe1eb66 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:27.937625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:28.107453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7593e79d-acf8-4a4d-a3bd-ae037fe1eb66 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:28.116869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7593e79d-acf8-4a4d-a3bd-ae037fe1eb66 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.196622 Jun 02 19:03:28.127345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 133/265] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:27 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:28.382243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:28.382961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:28.393636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-22e7eada-b92b-47b8-82d9-f228c4579366 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:28.393636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-22e7eada-b92b-47b8-82d9-f228c4579366 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:28.400033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22e7eada-b92b-47b8-82d9-f228c4579366 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:28.400273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:28.400493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22e7eada-b92b-47b8-82d9-f228c4579366 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:28.400702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:28.401279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22e7eada-b92b-47b8-82d9-f228c4579366 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:28.401456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:28.401727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22e7eada-b92b-47b8-82d9-f228c4579366 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:28.412929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:28.662275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:28.667053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-22e7eada-b92b-47b8-82d9-f228c4579366 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:28.677090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:28.677357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-22e7eada-b92b-47b8-82d9-f228c4579366 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.305229 Jun 02 19:03:28.678827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 134/266] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:28.679943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:28.681182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0d57fe73-4de8-4a70-814c-526544ea3676 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.310656 Jun 02 19:03:28.681699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 133/267] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:28.743625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-12840e98-ca1a-4e6b-a4d2-d63695d3e500 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:28.744147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-12840e98-ca1a-4e6b-a4d2-d63695d3e500 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:28.750358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12840e98-ca1a-4e6b-a4d2-d63695d3e500 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:28.750814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12840e98-ca1a-4e6b-a4d2-d63695d3e500 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:28.751595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12840e98-ca1a-4e6b-a4d2-d63695d3e500 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:28.752028 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12840e98-ca1a-4e6b-a4d2-d63695d3e500 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:28.986031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-12840e98-ca1a-4e6b-a4d2-d63695d3e500 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:28.994856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-12840e98-ca1a-4e6b-a4d2-d63695d3e500 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.255172 Jun 02 19:03:28.995320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 135/268] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:28 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:29.141106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-32b2a4af-b060-4396-8d3a-f6197b459613 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:29.142413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-32b2a4af-b060-4396-8d3a-f6197b459613 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:29.154775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-32b2a4af-b060-4396-8d3a-f6197b459613 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:29.155549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-32b2a4af-b060-4396-8d3a-f6197b459613 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:29.156858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-32b2a4af-b060-4396-8d3a-f6197b459613 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:29.157634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-32b2a4af-b060-4396-8d3a-f6197b459613 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:29.347706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-32b2a4af-b060-4396-8d3a-f6197b459613 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:29.356589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-32b2a4af-b060-4396-8d3a-f6197b459613 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.224923 Jun 02 19:03:29.358115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 134/269] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:29 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:29.696346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-04f92f48-6948-414c-86f7-422096c324a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:29.697146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-04f92f48-6948-414c-86f7-422096c324a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:29.702370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:29.703100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:29.705856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04f92f48-6948-414c-86f7-422096c324a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:29.706870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04f92f48-6948-414c-86f7-422096c324a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:29.707852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04f92f48-6948-414c-86f7-422096c324a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:29.708857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04f92f48-6948-414c-86f7-422096c324a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:29.711229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:29.711788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:29.712777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:29.713742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:29.731370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.926968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-04f92f48-6948-414c-86f7-422096c324a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:29.930476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:29.939419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:29.940950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:29.941585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-04f92f48-6948-414c-86f7-422096c324a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.250318 Jun 02 19:03:29.942211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 136/270] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:29.942330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bb3aacfa-110e-459c-bd2b-37bc185f4919 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.246097 Jun 02 19:03:29.942986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 135/271] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:30.013262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5746155b-cf26-4d95-b673-2a0ed2ba61b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:30.013885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5746155b-cf26-4d95-b673-2a0ed2ba61b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:30.021634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5746155b-cf26-4d95-b673-2a0ed2ba61b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:30.022132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5746155b-cf26-4d95-b673-2a0ed2ba61b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:30.022894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5746155b-cf26-4d95-b673-2a0ed2ba61b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:30.023477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5746155b-cf26-4d95-b673-2a0ed2ba61b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:30.174697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5746155b-cf26-4d95-b673-2a0ed2ba61b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:30.183300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5746155b-cf26-4d95-b673-2a0ed2ba61b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.173859 Jun 02 19:03:30.183933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 137/272] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:30 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:30.374474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e971706c-bb8b-4dd2-9a15-0ad1de9ee952 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:30.375035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e971706c-bb8b-4dd2-9a15-0ad1de9ee952 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:30.381355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e971706c-bb8b-4dd2-9a15-0ad1de9ee952 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:30.381835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e971706c-bb8b-4dd2-9a15-0ad1de9ee952 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:30.382759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e971706c-bb8b-4dd2-9a15-0ad1de9ee952 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:30.383182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e971706c-bb8b-4dd2-9a15-0ad1de9ee952 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:30.531052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e971706c-bb8b-4dd2-9a15-0ad1de9ee952 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:30.540740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e971706c-bb8b-4dd2-9a15-0ad1de9ee952 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.170093 Jun 02 19:03:30.540740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 136/273] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:30 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:30.965437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-58721a18-e147-4e17-9a8c-66fe15400eaa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:30.968333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-58721a18-e147-4e17-9a8c-66fe15400eaa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:30.968936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:30.970816 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:30.982765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58721a18-e147-4e17-9a8c-66fe15400eaa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:30.983517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58721a18-e147-4e17-9a8c-66fe15400eaa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:30.985021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58721a18-e147-4e17-9a8c-66fe15400eaa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:30.986138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58721a18-e147-4e17-9a8c-66fe15400eaa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:30.988417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:30.989145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:30.990488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:30.991436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:31.214748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-58721a18-e147-4e17-9a8c-66fe15400eaa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:31.218299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:31.222727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-58721a18-e147-4e17-9a8c-66fe15400eaa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.267684 Jun 02 19:03:31.223342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 138/274] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:31.228142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e9879cc8-a5e8-4933-bbd1-05f7a3725f26 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:31.228747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e9879cc8-a5e8-4933-bbd1-05f7a3725f26 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:31.231693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:31.233029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:31.234235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-46e699fc-2934-4e2f-82d7-e8950dee9cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.274626 Jun 02 19:03:31.234946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9879cc8-a5e8-4933-bbd1-05f7a3725f26 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:31.235082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 137/275] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:31.235478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9879cc8-a5e8-4933-bbd1-05f7a3725f26 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:31.236331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9879cc8-a5e8-4933-bbd1-05f7a3725f26 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:31.236785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9879cc8-a5e8-4933-bbd1-05f7a3725f26 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:31.372784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e9879cc8-a5e8-4933-bbd1-05f7a3725f26 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:31.380548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e9879cc8-a5e8-4933-bbd1-05f7a3725f26 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.156151 Jun 02 19:03:31.381123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 139/276] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:31 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:31.562184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5b21cd1e-fd8c-4799-a339-08523acee14c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:31.562833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5b21cd1e-fd8c-4799-a339-08523acee14c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:31.569278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1e-fd8c-4799-a339-08523acee14c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:31.569754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1e-fd8c-4799-a339-08523acee14c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:31.570786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1e-fd8c-4799-a339-08523acee14c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:31.571052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1e-fd8c-4799-a339-08523acee14c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:31.712973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5b21cd1e-fd8c-4799-a339-08523acee14c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:31.720825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5b21cd1e-fd8c-4799-a339-08523acee14c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.162691 Jun 02 19:03:31.721398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 138/277] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:31 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:32.241712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-89a3c126-e95a-4d75-b43b-7c5c749396d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:32.242451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-89a3c126-e95a-4d75-b43b-7c5c749396d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:32.251422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89a3c126-e95a-4d75-b43b-7c5c749396d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:32.251850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89a3c126-e95a-4d75-b43b-7c5c749396d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:32.252829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89a3c126-e95a-4d75-b43b-7c5c749396d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:32.253261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89a3c126-e95a-4d75-b43b-7c5c749396d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:32.253387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:32.254014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:32.263266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:32.264556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:32.265533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:32.266041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:32.838401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-89a3c126-e95a-4d75-b43b-7c5c749396d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:32.847450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-89a3c126-e95a-4d75-b43b-7c5c749396d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.610129 Jun 02 19:03:32.848315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 140/278] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:32.853231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-12f9fe9c-82b9-495a-b9ca-d6e2286f0dff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:32.857576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-12f9fe9c-82b9-495a-b9ca-d6e2286f0dff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:32.862168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12f9fe9c-82b9-495a-b9ca-d6e2286f0dff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:32.863338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12f9fe9c-82b9-495a-b9ca-d6e2286f0dff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:32.875504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12f9fe9c-82b9-495a-b9ca-d6e2286f0dff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:32.876963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12f9fe9c-82b9-495a-b9ca-d6e2286f0dff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:32.894979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:32.905758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:32.907721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:32.909764 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1e042fef-bfe8-44e5-836c-0eec2ddb4770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1723 microversion: 2.20 time: 0.660661 Jun 02 19:03:32.910908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 139/279] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1723 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:32.921083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b0610608-ac55-45d1-9a72-31038fa4a23c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:32.922583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b0610608-ac55-45d1-9a72-31038fa4a23c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:32.929342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0610608-ac55-45d1-9a72-31038fa4a23c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:32.931058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0610608-ac55-45d1-9a72-31038fa4a23c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:32.932317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0610608-ac55-45d1-9a72-31038fa4a23c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:32.932951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0610608-ac55-45d1-9a72-31038fa4a23c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:33.191818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-12f9fe9c-82b9-495a-b9ca-d6e2286f0dff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:33.206828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-12f9fe9c-82b9-495a-b9ca-d6e2286f0dff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.357701 Jun 02 19:03:33.222643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 141/280] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:32 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:33.227930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0610608-ac55-45d1-9a72-31038fa4a23c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:33.236381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b0610608-ac55-45d1-9a72-31038fa4a23c tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1504 microversion: 2.1 time: 0.324210 Jun 02 19:03:33.254214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 140/281] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:32 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:33.267842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-87a102fa-83bc-49ef-b87d-24c5bd286c0f req-27266d0e-57ce-4ca4-8db3-27adb829a5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721b511d-9547-41f5-a72c-47179f69b6af", "tag": "dcfd3ee8-9442-4031-bf79-1d94f38ef91a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:33.296878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-87a102fa-83bc-49ef-b87d-24c5bd286c0f req-27266d0e-57ce-4ca4-8db3-27adb829a5c7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:33.298597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-87a102fa-83bc-49ef-b87d-24c5bd286c0f req-27266d0e-57ce-4ca4-8db3-27adb829a5c7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:33.332352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-87a102fa-83bc-49ef-b87d-24c5bd286c0f req-27266d0e-57ce-4ca4-8db3-27adb829a5c7 service nova] Creating event network-changed:dcfd3ee8-9442-4031-bf79-1d94f38ef91a for instance 721b511d-9547-41f5-a72c-47179f69b6af on hv-cinder-79760 Jun 02 19:03:33.356768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-87a102fa-83bc-49ef-b87d-24c5bd286c0f req-27266d0e-57ce-4ca4-8db3-27adb829a5c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093014 Jun 02 19:03:33.361367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 142/282] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:33.870373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9d3de854-c6cd-4ae3-a2cd-096dd967b62c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:33.872599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9d3de854-c6cd-4ae3-a2cd-096dd967b62c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:33.885940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d3de854-c6cd-4ae3-a2cd-096dd967b62c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:33.886501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d3de854-c6cd-4ae3-a2cd-096dd967b62c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:33.887366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d3de854-c6cd-4ae3-a2cd-096dd967b62c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:33.887822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d3de854-c6cd-4ae3-a2cd-096dd967b62c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:33.932756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:33.933756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:33.945214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:33.945977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:33.947568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:33.948510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:34.115574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9d3de854-c6cd-4ae3-a2cd-096dd967b62c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:34.123861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9d3de854-c6cd-4ae3-a2cd-096dd967b62c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.262954 Jun 02 19:03:34.124445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 141/283] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:34.153429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:34.165631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:34.167576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:34.169006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-22a4ce63-3cf5-4e4e-9142-d5c03c2fdc28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1744 microversion: 2.20 time: 0.243848 Jun 02 19:03:34.182011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 143/284] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1744 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:34.233420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bca55ac7-23fa-4cff-9cf5-b7fd2ea62b0a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:34.234527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bca55ac7-23fa-4cff-9cf5-b7fd2ea62b0a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:34.245161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca55ac7-23fa-4cff-9cf5-b7fd2ea62b0a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:34.246057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca55ac7-23fa-4cff-9cf5-b7fd2ea62b0a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:34.247170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca55ac7-23fa-4cff-9cf5-b7fd2ea62b0a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:34.248712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca55ac7-23fa-4cff-9cf5-b7fd2ea62b0a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:34.257555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-007ff3b0-c81c-4610-9f19-068dd4113ff3 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:34.259184 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-007ff3b0-c81c-4610-9f19-068dd4113ff3 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:34.269369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-007ff3b0-c81c-4610-9f19-068dd4113ff3 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:34.270148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-007ff3b0-c81c-4610-9f19-068dd4113ff3 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:34.270623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-007ff3b0-c81c-4610-9f19-068dd4113ff3 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:34.271059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-007ff3b0-c81c-4610-9f19-068dd4113ff3 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:34.420181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-007ff3b0-c81c-4610-9f19-068dd4113ff3 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:34.429272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-007ff3b0-c81c-4610-9f19-068dd4113ff3 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1462 microversion: 2.1 time: 0.176307 Jun 02 19:03:34.430294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 144/285] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:34 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1462 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:34.436175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3cdfa78d-7133-417e-8f16-97971e8f23b0 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: .version_select at 0x7f5b788be0d0>, body: {"keypair": {"name": "tempest-keypair-1914833208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr3lY1uGWya5o+opuhI3LlWSAC4RwOcgHyrNk/NIJVxmhNgLFY4EqgdL3MlV6nmVuTcR8ls+kwn5W+ymPmOcAvm5QyEnsc+EmysBnQ8+Ri6/QQ/dybjg/WMshPEFRXTPQ=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:34.454835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-3cdfa78d-7133-417e-8f16-97971e8f23b0 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for project 5a66e7666ca24a079738eea09c470cdd. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:03:34.459999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-3cdfa78d-7133-417e-8f16-97971e8f23b0 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for user 4a660a47927140d6b4d0543de5e281a1 and project 5a66e7666ca24a079738eea09c470cdd. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:03:34.485453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3cdfa78d-7133-417e-8f16-97971e8f23b0 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053595 Jun 02 19:03:34.486094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 145/286] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:03:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:34.495490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-a6d1e2af-c5b6-4864-ad33-926a58b3c0bd req-695daa72-a550-4671-8d03-d64bf3626d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e", "name": "network-vif-deleted", "tag": "8d876c1b-9971-41b0-a027-91e28ed2b52a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:34.505744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-a6d1e2af-c5b6-4864-ad33-926a58b3c0bd req-695daa72-a550-4671-8d03-d64bf3626d6e service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:34.506507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-a6d1e2af-c5b6-4864-ad33-926a58b3c0bd req-695daa72-a550-4671-8d03-d64bf3626d6e service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:34.534710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bca55ac7-23fa-4cff-9cf5-b7fd2ea62b0a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:34.537368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-a6d1e2af-c5b6-4864-ad33-926a58b3c0bd req-695daa72-a550-4671-8d03-d64bf3626d6e service nova] Creating event network-vif-deleted:8d876c1b-9971-41b0-a027-91e28ed2b52a for instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e on hv-cinder-79760 Jun 02 19:03:34.542762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bca55ac7-23fa-4cff-9cf5-b7fd2ea62b0a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.316042 Jun 02 19:03:34.544360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-a6d1e2af-c5b6-4864-ad33-926a58b3c0bd req-695daa72-a550-4671-8d03-d64bf3626d6e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056893 Jun 02 19:03:34.545386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 146/287] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:34.547165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 142/288] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:34 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:35.141500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c182d74a-d75a-4333-9883-c5f621167297 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:35.142245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c182d74a-d75a-4333-9883-c5f621167297 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:35.148976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c182d74a-d75a-4333-9883-c5f621167297 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:35.149418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c182d74a-d75a-4333-9883-c5f621167297 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:35.150197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c182d74a-d75a-4333-9883-c5f621167297 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:35.151241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c182d74a-d75a-4333-9883-c5f621167297 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:35.188211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:35.188887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:35.195882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:35.196354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:35.197115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:35.197559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:35.519403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c182d74a-d75a-4333-9883-c5f621167297 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:35.529990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c182d74a-d75a-4333-9883-c5f621167297 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.392155 Jun 02 19:03:35.539454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 147/289] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:35.545013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-06127f64-91bf-4081-8500-3df26908212f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:35.545896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-06127f64-91bf-4081-8500-3df26908212f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:35.548616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:35.552684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06127f64-91bf-4081-8500-3df26908212f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:35.553494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06127f64-91bf-4081-8500-3df26908212f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:35.554419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06127f64-91bf-4081-8500-3df26908212f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:35.555190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06127f64-91bf-4081-8500-3df26908212f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:35.561380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:35.565239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:35.566720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a6c537c4-dd96-4d61-92a9-41327244e40a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1744 microversion: 2.20 time: 0.382300 Jun 02 19:03:35.567204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 143/290] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1744 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:35.572904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-25b24fef-d2c1-444c-ae07-fefb0f5f5c5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:35.573677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-25b24fef-d2c1-444c-ae07-fefb0f5f5c5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:35.590368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25b24fef-d2c1-444c-ae07-fefb0f5f5c5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:35.591175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25b24fef-d2c1-444c-ae07-fefb0f5f5c5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:35.592161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25b24fef-d2c1-444c-ae07-fefb0f5f5c5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:35.592816 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25b24fef-d2c1-444c-ae07-fefb0f5f5c5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:35.660960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06127f64-91bf-4081-8500-3df26908212f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:35.669380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-06127f64-91bf-4081-8500-3df26908212f tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1462 microversion: 2.1 time: 0.128296 Jun 02 19:03:35.669989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 148/291] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:35 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1462 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:35.840104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-25b24fef-d2c1-444c-ae07-fefb0f5f5c5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:35.848146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-25b24fef-d2c1-444c-ae07-fefb0f5f5c5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.279694 Jun 02 19:03:35.848717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 144/292] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:35 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:36.385949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1168235972", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60bdcf03-2f93-4152-823f-c85a0a62a5ae"}], "security_groups": [{"name": "tempest-securitygroup--579868302"}], "key_name": "tempest-keypair-1914833208", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:36.506711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] validate_networks() for [('60bdcf03-2f93-4152-823f-c85a0a62a5ae', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:03:36.547009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47d4b608-68dc-485c-a3db-d5a916036e06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:36.547611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47d4b608-68dc-485c-a3db-d5a916036e06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:36.557204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d4b608-68dc-485c-a3db-d5a916036e06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:36.557636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d4b608-68dc-485c-a3db-d5a916036e06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:36.558475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d4b608-68dc-485c-a3db-d5a916036e06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:36.558902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47d4b608-68dc-485c-a3db-d5a916036e06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:36.778063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47d4b608-68dc-485c-a3db-d5a916036e06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:36.786579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47d4b608-68dc-485c-a3db-d5a916036e06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.244343 Jun 02 19:03:36.788300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 145/293] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:36.794641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:36.795457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:36.801753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:36.802237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:36.803000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:36.803432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:37.032718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:37.042630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:37.044137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:37.045744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-35603d82-61d7-4860-8928-c7db7b78b45c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1744 microversion: 2.20 time: 0.255804 Jun 02 19:03:37.046341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 146/294] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1744 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:37.051413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1715a750-b9b7-4b2d-9274-a5dd85919c02 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:37.052405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1715a750-b9b7-4b2d-9274-a5dd85919c02 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:37.059995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1715a750-b9b7-4b2d-9274-a5dd85919c02 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:37.060442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1715a750-b9b7-4b2d-9274-a5dd85919c02 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:37.061244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1715a750-b9b7-4b2d-9274-a5dd85919c02 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:37.061688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1715a750-b9b7-4b2d-9274-a5dd85919c02 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:37.087204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:03:37.088367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:03:37.088920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:03:37.089382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:03:37.089880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:03:37.099980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:37.100551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:37.101811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:37.102672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:37.121783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for project 5a66e7666ca24a079738eea09c470cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:03:37.126355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for user 4a660a47927140d6b4d0543de5e281a1 and project 5a66e7666ca24a079738eea09c470cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:03:37.141079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:03:37.143852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:03:37.145169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1715a750-b9b7-4b2d-9274-a5dd85919c02 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:37.154283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1715a750-b9b7-4b2d-9274-a5dd85919c02 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1462 microversion: 2.1 time: 0.106443 Jun 02 19:03:37.154892 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 147/295] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:37 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:37.169492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-62af9a8b-44d3-47ea-907c-ec5f89c83080 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:37.170142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-62af9a8b-44d3-47ea-907c-ec5f89c83080 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:37.176600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62af9a8b-44d3-47ea-907c-ec5f89c83080 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:37.177313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62af9a8b-44d3-47ea-907c-ec5f89c83080 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:37.178143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62af9a8b-44d3-47ea-907c-ec5f89c83080 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:37.178572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62af9a8b-44d3-47ea-907c-ec5f89c83080 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:37.204724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5a7487df-7f2b-46e2-86eb-5b6d22d3b4ab tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.824321 Jun 02 19:03:37.205742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 149/296] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:03:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:03:37.218026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9f0e8481-bc51-45b1-aa10-b81f3c79d672 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:37.218846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9f0e8481-bc51-45b1-aa10-b81f3c79d672 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:37.360982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9f0e8481-bc51-45b1-aa10-b81f3c79d672 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:37.370660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9f0e8481-bc51-45b1-aa10-b81f3c79d672 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1242 microversion: 2.1 time: 0.157187 Jun 02 19:03:37.371917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 150/297] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:37 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1242 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:37.404208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-62af9a8b-44d3-47ea-907c-ec5f89c83080 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:37.412820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-62af9a8b-44d3-47ea-907c-ec5f89c83080 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.247476 Jun 02 19:03:37.414099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 148/298] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:37 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:37.816307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f08cc28c-2f17-46e4-92db-60cff4bb571b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:37.817331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f08cc28c-2f17-46e4-92db-60cff4bb571b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:37.828834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f08cc28c-2f17-46e4-92db-60cff4bb571b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:37.829552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f08cc28c-2f17-46e4-92db-60cff4bb571b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:37.832131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f08cc28c-2f17-46e4-92db-60cff4bb571b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:37.833068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f08cc28c-2f17-46e4-92db-60cff4bb571b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.048058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f08cc28c-2f17-46e4-92db-60cff4bb571b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:38.057456 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f08cc28c-2f17-46e4-92db-60cff4bb571b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.255943 Jun 02 19:03:38.063686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 151/299] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:38.067218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:38.067959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:38.087338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.088131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.088987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.089426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.171350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:38.172027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:38.178583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.179128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.179933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.180647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.228576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.229184 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.229733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lazy-loading 'fault' on Instance uuid 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:03:38.244273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:38.252241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:38.253786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:38.255107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-99659baa-4e4f-4e74-ae9d-fb9a5bc3a322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1744 microversion: 2.20 time: 0.194654 Jun 02 19:03:38.255699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 149/300] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:38.273274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de00142413f4f57b4782279bc826f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f56ecf8c55d4db69eaa62e872d9f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:38.281362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-da965fe7-8b23-4799-b108-9f3070f6aab4 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 200 len: 1303 microversion: 2.1 time: 0.113888 Jun 02 19:03:38.281969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 152/301] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:38 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:38.390857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3a407c99-e83f-45d8-ac3e-e0fefa70b424 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:38.391565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a407c99-e83f-45d8-ac3e-e0fefa70b424 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:38.398909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a407c99-e83f-45d8-ac3e-e0fefa70b424 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.399518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a407c99-e83f-45d8-ac3e-e0fefa70b424 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.400624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a407c99-e83f-45d8-ac3e-e0fefa70b424 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.401150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a407c99-e83f-45d8-ac3e-e0fefa70b424 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.431364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-67d11958-5321-4638-bcac-8806ab081a9e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:38.431944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-67d11958-5321-4638-bcac-8806ab081a9e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:38.438325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67d11958-5321-4638-bcac-8806ab081a9e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.438785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67d11958-5321-4638-bcac-8806ab081a9e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.439560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67d11958-5321-4638-bcac-8806ab081a9e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:38.440023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67d11958-5321-4638-bcac-8806ab081a9e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:38.456944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:38.498949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a407c99-e83f-45d8-ac3e-e0fefa70b424 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:38.510558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3a407c99-e83f-45d8-ac3e-e0fefa70b424 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1294 microversion: 2.1 time: 0.124828 Jun 02 19:03:38.511126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 150/302] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:38 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:38.594889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67d11958-5321-4638-bcac-8806ab081a9e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:38.604217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-67d11958-5321-4638-bcac-8806ab081a9e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.177026 Jun 02 19:03:38.604729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 153/303] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:38 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:39.080724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47c4bfaa-c209-4f3d-abbd-0961652fa53d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:39.081304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47c4bfaa-c209-4f3d-abbd-0961652fa53d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:39.089193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47c4bfaa-c209-4f3d-abbd-0961652fa53d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.089644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47c4bfaa-c209-4f3d-abbd-0961652fa53d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.090471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47c4bfaa-c209-4f3d-abbd-0961652fa53d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.090909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47c4bfaa-c209-4f3d-abbd-0961652fa53d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.276486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:39.278943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:39.285354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:39.295924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.304279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.305595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47c4bfaa-c209-4f3d-abbd-0961652fa53d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:39.305947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.309747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.315760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47c4bfaa-c209-4f3d-abbd-0961652fa53d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.238788 Jun 02 19:03:39.317693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 151/304] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:39.322733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:39.323645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] [instance: 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:39.349072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.354490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.355650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.356306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.361591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:39.399216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] HTTP exception thrown: Instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e could not be found. Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Request method failure captured: Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e HTTP/1.1 Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQlFLQaVQqY39k5dlTo_t9lahJyyAP2Ee_p1WLP4Kri1UkOUaPnmoaiPamKABRO5R0WXRJSemrkvPEZCWBfHw_2wI6cDjjZx9dM9IsnXPuN9-4Zx29JLvXi5MibXH15Im_kIbFO0Rs0K4cq6cKYyK40Od2B-flUSMB3kEFvIJauMdG4 Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 9f56ecf8c55d4db69eaa62e872d9f169 Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesActionsTest-1650200502 Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:03:39.400920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f56ecf8c55d4db69eaa62e872d9f169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f56ecf8c55d4db69eaa62e872d9f169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f56ecf8c55d4db69eaa62e872d9f169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f56ecf8c55d4db69eaa62e872d9f169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesActionsTest-1650200502 Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 9f56ecf8c55d4db69eaa62e872d9f169 Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesActionsTest-1650200502 Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesActionsTest-1650200502-project Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 7de00142413f4f57b4782279bc826f4f Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesActionsTest-1650200502-project Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e could not be found. Jun 02 19:03:39.402208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e'} Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e could not be found. Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:03:39.402959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e could not be found. Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e could not be found. Jun 02 19:03:39.404507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:03:39.405691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] Returning 404 to user: Instance 4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:03:39.405691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d5a61052-d56a-4c9b-b410-44024f15fac0 tempest-VolumesActionsTest-1650200502 tempest-VolumesActionsTest-1650200502-project] 10.222.0.15 "GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e" status: 404 len: 111 microversion: 2.1 time: 0.083403 Jun 02 19:03:39.412487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 152/305] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:39 2022] GET /compute/v2.1/servers/4224f9c6-9c8a-4acc-9b6f-2c8e87198e7e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:03:39.527952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:39.533528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-956b8349-142b-446e-8d13-52ed4b422422 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:39.535802 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-956b8349-142b-446e-8d13-52ed4b422422 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:39.543000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-956b8349-142b-446e-8d13-52ed4b422422 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.543529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-956b8349-142b-446e-8d13-52ed4b422422 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.544386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-956b8349-142b-446e-8d13-52ed4b422422 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.544709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:39.544964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-956b8349-142b-446e-8d13-52ed4b422422 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.546276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:39.547836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7302010e-2d2d-4535-995c-349dfaf28847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.278190 Jun 02 19:03:39.557535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 154/306] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:39.620888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-956b8349-142b-446e-8d13-52ed4b422422 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:39.625394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7975f235-f1c4-435f-a3cd-2be2e6384669 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:39.627048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7975f235-f1c4-435f-a3cd-2be2e6384669 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:39.628757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-956b8349-142b-446e-8d13-52ed4b422422 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1312 microversion: 2.1 time: 0.104492 Jun 02 19:03:39.639357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 153/307] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:39 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:39.644505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7975f235-f1c4-435f-a3cd-2be2e6384669 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.645688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7975f235-f1c4-435f-a3cd-2be2e6384669 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.647087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7975f235-f1c4-435f-a3cd-2be2e6384669 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:39.647519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7975f235-f1c4-435f-a3cd-2be2e6384669 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:39.916166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7975f235-f1c4-435f-a3cd-2be2e6384669 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:39.950045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7975f235-f1c4-435f-a3cd-2be2e6384669 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.314120 Jun 02 19:03:39.954735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 155/308] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:39 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:40.050662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-c8afd912-7052-46ca-be21-2fb3c50bfad2 req-806d42e8-4d52-4508-8e45-bb15b1cb8666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2f3bad-3acd-4fe8-87bb-29f1424ea788", "name": "network-vif-plugged", "status": "completed", "tag": "907b11e3-1dc7-4e4c-9786-5e63f5dd0812"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:40.071099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-c8afd912-7052-46ca-be21-2fb3c50bfad2 req-806d42e8-4d52-4508-8e45-bb15b1cb8666 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:40.073448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-c8afd912-7052-46ca-be21-2fb3c50bfad2 req-806d42e8-4d52-4508-8e45-bb15b1cb8666 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:40.097704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-c8afd912-7052-46ca-be21-2fb3c50bfad2 req-806d42e8-4d52-4508-8e45-bb15b1cb8666 service nova] Creating event network-vif-plugged:907b11e3-1dc7-4e4c-9786-5e63f5dd0812 for instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 on hv-cinder-79760 Jun 02 19:03:40.105162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-c8afd912-7052-46ca-be21-2fb3c50bfad2 req-806d42e8-4d52-4508-8e45-bb15b1cb8666 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059146 Jun 02 19:03:40.106835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 154/309] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:40.184907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-334062193", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "networks": [{"uuid": "669b9edc-30e0-44b4-9f6c-43848b6da576"}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:40.295622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] validate_networks() for [('669b9edc-30e0-44b4-9f6c-43848b6da576', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:03:40.339726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ffa687a6-c0d2-441d-96ee-90395d30ce41 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:40.340863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ffa687a6-c0d2-441d-96ee-90395d30ce41 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:40.358572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffa687a6-c0d2-441d-96ee-90395d30ce41 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:40.359450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffa687a6-c0d2-441d-96ee-90395d30ce41 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:40.364258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffa687a6-c0d2-441d-96ee-90395d30ce41 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:40.365917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffa687a6-c0d2-441d-96ee-90395d30ce41 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:40.712796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ffa687a6-c0d2-441d-96ee-90395d30ce41 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:40.730935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ffa687a6-c0d2-441d-96ee-90395d30ce41 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.397371 Jun 02 19:03:40.741214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 155/310] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:40.771821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:40.772738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:40.793071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:40.798642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:40.802194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:40.802792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.398481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:41.413382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:41.418392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:41.419622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-98606b92-b783-4388-bafc-cdb30671100a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.676389 Jun 02 19:03:41.422091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 156/311] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:41.436222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-22279986-b44f-4a41-9f41-66a31996d9eb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:41.436842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-22279986-b44f-4a41-9f41-66a31996d9eb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:41.448742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22279986-b44f-4a41-9f41-66a31996d9eb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:41.449956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22279986-b44f-4a41-9f41-66a31996d9eb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.450819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22279986-b44f-4a41-9f41-66a31996d9eb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:41.451615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22279986-b44f-4a41-9f41-66a31996d9eb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.470978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:03:41.472083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:03:41.477042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:03:41.478219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:03:41.479294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:03:41.490445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:41.491267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.492334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:41.492762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.522491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Getting quotas for project 6ad466a7fdbb4ef18dddf54fb200971d. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:03:41.529888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Getting quotas for user 5c5875c5cba841a28560a475bb18d595 and project 6ad466a7fdbb4ef18dddf54fb200971d. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:03:41.556020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:03:41.560557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:03:41.631879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-03ba2de8-834e-45e2-ae7e-0ce03bf1f659 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.451146 Jun 02 19:03:41.632567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 156/312] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:03:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:03:41.640059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-76b64e75-711b-44bf-a613-757e2bdbf5cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:41.641073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-76b64e75-711b-44bf-a613-757e2bdbf5cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:41.645908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-22279986-b44f-4a41-9f41-66a31996d9eb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:41.654705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76b64e75-711b-44bf-a613-757e2bdbf5cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:41.655614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76b64e75-711b-44bf-a613-757e2bdbf5cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.655903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76b64e75-711b-44bf-a613-757e2bdbf5cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:41.656330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76b64e75-711b-44bf-a613-757e2bdbf5cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.659733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-22279986-b44f-4a41-9f41-66a31996d9eb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.236595 Jun 02 19:03:41.673022 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 157/313] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:41 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:41.678386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-752513cf-cd56-45ee-a76e-a9a8ae91546c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:41.679259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-752513cf-cd56-45ee-a76e-a9a8ae91546c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:41.779705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-752513cf-cd56-45ee-a76e-a9a8ae91546c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:41.788123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-752513cf-cd56-45ee-a76e-a9a8ae91546c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1218 microversion: 2.1 time: 0.115780 Jun 02 19:03:41.788934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 158/314] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:41 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:41.795030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1923dcb4-7649-4415-9ecf-335bc4296ad1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:41.796017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1923dcb4-7649-4415-9ecf-335bc4296ad1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:41.807670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1923dcb4-7649-4415-9ecf-335bc4296ad1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:41.808504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1923dcb4-7649-4415-9ecf-335bc4296ad1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.809488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1923dcb4-7649-4415-9ecf-335bc4296ad1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:41.810281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1923dcb4-7649-4415-9ecf-335bc4296ad1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:41.973763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-76b64e75-711b-44bf-a613-757e2bdbf5cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:41.987749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-76b64e75-711b-44bf-a613-757e2bdbf5cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.353143 Jun 02 19:03:41.988890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 157/315] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:41 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:42.060064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1923dcb4-7649-4415-9ecf-335bc4296ad1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:42.068631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1923dcb4-7649-4415-9ecf-335bc4296ad1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.278170 Jun 02 19:03:42.069273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 159/316] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:42.438439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:42.439450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:42.448961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:42.449534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:42.450565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:42.451681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:42.616603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:42.626317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:42.628625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:42.630471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cb1e11f3-a108-460a-84f2-956eb865d34c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.195855 Jun 02 19:03:42.637845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 158/317] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:42.680771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0552bd2f-acf3-41c5-9dff-e3a727511a88 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:42.681640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0552bd2f-acf3-41c5-9dff-e3a727511a88 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:42.688961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0552bd2f-acf3-41c5-9dff-e3a727511a88 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:42.689474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0552bd2f-acf3-41c5-9dff-e3a727511a88 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:42.690381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0552bd2f-acf3-41c5-9dff-e3a727511a88 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:42.691059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0552bd2f-acf3-41c5-9dff-e3a727511a88 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:42.806931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-de144da5-796e-4bfc-92ef-be100f418e4e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:42.807557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-de144da5-796e-4bfc-92ef-be100f418e4e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:42.820065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de144da5-796e-4bfc-92ef-be100f418e4e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:42.821192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de144da5-796e-4bfc-92ef-be100f418e4e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:42.822267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de144da5-796e-4bfc-92ef-be100f418e4e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:42.823390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de144da5-796e-4bfc-92ef-be100f418e4e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:42.917659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0552bd2f-acf3-41c5-9dff-e3a727511a88 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:42.929710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0552bd2f-acf3-41c5-9dff-e3a727511a88 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.251707 Jun 02 19:03:42.930793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 160/318] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:42 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:42.938097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-de144da5-796e-4bfc-92ef-be100f418e4e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:42.948794 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-de144da5-796e-4bfc-92ef-be100f418e4e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1222 microversion: 2.1 time: 0.146496 Jun 02 19:03:42.949687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 159/319] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:42 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:43.006432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a1039eb-496d-4448-ad84-eaed1a2657e2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:43.007325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a1039eb-496d-4448-ad84-eaed1a2657e2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:43.014809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a1039eb-496d-4448-ad84-eaed1a2657e2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:43.015707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a1039eb-496d-4448-ad84-eaed1a2657e2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:43.016671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a1039eb-496d-4448-ad84-eaed1a2657e2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:43.017278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a1039eb-496d-4448-ad84-eaed1a2657e2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:43.090432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-61b05f02-d227-4b3f-89a7-83944d1ab992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:43.092316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-61b05f02-d227-4b3f-89a7-83944d1ab992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:43.106744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61b05f02-d227-4b3f-89a7-83944d1ab992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:43.108768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61b05f02-d227-4b3f-89a7-83944d1ab992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:43.109938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61b05f02-d227-4b3f-89a7-83944d1ab992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:43.112725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61b05f02-d227-4b3f-89a7-83944d1ab992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:43.515059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2a1039eb-496d-4448-ad84-eaed1a2657e2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:43.528961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a1039eb-496d-4448-ad84-eaed1a2657e2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.526639 Jun 02 19:03:43.530238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 161/320] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:43 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:43.569410 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-61b05f02-d227-4b3f-89a7-83944d1ab992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:43.579473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-61b05f02-d227-4b3f-89a7-83944d1ab992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.496294 Jun 02 19:03:43.580840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 160/321] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:43.649554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:43.650215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:43.660838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:43.663953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:43.665111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:43.665727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:43.850383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-567a9b82-b401-40b9-a411-4c0937db6d90 req-52581b8b-9df2-43e1-bcca-c175c28a8904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac72221-56c7-4928-a41f-7bf89b4cab20", "tag": "6ccfd62c-96b8-4126-8fcb-55c08b439177"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:43.894100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-567a9b82-b401-40b9-a411-4c0937db6d90 req-52581b8b-9df2-43e1-bcca-c175c28a8904 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:43.894562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-567a9b82-b401-40b9-a411-4c0937db6d90 req-52581b8b-9df2-43e1-bcca-c175c28a8904 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:43.934374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-567a9b82-b401-40b9-a411-4c0937db6d90 req-52581b8b-9df2-43e1-bcca-c175c28a8904 service nova] Creating event network-changed:6ccfd62c-96b8-4126-8fcb-55c08b439177 for instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 on hv-cinder-79760 Jun 02 19:03:43.958344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-567a9b82-b401-40b9-a411-4c0937db6d90 req-52581b8b-9df2-43e1-bcca-c175c28a8904 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117860 Jun 02 19:03:43.960128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 161/322] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:43.977255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3e6eb54e-1534-484f-a050-385120eb72af tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:43.978634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3e6eb54e-1534-484f-a050-385120eb72af tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:43.990196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e6eb54e-1534-484f-a050-385120eb72af tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.035686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e6eb54e-1534-484f-a050-385120eb72af tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:44.035686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e6eb54e-1534-484f-a050-385120eb72af tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.035686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e6eb54e-1534-484f-a050-385120eb72af tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:44.058569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:44.072280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:44.074533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:44.077136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b95c3645-c3b4-4bad-a39c-b9d078e2393d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.431855 Jun 02 19:03:44.096850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 162/323] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:44.109909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0447b6b7-f5a8-4ff5-9a10-7558584c777d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:44.111588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0447b6b7-f5a8-4ff5-9a10-7558584c777d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:44.124429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0447b6b7-f5a8-4ff5-9a10-7558584c777d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.125576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0447b6b7-f5a8-4ff5-9a10-7558584c777d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:44.126703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0447b6b7-f5a8-4ff5-9a10-7558584c777d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.127377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0447b6b7-f5a8-4ff5-9a10-7558584c777d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:44.251782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3e6eb54e-1534-484f-a050-385120eb72af tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:44.262776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3e6eb54e-1534-484f-a050-385120eb72af tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1270 microversion: 2.1 time: 0.298494 Jun 02 19:03:44.264421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 162/324] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:43 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1270 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:44.406076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0447b6b7-f5a8-4ff5-9a10-7558584c777d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:44.441071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0447b6b7-f5a8-4ff5-9a10-7558584c777d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.342597 Jun 02 19:03:44.441664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 163/325] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:44 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:44.504678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-afb89089-8b45-407a-a435-5f5ce7821af3 req-9c10b985-caae-467f-9c13-3a9420b50b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721b511d-9547-41f5-a72c-47179f69b6af", "name": "network-vif-plugged", "status": "completed", "tag": "dcfd3ee8-9442-4031-bf79-1d94f38ef91a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:44.524698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-afb89089-8b45-407a-a435-5f5ce7821af3 req-9c10b985-caae-467f-9c13-3a9420b50b0c service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.528500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-afb89089-8b45-407a-a435-5f5ce7821af3 req-9c10b985-caae-467f-9c13-3a9420b50b0c service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:44.548634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0572cb7c-6b44-432f-a03e-9478d99d70e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:44.550009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0572cb7c-6b44-432f-a03e-9478d99d70e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:44.554122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-afb89089-8b45-407a-a435-5f5ce7821af3 req-9c10b985-caae-467f-9c13-3a9420b50b0c service nova] Creating event network-vif-plugged:dcfd3ee8-9442-4031-bf79-1d94f38ef91a for instance 721b511d-9547-41f5-a72c-47179f69b6af on hv-cinder-79760 Jun 02 19:03:44.568343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-afb89089-8b45-407a-a435-5f5ce7821af3 req-9c10b985-caae-467f-9c13-3a9420b50b0c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063311 Jun 02 19:03:44.569301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 163/326] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:44.583911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0572cb7c-6b44-432f-a03e-9478d99d70e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.585538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0572cb7c-6b44-432f-a03e-9478d99d70e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:44.586512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0572cb7c-6b44-432f-a03e-9478d99d70e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.592174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0572cb7c-6b44-432f-a03e-9478d99d70e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:44.598007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-449b707d-73f3-452a-9336-f775122a7279 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:44.599034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-449b707d-73f3-452a-9336-f775122a7279 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:44.612339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-449b707d-73f3-452a-9336-f775122a7279 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.614083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-449b707d-73f3-452a-9336-f775122a7279 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:44.616420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-449b707d-73f3-452a-9336-f775122a7279 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:44.618253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-449b707d-73f3-452a-9336-f775122a7279 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:45.066110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0572cb7c-6b44-432f-a03e-9478d99d70e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:45.124871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0572cb7c-6b44-432f-a03e-9478d99d70e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.582059 Jun 02 19:03:45.133701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-449b707d-73f3-452a-9336-f775122a7279 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:45.144480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 164/327] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:44 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:45.179586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:45.182206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-449b707d-73f3-452a-9336-f775122a7279 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.587583 Jun 02 19:03:45.185948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 164/328] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:45.188147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:45.216849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:45.222170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:45.223626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:45.227410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:45.287239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ceacb3b3-e244-4dca-b325-c0d1d23d5efc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:45.291257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ceacb3b3-e244-4dca-b325-c0d1d23d5efc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:45.307061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceacb3b3-e244-4dca-b325-c0d1d23d5efc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:45.307517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceacb3b3-e244-4dca-b325-c0d1d23d5efc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:45.308613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceacb3b3-e244-4dca-b325-c0d1d23d5efc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:45.309158 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceacb3b3-e244-4dca-b325-c0d1d23d5efc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:45.435267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ceacb3b3-e244-4dca-b325-c0d1d23d5efc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:45.448677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ceacb3b3-e244-4dca-b325-c0d1d23d5efc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1276 microversion: 2.1 time: 0.170588 Jun 02 19:03:45.449666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 165/329] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:45 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:45.468220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c16b6fd4-e55c-4310-94ef-f98fb5285ac4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:45.468819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c16b6fd4-e55c-4310-94ef-f98fb5285ac4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:45.486579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c16b6fd4-e55c-4310-94ef-f98fb5285ac4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:45.487124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c16b6fd4-e55c-4310-94ef-f98fb5285ac4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:45.491093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c16b6fd4-e55c-4310-94ef-f98fb5285ac4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:45.491903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c16b6fd4-e55c-4310-94ef-f98fb5285ac4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:45.846284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c16b6fd4-e55c-4310-94ef-f98fb5285ac4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:45.861338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c16b6fd4-e55c-4310-94ef-f98fb5285ac4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.403899 Jun 02 19:03:45.870821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:45.889439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:45.889439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:45.889439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e7b7fb26-cc24-49db-af67-5966b2a3bc36 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.741742 Jun 02 19:03:45.894331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 166/330] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:45 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:45.906825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 165/331] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:46.174103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-10ebbfec-df67-49b6-805d-2df619795905 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:46.175406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-10ebbfec-df67-49b6-805d-2df619795905 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:46.197414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10ebbfec-df67-49b6-805d-2df619795905 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.198235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10ebbfec-df67-49b6-805d-2df619795905 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.199211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10ebbfec-df67-49b6-805d-2df619795905 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.199818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10ebbfec-df67-49b6-805d-2df619795905 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.204414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9e785813-d8b4-432a-9fc8-c34b8eca34aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:46.205659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9e785813-d8b4-432a-9fc8-c34b8eca34aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:46.221602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e785813-d8b4-432a-9fc8-c34b8eca34aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.223284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e785813-d8b4-432a-9fc8-c34b8eca34aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.224725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e785813-d8b4-432a-9fc8-c34b8eca34aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.225373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e785813-d8b4-432a-9fc8-c34b8eca34aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.594646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9e785813-d8b4-432a-9fc8-c34b8eca34aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:46.612936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9e785813-d8b4-432a-9fc8-c34b8eca34aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.411872 Jun 02 19:03:46.618623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-10ebbfec-df67-49b6-805d-2df619795905 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:46.626099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 166/332] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:46.637915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-10ebbfec-df67-49b6-805d-2df619795905 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.467690 Jun 02 19:03:46.642543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fd020d17-3ed4-4603-b100-a82feff7e27f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:46.649940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 167/333] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:46 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:46.653956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fd020d17-3ed4-4603-b100-a82feff7e27f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:46.669474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd020d17-3ed4-4603-b100-a82feff7e27f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.670789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd020d17-3ed4-4603-b100-a82feff7e27f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.671863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd020d17-3ed4-4603-b100-a82feff7e27f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.672679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd020d17-3ed4-4603-b100-a82feff7e27f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.896594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-de96e356-6e91-444b-9fcf-04624cb72954 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:46.897327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fd020d17-3ed4-4603-b100-a82feff7e27f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:46.897506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-de96e356-6e91-444b-9fcf-04624cb72954 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:46.908837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fd020d17-3ed4-4603-b100-a82feff7e27f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.273072 Jun 02 19:03:46.910181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de96e356-6e91-444b-9fcf-04624cb72954 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.910637 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de96e356-6e91-444b-9fcf-04624cb72954 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.910796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 167/334] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:46 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:46.911904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de96e356-6e91-444b-9fcf-04624cb72954 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.912341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de96e356-6e91-444b-9fcf-04624cb72954 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.918255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:46.919373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:46.923836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:46.932631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.935281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:46.936526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:46.937197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:47.237046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-de96e356-6e91-444b-9fcf-04624cb72954 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:47.245176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:47.253392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-de96e356-6e91-444b-9fcf-04624cb72954 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.357889 Jun 02 19:03:47.270105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 168/335] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:46 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:47.270780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:47.274252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:47.276601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b9339e2d-3d82-4f8f-aa7d-b0fc94c7dd2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.363246 Jun 02 19:03:47.278185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 168/336] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:47.661370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d417661f-f8d1-4c45-8eb0-0b159cb66eae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:47.662469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d417661f-f8d1-4c45-8eb0-0b159cb66eae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:47.683603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-20dbf2bc-2ab4-43a1-82df-2d90568ed803 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:47.686896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-20dbf2bc-2ab4-43a1-82df-2d90568ed803 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:47.687750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d417661f-f8d1-4c45-8eb0-0b159cb66eae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:47.687750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d417661f-f8d1-4c45-8eb0-0b159cb66eae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:47.691111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d417661f-f8d1-4c45-8eb0-0b159cb66eae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:47.691111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d417661f-f8d1-4c45-8eb0-0b159cb66eae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:47.715384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20dbf2bc-2ab4-43a1-82df-2d90568ed803 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:47.716267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20dbf2bc-2ab4-43a1-82df-2d90568ed803 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:47.717384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20dbf2bc-2ab4-43a1-82df-2d90568ed803 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:47.722875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20dbf2bc-2ab4-43a1-82df-2d90568ed803 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:48.026930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d417661f-f8d1-4c45-8eb0-0b159cb66eae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:48.037443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d417661f-f8d1-4c45-8eb0-0b159cb66eae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.379940 Jun 02 19:03:48.040165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 169/337] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:47 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:48.052604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dff79f44-d13d-488c-bf6c-4e5d3a43d506 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:48.053587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dff79f44-d13d-488c-bf6c-4e5d3a43d506 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:48.070938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dff79f44-d13d-488c-bf6c-4e5d3a43d506 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:48.071531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dff79f44-d13d-488c-bf6c-4e5d3a43d506 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:48.072481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dff79f44-d13d-488c-bf6c-4e5d3a43d506 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:48.074491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dff79f44-d13d-488c-bf6c-4e5d3a43d506 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:48.085441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-20dbf2bc-2ab4-43a1-82df-2d90568ed803 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:48.095130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-20dbf2bc-2ab4-43a1-82df-2d90568ed803 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.452985 Jun 02 19:03:48.095718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 169/338] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:48.279750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5247ad0f-deff-4f86-91b0-28a29a882319 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:48.281168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5247ad0f-deff-4f86-91b0-28a29a882319 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:48.295597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dff79f44-d13d-488c-bf6c-4e5d3a43d506 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:48.300299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5247ad0f-deff-4f86-91b0-28a29a882319 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:48.301299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5247ad0f-deff-4f86-91b0-28a29a882319 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:48.302575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5247ad0f-deff-4f86-91b0-28a29a882319 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:48.303173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5247ad0f-deff-4f86-91b0-28a29a882319 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:48.309528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dff79f44-d13d-488c-bf6c-4e5d3a43d506 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.266823 Jun 02 19:03:48.334054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 170/339] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:48 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:48.339420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:48.340036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:48.360023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:48.360783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:48.366322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:48.368990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:48.381235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:48.681154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:48.693743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:48.706842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:48.708314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b0677391-4a83-4962-a5ce-d3d942cb544b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.372925 Jun 02 19:03:48.708901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 171/340] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:48.745265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5247ad0f-deff-4f86-91b0-28a29a882319 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:48.759671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5247ad0f-deff-4f86-91b0-28a29a882319 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.479182 Jun 02 19:03:48.772161 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 170/341] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:48 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:49.064733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-118b2c80-b96c-4412-b7a8-a84c8698d3a3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:49.065698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-118b2c80-b96c-4412-b7a8-a84c8698d3a3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:49.077907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-118b2c80-b96c-4412-b7a8-a84c8698d3a3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.079097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-118b2c80-b96c-4412-b7a8-a84c8698d3a3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.081685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-118b2c80-b96c-4412-b7a8-a84c8698d3a3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.082804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-118b2c80-b96c-4412-b7a8-a84c8698d3a3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.126054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-98ca6201-947e-4509-b0ea-2b3cfae3315e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:49.126994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-98ca6201-947e-4509-b0ea-2b3cfae3315e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:49.138513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98ca6201-947e-4509-b0ea-2b3cfae3315e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.139959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98ca6201-947e-4509-b0ea-2b3cfae3315e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.141777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98ca6201-947e-4509-b0ea-2b3cfae3315e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.143618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98ca6201-947e-4509-b0ea-2b3cfae3315e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.477463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-118b2c80-b96c-4412-b7a8-a84c8698d3a3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:49.487821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-118b2c80-b96c-4412-b7a8-a84c8698d3a3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.427475 Jun 02 19:03:49.497411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 172/342] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:49 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:49.503194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a604de0-678e-40bb-aec7-33a4c0d0c4aa tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:49.503957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a604de0-678e-40bb-aec7-33a4c0d0c4aa tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:49.528269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a604de0-678e-40bb-aec7-33a4c0d0c4aa tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.528791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a604de0-678e-40bb-aec7-33a4c0d0c4aa tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.536883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-98ca6201-947e-4509-b0ea-2b3cfae3315e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:49.539732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a604de0-678e-40bb-aec7-33a4c0d0c4aa tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.539986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a604de0-678e-40bb-aec7-33a4c0d0c4aa tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.550005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-98ca6201-947e-4509-b0ea-2b3cfae3315e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1356 microversion: 2.1 time: 0.429843 Jun 02 19:03:49.560076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 171/343] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1356 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:49.730811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:49.730811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:49.752526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.753202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.754445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.755345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.822525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:49.846185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2a604de0-678e-40bb-aec7-33a4c0d0c4aa tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:49.856489 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a604de0-678e-40bb-aec7-33a4c0d0c4aa tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.362060 Jun 02 19:03:49.861202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 173/344] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:49 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:49.870133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dd0fd81e-cf9a-4c0b-b67e-72d26747fe6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:49.870695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dd0fd81e-cf9a-4c0b-b67e-72d26747fe6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:49.887949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd0fd81e-cf9a-4c0b-b67e-72d26747fe6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.888404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd0fd81e-cf9a-4c0b-b67e-72d26747fe6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:49.889191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd0fd81e-cf9a-4c0b-b67e-72d26747fe6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:49.889629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd0fd81e-cf9a-4c0b-b67e-72d26747fe6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:50.308421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dd0fd81e-cf9a-4c0b-b67e-72d26747fe6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:50.321037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dd0fd81e-cf9a-4c0b-b67e-72d26747fe6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.458517 Jun 02 19:03:50.321963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 174/345] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:49 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:50.351997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:50.374750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:50.381815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:50.387736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f0a895b4-7fdc-4d99-9ed6-1d15489eab19 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.663898 Jun 02 19:03:50.394674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-b534c807-309e-4b43-8d93-1cedafe75498 req-9e91dd33-cda8-4a14-b155-bc50ee0fa0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aaab800-95de-43b9-972d-b65ccd2a7ec6", "tag": "a498d4bf-e238-41a8-aeab-abeda8df24c7"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:50.400219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 172/346] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:50.408405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b534c807-309e-4b43-8d93-1cedafe75498 req-9e91dd33-cda8-4a14-b155-bc50ee0fa0c6 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:50.414987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b534c807-309e-4b43-8d93-1cedafe75498 req-9e91dd33-cda8-4a14-b155-bc50ee0fa0c6 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:50.446082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-b534c807-309e-4b43-8d93-1cedafe75498 req-9e91dd33-cda8-4a14-b155-bc50ee0fa0c6 service nova] Creating event network-changed:a498d4bf-e238-41a8-aeab-abeda8df24c7 for instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 on hv-cinder-79760 Jun 02 19:03:50.467608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-b534c807-309e-4b43-8d93-1cedafe75498 req-9e91dd33-cda8-4a14-b155-bc50ee0fa0c6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076622 Jun 02 19:03:50.468529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 175/347] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:03:50.513836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60030ba5-9a4e-495b-a058-dd4da8710ed8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:50.515232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-60030ba5-9a4e-495b-a058-dd4da8710ed8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:50.529683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60030ba5-9a4e-495b-a058-dd4da8710ed8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:50.530164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60030ba5-9a4e-495b-a058-dd4da8710ed8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:50.533212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60030ba5-9a4e-495b-a058-dd4da8710ed8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:50.533670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60030ba5-9a4e-495b-a058-dd4da8710ed8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:50.571579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7ef7e6f0-0cd8-468e-b1cb-61428e167a6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:50.573180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7ef7e6f0-0cd8-468e-b1cb-61428e167a6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:50.604825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ef7e6f0-0cd8-468e-b1cb-61428e167a6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:50.605417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ef7e6f0-0cd8-468e-b1cb-61428e167a6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:50.623330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ef7e6f0-0cd8-468e-b1cb-61428e167a6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:50.635069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ef7e6f0-0cd8-468e-b1cb-61428e167a6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:50.936087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7ef7e6f0-0cd8-468e-b1cb-61428e167a6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:50.940852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-60030ba5-9a4e-495b-a058-dd4da8710ed8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:50.952311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7ef7e6f0-0cd8-468e-b1cb-61428e167a6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1545 microversion: 2.1 time: 0.386948 Jun 02 19:03:50.953526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 176/348] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1545 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:50.958144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-60030ba5-9a4e-495b-a058-dd4da8710ed8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.456402 Jun 02 19:03:50.959673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 173/349] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:50 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:50.965037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-33b3343a-b276-4a90-8175-61e7ea58517f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:50.968771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-33b3343a-b276-4a90-8175-61e7ea58517f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:50.976357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1503f0d1-74e4-4356-9de9-2d1409661213 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:50.977653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1503f0d1-74e4-4356-9de9-2d1409661213 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:50.985388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33b3343a-b276-4a90-8175-61e7ea58517f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:50.985903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33b3343a-b276-4a90-8175-61e7ea58517f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:50.987578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33b3343a-b276-4a90-8175-61e7ea58517f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:50.988746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33b3343a-b276-4a90-8175-61e7ea58517f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:50.996669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1503f0d1-74e4-4356-9de9-2d1409661213 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.010108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1503f0d1-74e4-4356-9de9-2d1409661213 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.011246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1503f0d1-74e4-4356-9de9-2d1409661213 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.011764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1503f0d1-74e4-4356-9de9-2d1409661213 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.363662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-33b3343a-b276-4a90-8175-61e7ea58517f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:51.376269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-33b3343a-b276-4a90-8175-61e7ea58517f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.421510 Jun 02 19:03:51.377249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 177/350] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:50 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:51.384114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c1d647d3-21b3-400e-bfb0-55f820965a81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:51.391856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1503f0d1-74e4-4356-9de9-2d1409661213 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:51.396857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c1d647d3-21b3-400e-bfb0-55f820965a81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:51.404313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1503f0d1-74e4-4356-9de9-2d1409661213 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1545 microversion: 2.1 time: 0.437764 Jun 02 19:03:51.409178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 174/351] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1545 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:51.417554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:51.419303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d647d3-21b3-400e-bfb0-55f820965a81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.420000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d647d3-21b3-400e-bfb0-55f820965a81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.421176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d647d3-21b3-400e-bfb0-55f820965a81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.422150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:51.422907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d647d3-21b3-400e-bfb0-55f820965a81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.436050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.441518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.445644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.446577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.527257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:51.542205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=18 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:51.746547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c1d647d3-21b3-400e-bfb0-55f820965a81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:51.759284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:51.767937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:51.770429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c1d647d3-21b3-400e-bfb0-55f820965a81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.391825 Jun 02 19:03:51.780091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 178/352] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:51 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:51.783670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:51.787891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9875d513-35e4-4143-b907-674406f7b97a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.377292 Jun 02 19:03:51.790893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:51.791922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 175/353] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:51.795854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:51.796931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Searching by: {'deleted': False, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac'} {{(pid=117776) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 02 19:03:51.803511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:51.806289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.807241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.808441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.809121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.923406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.multi_cell_list [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 02 19:03:51.977625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6926d6c7-0a3e-4300-9150-00e05da21d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:51.978427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6926d6c7-0a3e-4300-9150-00e05da21d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:51.994936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6926d6c7-0a3e-4300-9150-00e05da21d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:51.995475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6926d6c7-0a3e-4300-9150-00e05da21d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:51.996362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6926d6c7-0a3e-4300-9150-00e05da21d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.000011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6926d6c7-0a3e-4300-9150-00e05da21d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:52.175938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d4d61ed1-5d57-4222-9e11-29cf0a02cff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.394479 Jun 02 19:03:52.181410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 179/354] 10.222.0.15 () {58 vars in 1124 bytes} [Thu Jun 2 19:03:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:52.192321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-06f2c7fd-34f4-4f27-9438-ccca640456be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:52.195227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-06f2c7fd-34f4-4f27-9438-ccca640456be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:52.215305 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06f2c7fd-34f4-4f27-9438-ccca640456be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.218887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06f2c7fd-34f4-4f27-9438-ccca640456be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:52.219866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06f2c7fd-34f4-4f27-9438-ccca640456be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.220446 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06f2c7fd-34f4-4f27-9438-ccca640456be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:52.332037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6926d6c7-0a3e-4300-9150-00e05da21d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:52.344336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6926d6c7-0a3e-4300-9150-00e05da21d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.371174 Jun 02 19:03:52.345267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 176/355] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:51 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:52.396790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-99c8de3b-d073-43e6-857b-e03a5626a85f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:52.397465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-99c8de3b-d073-43e6-857b-e03a5626a85f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:52.410491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99c8de3b-d073-43e6-857b-e03a5626a85f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.410491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99c8de3b-d073-43e6-857b-e03a5626a85f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:52.410860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99c8de3b-d073-43e6-857b-e03a5626a85f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.414091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99c8de3b-d073-43e6-857b-e03a5626a85f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:52.491983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-06f2c7fd-34f4-4f27-9438-ccca640456be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:52.501388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-06f2c7fd-34f4-4f27-9438-ccca640456be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1545 microversion: 2.1 time: 0.313267 Jun 02 19:03:52.508477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 180/356] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1545 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:52.716983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-99c8de3b-d073-43e6-857b-e03a5626a85f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:52.736458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-99c8de3b-d073-43e6-857b-e03a5626a85f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.342571 Jun 02 19:03:52.748177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 177/357] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:52 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:52.791190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5bce74bd-0952-49fb-b689-b0363af21da2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:52.794140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5bce74bd-0952-49fb-b689-b0363af21da2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:52.807638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5bce74bd-0952-49fb-b689-b0363af21da2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.809399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5bce74bd-0952-49fb-b689-b0363af21da2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:52.810685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5bce74bd-0952-49fb-b689-b0363af21da2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.811044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:52.811491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5bce74bd-0952-49fb-b689-b0363af21da2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:52.812079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:52.832372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.837265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:52.840914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:52.890594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:53.492927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5bce74bd-0952-49fb-b689-b0363af21da2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:53.508920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5bce74bd-0952-49fb-b689-b0363af21da2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.725147 Jun 02 19:03:53.517379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:53.530067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 181/358] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:52 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:53.534960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:53.541411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:53.543121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b19d3f46-89c3-4b7c-b4b2-8fdb799ac511 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:53.545054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b19d3f46-89c3-4b7c-b4b2-8fdb799ac511 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:53.545431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ce5160d5-4659-4fc1-b8f4-929ed9afcd28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.738458 Jun 02 19:03:53.548971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 178/359] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:53.554666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b19d3f46-89c3-4b7c-b4b2-8fdb799ac511 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:53.555703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b19d3f46-89c3-4b7c-b4b2-8fdb799ac511 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:53.556682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b19d3f46-89c3-4b7c-b4b2-8fdb799ac511 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:53.557414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b19d3f46-89c3-4b7c-b4b2-8fdb799ac511 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:53.761043 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad65e602-bea2-4105-866c-a8a1a5691312 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:53.762082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad65e602-bea2-4105-866c-a8a1a5691312 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:53.788369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad65e602-bea2-4105-866c-a8a1a5691312 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:53.789639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad65e602-bea2-4105-866c-a8a1a5691312 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:53.794921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad65e602-bea2-4105-866c-a8a1a5691312 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:53.795430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad65e602-bea2-4105-866c-a8a1a5691312 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:54.129664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b19d3f46-89c3-4b7c-b4b2-8fdb799ac511 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:54.149049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b19d3f46-89c3-4b7c-b4b2-8fdb799ac511 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.614002 Jun 02 19:03:54.150361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 182/360] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:53 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:54.210326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad65e602-bea2-4105-866c-a8a1a5691312 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:54.220338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad65e602-bea2-4105-866c-a8a1a5691312 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.469232 Jun 02 19:03:54.221415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 179/361] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:53 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:54.543506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cce4633b-4034-4c8e-882b-d28e574131d3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:54.544153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cce4633b-4034-4c8e-882b-d28e574131d3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:54.556226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cce4633b-4034-4c8e-882b-d28e574131d3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:54.556678 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cce4633b-4034-4c8e-882b-d28e574131d3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:54.561501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cce4633b-4034-4c8e-882b-d28e574131d3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:54.565171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cce4633b-4034-4c8e-882b-d28e574131d3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:54.577952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:54.579368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:54.600221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:54.601136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:54.602254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:54.602960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:54.940606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cce4633b-4034-4c8e-882b-d28e574131d3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:54.955620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cce4633b-4034-4c8e-882b-d28e574131d3 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.415194 Jun 02 19:03:54.957133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 183/362] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:54 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:54.967382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:54.978763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:54.980359 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:54.981879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-23c5e929-e7dc-41fd-a4fd-a1b1c3a04e16 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.408347 Jun 02 19:03:54.982696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 180/363] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:55.119283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fb902ad4-aa14-473b-9eb6-40c477fe813f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dda9684-67c6-4469-a214-dc543be1470c"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:55.121156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fb902ad4-aa14-473b-9eb6-40c477fe813f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:55.140249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb902ad4-aa14-473b-9eb6-40c477fe813f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:55.154642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb902ad4-aa14-473b-9eb6-40c477fe813f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:55.155818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb902ad4-aa14-473b-9eb6-40c477fe813f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:55.156531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb902ad4-aa14-473b-9eb6-40c477fe813f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:55.170556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1bc0db3f-f82f-4a48-a917-bc0f4b87c72e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:55.171560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1bc0db3f-f82f-4a48-a917-bc0f4b87c72e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:55.190592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bc0db3f-f82f-4a48-a917-bc0f4b87c72e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:55.191111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bc0db3f-f82f-4a48-a917-bc0f4b87c72e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:55.192311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bc0db3f-f82f-4a48-a917-bc0f4b87c72e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:55.192911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bc0db3f-f82f-4a48-a917-bc0f4b87c72e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:55.529012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1bc0db3f-f82f-4a48-a917-bc0f4b87c72e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:55.549814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1bc0db3f-f82f-4a48-a917-bc0f4b87c72e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.386377 Jun 02 19:03:55.550427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 181/364] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:55 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:55.565042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-89ed9f62-49d5-4281-948d-34d6187d3942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:55.568041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-89ed9f62-49d5-4281-948d-34d6187d3942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:55.589688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89ed9f62-49d5-4281-948d-34d6187d3942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:55.590377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89ed9f62-49d5-4281-948d-34d6187d3942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:55.591176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89ed9f62-49d5-4281-948d-34d6187d3942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:55.591779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89ed9f62-49d5-4281-948d-34d6187d3942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:55.834140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fb902ad4-aa14-473b-9eb6-40c477fe813f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715772 Jun 02 19:03:55.836183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 184/365] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:03:55 2022] POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:55.847304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-07a35559-db24-44e4-a132-8aa6e251d353 req-3b0acd8d-8074-496a-92f2-6b5414fe879c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac72221-56c7-4928-a41f-7bf89b4cab20", "name": "network-vif-plugged", "status": "completed", "tag": "6ccfd62c-96b8-4126-8fcb-55c08b439177"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:03:55.873001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-07a35559-db24-44e4-a132-8aa6e251d353 req-3b0acd8d-8074-496a-92f2-6b5414fe879c service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:55.876505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-07a35559-db24-44e4-a132-8aa6e251d353 req-3b0acd8d-8074-496a-92f2-6b5414fe879c service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:55.914038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-07a35559-db24-44e4-a132-8aa6e251d353 req-3b0acd8d-8074-496a-92f2-6b5414fe879c service nova] Creating event network-vif-plugged:6ccfd62c-96b8-4126-8fcb-55c08b439177 for instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 on hv-cinder-79760 Jun 02 19:03:55.927623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-07a35559-db24-44e4-a132-8aa6e251d353 req-3b0acd8d-8074-496a-92f2-6b5414fe879c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089402 Jun 02 19:03:55.928226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 185/366] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:03:55.976833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-11369b29-b300-4904-84d8-e4d121fe0578 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:55.978213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-11369b29-b300-4904-84d8-e4d121fe0578 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:56.008038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-89ed9f62-49d5-4281-948d-34d6187d3942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:56.009274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11369b29-b300-4904-84d8-e4d121fe0578 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:56.009939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11369b29-b300-4904-84d8-e4d121fe0578 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:56.017516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11369b29-b300-4904-84d8-e4d121fe0578 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:56.018293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11369b29-b300-4904-84d8-e4d121fe0578 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:56.019453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-89ed9f62-49d5-4281-948d-34d6187d3942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.467828 Jun 02 19:03:56.020594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 182/367] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:55 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:56.026934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:56.028749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:56.041690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:56.042363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:56.043305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:56.044000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:56.494601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-11369b29-b300-4904-84d8-e4d121fe0578 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:56.536699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-11369b29-b300-4904-84d8-e4d121fe0578 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.564401 Jun 02 19:03:56.540017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 186/368] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:55 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:56.570835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1ec38466-433d-4c07-8049-6f3eb0e2c673 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:56.571811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1ec38466-433d-4c07-8049-6f3eb0e2c673 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:56.598492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ec38466-433d-4c07-8049-6f3eb0e2c673 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:56.599168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ec38466-433d-4c07-8049-6f3eb0e2c673 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:56.600162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ec38466-433d-4c07-8049-6f3eb0e2c673 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:56.600880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ec38466-433d-4c07-8049-6f3eb0e2c673 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:56.638122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:56.644799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:56.670070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:56.681843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:56.683196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7281eab2-1cfe-4701-bfa6-11e2a982263e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.660713 Jun 02 19:03:56.684429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 183/369] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:56.910081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1ec38466-433d-4c07-8049-6f3eb0e2c673 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:56.924862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1ec38466-433d-4c07-8049-6f3eb0e2c673 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.360177 Jun 02 19:03:56.926304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 187/370] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:56 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:57.037295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-804c3f3d-be56-44da-9038-ab9b5d91d78e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:57.039885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-804c3f3d-be56-44da-9038-ab9b5d91d78e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:57.053515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-804c3f3d-be56-44da-9038-ab9b5d91d78e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:57.055524 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-804c3f3d-be56-44da-9038-ab9b5d91d78e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:57.056790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-804c3f3d-be56-44da-9038-ab9b5d91d78e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:57.057751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-804c3f3d-be56-44da-9038-ab9b5d91d78e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:57.317962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-804c3f3d-be56-44da-9038-ab9b5d91d78e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:57.328268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-804c3f3d-be56-44da-9038-ab9b5d91d78e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.294155 Jun 02 19:03:57.329208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 184/371] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:57 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:57.569842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b9424d3f-3d7b-4a2c-8506-e6d76d5be986 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:57.570696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b9424d3f-3d7b-4a2c-8506-e6d76d5be986 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:57.578118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9424d3f-3d7b-4a2c-8506-e6d76d5be986 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:57.579009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9424d3f-3d7b-4a2c-8506-e6d76d5be986 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:57.580009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9424d3f-3d7b-4a2c-8506-e6d76d5be986 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:57.580574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9424d3f-3d7b-4a2c-8506-e6d76d5be986 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:57.702387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:57.703752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:57.711764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:57.712436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:57.713455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:57.714318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:57.768963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b9424d3f-3d7b-4a2c-8506-e6d76d5be986 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:57.779778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b9424d3f-3d7b-4a2c-8506-e6d76d5be986 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.220104 Jun 02 19:03:57.783866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 188/372] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:57 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:57.926625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:57.947980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-695a8a44-6b23-49b5-9b9e-fc10dad880fa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:57.949056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-695a8a44-6b23-49b5-9b9e-fc10dad880fa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:57.958622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:57.969238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:57.974216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695a8a44-6b23-49b5-9b9e-fc10dad880fa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:57.977000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695a8a44-6b23-49b5-9b9e-fc10dad880fa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:57.977871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f3cc5bf2-11e2-451c-9777-7588a9676c7f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1739 microversion: 2.20 time: 0.275220 Jun 02 19:03:57.998545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695a8a44-6b23-49b5-9b9e-fc10dad880fa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:57.998545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695a8a44-6b23-49b5-9b9e-fc10dad880fa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:57.999015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 185/373] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:03:58.229765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-695a8a44-6b23-49b5-9b9e-fc10dad880fa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:58.244440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-695a8a44-6b23-49b5-9b9e-fc10dad880fa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.304891 Jun 02 19:03:58.245251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 189/374] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:57 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:58.356169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-da175926-0f6e-43d8-9d73-2aac39235e4c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:58.357070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-da175926-0f6e-43d8-9d73-2aac39235e4c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:58.371104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da175926-0f6e-43d8-9d73-2aac39235e4c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:58.372119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da175926-0f6e-43d8-9d73-2aac39235e4c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:58.373248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da175926-0f6e-43d8-9d73-2aac39235e4c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:58.373687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da175926-0f6e-43d8-9d73-2aac39235e4c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:58.594059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-da175926-0f6e-43d8-9d73-2aac39235e4c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:58.610869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-da175926-0f6e-43d8-9d73-2aac39235e4c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.267979 Jun 02 19:03:58.611529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 186/375] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:58 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:58.798045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4841d25f-c98e-47e0-9ec0-5a7485e2b7a1 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:58.798671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4841d25f-c98e-47e0-9ec0-5a7485e2b7a1 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:58.806037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4841d25f-c98e-47e0-9ec0-5a7485e2b7a1 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:58.806493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4841d25f-c98e-47e0-9ec0-5a7485e2b7a1 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:58.807281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4841d25f-c98e-47e0-9ec0-5a7485e2b7a1 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:58.807718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4841d25f-c98e-47e0-9ec0-5a7485e2b7a1 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:58.996544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4841d25f-c98e-47e0-9ec0-5a7485e2b7a1 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:59.010264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4841d25f-c98e-47e0-9ec0-5a7485e2b7a1 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1367 microversion: 2.1 time: 0.215942 Jun 02 19:03:59.011152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 190/376] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:58 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:03:59.011917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:59.012593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:59.018747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:59.019271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:59.020166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:59.020679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:59.212948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:59.223343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:59.226789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:59.228028 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3dca7b95-8653-41a0-b66a-1c12a397e53b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1721 microversion: 2.20 time: 0.221628 Jun 02 19:03:59.228603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 187/377] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:03:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:03:59.267021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a028b898-501d-430c-b95f-c254606f51ad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:59.267893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a028b898-501d-430c-b95f-c254606f51ad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:59.284872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a028b898-501d-430c-b95f-c254606f51ad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:59.285256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a028b898-501d-430c-b95f-c254606f51ad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:59.291097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a028b898-501d-430c-b95f-c254606f51ad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:59.291843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a028b898-501d-430c-b95f-c254606f51ad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:59.474981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a028b898-501d-430c-b95f-c254606f51ad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:59.484763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a028b898-501d-430c-b95f-c254606f51ad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.222827 Jun 02 19:03:59.485458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 191/378] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:59 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:03:59.627692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-72c22a97-b343-42e0-9af7-7c0152a34361 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:03:59.628616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-72c22a97-b343-42e0-9af7-7c0152a34361 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:03:59.642184 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72c22a97-b343-42e0-9af7-7c0152a34361 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:59.643868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72c22a97-b343-42e0-9af7-7c0152a34361 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:59.647198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72c22a97-b343-42e0-9af7-7c0152a34361 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:03:59.649404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72c22a97-b343-42e0-9af7-7c0152a34361 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:03:59.812274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-72c22a97-b343-42e0-9af7-7c0152a34361 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:03:59.814786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:59.822495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-72c22a97-b343-42e0-9af7-7c0152a34361 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.199214 Jun 02 19:03:59.823818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 188/379] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:03:59 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:00.028685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-face319e-cbe5-41b3-8742-55bb74aa1309 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:00.032078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-face319e-cbe5-41b3-8742-55bb74aa1309 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:00.040476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-face319e-cbe5-41b3-8742-55bb74aa1309 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.041481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-face319e-cbe5-41b3-8742-55bb74aa1309 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.042715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-face319e-cbe5-41b3-8742-55bb74aa1309 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.043303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-face319e-cbe5-41b3-8742-55bb74aa1309 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.248031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:00.249156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:00.250981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-face319e-cbe5-41b3-8742-55bb74aa1309 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:00.260318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.261326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.263365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.263883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.286876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-face319e-cbe5-41b3-8742-55bb74aa1309 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1557 microversion: 2.1 time: 0.258568 Jun 02 19:04:00.287890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 192/380] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:00 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:00.306237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-902a44bf-635d-4cfa-8f0b-325b569b1dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:00.307134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-902a44bf-635d-4cfa-8f0b-325b569b1dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:00.320213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-902a44bf-635d-4cfa-8f0b-325b569b1dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.320601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-902a44bf-635d-4cfa-8f0b-325b569b1dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.321425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-902a44bf-635d-4cfa-8f0b-325b569b1dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.321905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-902a44bf-635d-4cfa-8f0b-325b569b1dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.495240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-902a44bf-635d-4cfa-8f0b-325b569b1dd4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193710 Jun 02 19:04:00.496359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 193/381] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Jun 2 19:04:00 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:00.507398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-94943fd1-ec83-4cf6-9ca1-9f75aef11afa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:00.508116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-94943fd1-ec83-4cf6-9ca1-9f75aef11afa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:00.517550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-94943fd1-ec83-4cf6-9ca1-9f75aef11afa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.521149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-94943fd1-ec83-4cf6-9ca1-9f75aef11afa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.522568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-94943fd1-ec83-4cf6-9ca1-9f75aef11afa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.524711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-94943fd1-ec83-4cf6-9ca1-9f75aef11afa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.591470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:00.604859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:00.606381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:00.607540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-73ec7645-7cf9-499c-a223-1779f11394a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1721 microversion: 2.20 time: 0.364798 Jun 02 19:04:00.608277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 189/382] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1721 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:04:00.754977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-94943fd1-ec83-4cf6-9ca1-9f75aef11afa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:00.764670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-94943fd1-ec83-4cf6-9ca1-9f75aef11afa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.266778 Jun 02 19:04:00.765466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 194/383] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:00 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:00.841318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e2b8f2d6-adb3-48b0-beef-6b18f2a2fcdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:00.842236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e2b8f2d6-adb3-48b0-beef-6b18f2a2fcdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:00.849525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2b8f2d6-adb3-48b0-beef-6b18f2a2fcdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.850311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2b8f2d6-adb3-48b0-beef-6b18f2a2fcdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:00.851555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2b8f2d6-adb3-48b0-beef-6b18f2a2fcdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:00.852248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2b8f2d6-adb3-48b0-beef-6b18f2a2fcdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:01.237394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e2b8f2d6-adb3-48b0-beef-6b18f2a2fcdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:01.251216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e2b8f2d6-adb3-48b0-beef-6b18f2a2fcdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.414203 Jun 02 19:04:01.252568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 190/384] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:00 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:01.416264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-b7c76bed-7e2d-4e20-adbc-b0e00a8ef881 req-fb9bf44d-26fa-485c-bb54-7511873322d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaab800-95de-43b9-972d-b65ccd2a7ec6", "name": "network-vif-plugged", "status": "completed", "tag": "a498d4bf-e238-41a8-aeab-abeda8df24c7"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:01.442095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b7c76bed-7e2d-4e20-adbc-b0e00a8ef881 req-fb9bf44d-26fa-485c-bb54-7511873322d7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:01.444034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b7c76bed-7e2d-4e20-adbc-b0e00a8ef881 req-fb9bf44d-26fa-485c-bb54-7511873322d7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:01.471034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-b7c76bed-7e2d-4e20-adbc-b0e00a8ef881 req-fb9bf44d-26fa-485c-bb54-7511873322d7 service nova] Creating event network-vif-plugged:a498d4bf-e238-41a8-aeab-abeda8df24c7 for instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 on hv-cinder-79760 Jun 02 19:04:01.484864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-b7c76bed-7e2d-4e20-adbc-b0e00a8ef881 req-fb9bf44d-26fa-485c-bb54-7511873322d7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071978 Jun 02 19:04:01.487417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 195/385] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:04:01.628493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:01.629421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:01.645289 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:01.646324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:01.648200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:01.651475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:01.792957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-67a526da-fa6f-4568-bd3f-79454ace1fc7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:01.795951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-67a526da-fa6f-4568-bd3f-79454ace1fc7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:01.855057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67a526da-fa6f-4568-bd3f-79454ace1fc7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:01.856394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67a526da-fa6f-4568-bd3f-79454ace1fc7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:01.861857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:01.863188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67a526da-fa6f-4568-bd3f-79454ace1fc7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:01.863826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67a526da-fa6f-4568-bd3f-79454ace1fc7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:01.864631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:01.877588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:01.879109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:01.880297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b673d3ee-b2cb-4107-b733-ba2aaddbf630 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1721 microversion: 2.20 time: 0.258043 Jun 02 19:04:01.880845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 191/386] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:02.161357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-67a526da-fa6f-4568-bd3f-79454ace1fc7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:02.177600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-67a526da-fa6f-4568-bd3f-79454ace1fc7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.397740 Jun 02 19:04:02.179371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 196/387] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:01 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:02.268750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b060b824-135b-49d3-bdaf-9d89699f2eb7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:02.269358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b060b824-135b-49d3-bdaf-9d89699f2eb7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:02.279554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b060b824-135b-49d3-bdaf-9d89699f2eb7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:02.280002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b060b824-135b-49d3-bdaf-9d89699f2eb7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:02.280929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b060b824-135b-49d3-bdaf-9d89699f2eb7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:02.281356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b060b824-135b-49d3-bdaf-9d89699f2eb7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:02.477237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-ed4d9ddc-d63e-44e3-8990-a9df642803ec req-51aef263-f191-47fe-8cbb-a36bd0c7ed26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac72221-56c7-4928-a41f-7bf89b4cab20", "tag": "6ccfd62c-96b8-4126-8fcb-55c08b439177"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:02.501651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ed4d9ddc-d63e-44e3-8990-a9df642803ec req-51aef263-f191-47fe-8cbb-a36bd0c7ed26 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:02.502375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ed4d9ddc-d63e-44e3-8990-a9df642803ec req-51aef263-f191-47fe-8cbb-a36bd0c7ed26 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:02.542373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-ed4d9ddc-d63e-44e3-8990-a9df642803ec req-51aef263-f191-47fe-8cbb-a36bd0c7ed26 service nova] Creating event network-changed:6ccfd62c-96b8-4126-8fcb-55c08b439177 for instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 on hv-cinder-79760 Jun 02 19:04:02.550252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-ed4d9ddc-d63e-44e3-8990-a9df642803ec req-51aef263-f191-47fe-8cbb-a36bd0c7ed26 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077653 Jun 02 19:04:02.551412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b060b824-135b-49d3-bdaf-9d89699f2eb7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:02.551661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 197/388] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:04:02.560964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b060b824-135b-49d3-bdaf-9d89699f2eb7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.296080 Jun 02 19:04:02.563195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 192/389] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:02 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:02.901322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:02.902464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:02.919937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:02.920845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:02.921921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:02.922563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:03.112976 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:03.124901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:03.128616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:03.131529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2e41c7f5-f757-4634-b45d-187278497fff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1721 microversion: 2.20 time: 0.236547 Jun 02 19:04:03.143697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 198/390] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:03.199725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5b289f69-9f7c-499e-b4d1-fec61cbe3ee1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:03.200844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5b289f69-9f7c-499e-b4d1-fec61cbe3ee1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:03.219029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b289f69-9f7c-499e-b4d1-fec61cbe3ee1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:03.228590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b289f69-9f7c-499e-b4d1-fec61cbe3ee1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:03.230294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b289f69-9f7c-499e-b4d1-fec61cbe3ee1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:03.231182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b289f69-9f7c-499e-b4d1-fec61cbe3ee1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:03.508391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-b8641604-576b-4dc6-9d94-a306ef088aff req-a701b39f-ebfd-4587-bdfa-835dafaf93a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2f3bad-3acd-4fe8-87bb-29f1424ea788", "name": "network-vif-unplugged", "status": "completed", "tag": "907b11e3-1dc7-4e4c-9786-5e63f5dd0812"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:03.535476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b8641604-576b-4dc6-9d94-a306ef088aff req-a701b39f-ebfd-4587-bdfa-835dafaf93a4 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:03.541994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b8641604-576b-4dc6-9d94-a306ef088aff req-a701b39f-ebfd-4587-bdfa-835dafaf93a4 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:03.584724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-b8641604-576b-4dc6-9d94-a306ef088aff req-a701b39f-ebfd-4587-bdfa-835dafaf93a4 service nova] Creating event network-vif-unplugged:907b11e3-1dc7-4e4c-9786-5e63f5dd0812 for instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 on hv-cinder-79760 Jun 02 19:04:03.598983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-b8641604-576b-4dc6-9d94-a306ef088aff req-a701b39f-ebfd-4587-bdfa-835dafaf93a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088913 Jun 02 19:04:03.602313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 199/391] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:03.643529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-495324b0-725a-462e-a568-d64e5fca98ad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:03.649480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-495324b0-725a-462e-a568-d64e5fca98ad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:03.655218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5b289f69-9f7c-499e-b4d1-fec61cbe3ee1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:03.668517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5b289f69-9f7c-499e-b4d1-fec61cbe3ee1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1522 microversion: 2.1 time: 0.475773 Jun 02 19:04:03.672543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 193/392] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:03 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:03.691022 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-495324b0-725a-462e-a568-d64e5fca98ad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:03.693154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-495324b0-725a-462e-a568-d64e5fca98ad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:03.697194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-495324b0-725a-462e-a568-d64e5fca98ad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:03.698967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-495324b0-725a-462e-a568-d64e5fca98ad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:03.948430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-495324b0-725a-462e-a568-d64e5fca98ad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:03.958893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-495324b0-725a-462e-a568-d64e5fca98ad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.355271 Jun 02 19:04:03.960230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 200/393] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:03 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:04.152430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:04.153400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:04.164832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:04.165443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:04.166786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:04.167586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:04.686635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d359aac8-3cc8-4276-92d1-4b429d6c042c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:04.687860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d359aac8-3cc8-4276-92d1-4b429d6c042c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:04.703028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d359aac8-3cc8-4276-92d1-4b429d6c042c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:04.703889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d359aac8-3cc8-4276-92d1-4b429d6c042c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:04.704921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d359aac8-3cc8-4276-92d1-4b429d6c042c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:04.705593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d359aac8-3cc8-4276-92d1-4b429d6c042c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:04.725706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:04.734301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:04.736228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:04.737582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-89e0aeae-da3a-43bc-b2ca-42472c558ac7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1721 microversion: 2.20 time: 0.591267 Jun 02 19:04:04.748557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 194/394] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1721 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:04.890533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d359aac8-3cc8-4276-92d1-4b429d6c042c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:04.907612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d359aac8-3cc8-4276-92d1-4b429d6c042c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1502 microversion: 2.1 time: 0.225374 Jun 02 19:04:04.908914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 201/395] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:04 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:04.924979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ee4622b-c32d-46e4-9a85-da77c15a0668 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:04.925895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ee4622b-c32d-46e4-9a85-da77c15a0668 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:04.938547 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ee4622b-c32d-46e4-9a85-da77c15a0668 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:04.939367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ee4622b-c32d-46e4-9a85-da77c15a0668 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:04.940299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ee4622b-c32d-46e4-9a85-da77c15a0668 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:04.942350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ee4622b-c32d-46e4-9a85-da77c15a0668 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:04.976249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-05d38f0e-d260-426c-b7bc-0b1f1743fc47 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:04.977106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-05d38f0e-d260-426c-b7bc-0b1f1743fc47 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:04.993900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05d38f0e-d260-426c-b7bc-0b1f1743fc47 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:04.996439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05d38f0e-d260-426c-b7bc-0b1f1743fc47 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:04.998049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05d38f0e-d260-426c-b7bc-0b1f1743fc47 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:05.002130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05d38f0e-d260-426c-b7bc-0b1f1743fc47 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:05.269176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-05d38f0e-d260-426c-b7bc-0b1f1743fc47 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:05.296357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-05d38f0e-d260-426c-b7bc-0b1f1743fc47 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.323176 Jun 02 19:04:05.296766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 202/396] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:04 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:05.302355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fd3061a2-25b6-40b0-b428-5b2c5974ffe7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:05.303189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fd3061a2-25b6-40b0-b428-5b2c5974ffe7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:05.315294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd3061a2-25b6-40b0-b428-5b2c5974ffe7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:05.315432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd3061a2-25b6-40b0-b428-5b2c5974ffe7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:05.316320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd3061a2-25b6-40b0-b428-5b2c5974ffe7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:05.317713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd3061a2-25b6-40b0-b428-5b2c5974ffe7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:05.330831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0ee4622b-c32d-46e4-9a85-da77c15a0668 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:05.350948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ee4622b-c32d-46e4-9a85-da77c15a0668 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1515 microversion: 2.1 time: 0.429779 Jun 02 19:04:05.354342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 195/397] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:04 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:05.758518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:05.759869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:05.776880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fd3061a2-25b6-40b0-b428-5b2c5974ffe7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:05.783704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:05.784903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:05.788357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:05.792800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:05.806468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fd3061a2-25b6-40b0-b428-5b2c5974ffe7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1591 microversion: 2.1 time: 0.505553 Jun 02 19:04:05.807853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 203/398] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1591 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:06.319173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-db779f04-b145-4700-a748-0bcab54d8d15 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:06.319911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-db779f04-b145-4700-a748-0bcab54d8d15 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:06.331673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db779f04-b145-4700-a748-0bcab54d8d15 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:06.332438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db779f04-b145-4700-a748-0bcab54d8d15 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:06.336271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db779f04-b145-4700-a748-0bcab54d8d15 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:06.337011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db779f04-b145-4700-a748-0bcab54d8d15 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:06.343890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:06.353886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:06.355500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:06.372156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b1b0d6af-91b9-451c-970a-f772208e62e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1721 microversion: 2.20 time: 0.617349 Jun 02 19:04:06.389987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 196/399] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1721 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:06.666808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-db779f04-b145-4700-a748-0bcab54d8d15 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:06.675451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-db779f04-b145-4700-a748-0bcab54d8d15 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1318 microversion: 2.1 time: 0.362283 Jun 02 19:04:06.681891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 204/400] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:06 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:07.238149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ce8792d-5692-459a-9447-a0aeb40217a2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:07.239903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5ce8792d-5692-459a-9447-a0aeb40217a2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:07.243246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:07.271494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ce8792d-5692-459a-9447-a0aeb40217a2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:07.275941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ce8792d-5692-459a-9447-a0aeb40217a2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:07.280210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ce8792d-5692-459a-9447-a0aeb40217a2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:07.282376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ce8792d-5692-459a-9447-a0aeb40217a2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:07.360211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-5ce8792d-5692-459a-9447-a0aeb40217a2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lazy-loading 'flavor' on Instance uuid 9dc057ea-7c78-4621-9e75-8f9654f6157c {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:04:07.397184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:07.398045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:07.427462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:07.429482 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:07.430549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:07.431101 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:07.555724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ce8792d-5692-459a-9447-a0aeb40217a2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c/action" status: 200 len: 32 microversion: 2.1 time: 0.328957 Jun 02 19:04:07.560282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 197/401] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:04:07 2022] POST /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c/action => generated 32 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 19:04:07.571695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-47edabaf-0a6d-4164-a290-04da6fc9a8e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:07.572427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-47edabaf-0a6d-4164-a290-04da6fc9a8e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:07.581756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47edabaf-0a6d-4164-a290-04da6fc9a8e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:07.582248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47edabaf-0a6d-4164-a290-04da6fc9a8e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:07.583572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47edabaf-0a6d-4164-a290-04da6fc9a8e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:07.584021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47edabaf-0a6d-4164-a290-04da6fc9a8e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:07.922261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:07.945840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:07.953212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:07.956964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3522c06f-2c86-4972-af6f-5f513948ca35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1724 microversion: 2.20 time: 0.561804 Jun 02 19:04:07.958522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 205/402] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1724 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:04:07.990154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a63db1a-acec-4d99-8ddd-90b5925e323f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:07.991939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a63db1a-acec-4d99-8ddd-90b5925e323f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:08.010959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a63db1a-acec-4d99-8ddd-90b5925e323f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:08.011997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a63db1a-acec-4d99-8ddd-90b5925e323f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:08.013228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a63db1a-acec-4d99-8ddd-90b5925e323f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:08.013939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a63db1a-acec-4d99-8ddd-90b5925e323f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:08.038871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:08.130976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-47edabaf-0a6d-4164-a290-04da6fc9a8e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:08.144542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-47edabaf-0a6d-4164-a290-04da6fc9a8e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.582544 Jun 02 19:04:08.156483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 198/403] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:07 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:08.162534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-61b7e7f8-0af9-437f-8c9b-cd2bf35f804a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5f4c21f-be1f-41eb-8297-953ab7566441"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:08.164558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-61b7e7f8-0af9-437f-8c9b-cd2bf35f804a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:08.173180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61b7e7f8-0af9-437f-8c9b-cd2bf35f804a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:08.173931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61b7e7f8-0af9-437f-8c9b-cd2bf35f804a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:08.177734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61b7e7f8-0af9-437f-8c9b-cd2bf35f804a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:08.178463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61b7e7f8-0af9-437f-8c9b-cd2bf35f804a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:08.823125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-61b7e7f8-0af9-437f-8c9b-cd2bf35f804a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "POST /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.665079 Jun 02 19:04:08.826275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 199/404] 10.222.0.15 () {62 vars in 1363 bytes} [Thu Jun 2 19:04:08 2022] POST /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 188 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:04:08.960512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2a63db1a-acec-4d99-8ddd-90b5925e323f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:08.969307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a63db1a-acec-4d99-8ddd-90b5925e323f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1508 microversion: 2.1 time: 1.009420 Jun 02 19:04:08.973281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 206/405] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:07 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1508 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:09.113222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e2d708c7-d3a0-4c0d-ae30-2ade390ce915 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:09.113950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e2d708c7-d3a0-4c0d-ae30-2ade390ce915 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:09.132344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2d708c7-d3a0-4c0d-ae30-2ade390ce915 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:09.133169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2d708c7-d3a0-4c0d-ae30-2ade390ce915 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:09.135256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2d708c7-d3a0-4c0d-ae30-2ade390ce915 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:09.135807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2d708c7-d3a0-4c0d-ae30-2ade390ce915 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:09.185941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-37681e7a-3cff-4371-a607-68f270ebdea1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:09.185941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-37681e7a-3cff-4371-a607-68f270ebdea1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:09.190062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37681e7a-3cff-4371-a607-68f270ebdea1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:09.202256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37681e7a-3cff-4371-a607-68f270ebdea1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:09.203950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37681e7a-3cff-4371-a607-68f270ebdea1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:09.208505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37681e7a-3cff-4371-a607-68f270ebdea1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:09.579459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:09.646627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-37681e7a-3cff-4371-a607-68f270ebdea1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:09.658400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-37681e7a-3cff-4371-a607-68f270ebdea1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.498012 Jun 02 19:04:09.662683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 207/406] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:09 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:09.674006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e2d708c7-d3a0-4c0d-ae30-2ade390ce915 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "POST /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/action" status: 202 len: 0 microversion: 2.20 time: 0.567158 Jun 02 19:04:09.678173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 200/407] 10.222.0.15 () {62 vars in 1318 bytes} [Thu Jun 2 19:04:09 2022] POST /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:04:09.688247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:09.696330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:09.718813 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:09.737535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:09.737535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:09.737964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:10.138638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:10.153211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:10.155006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:10.156948 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c0e48fdd-c1d7-4c6d-947c-6469169d46c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1750 microversion: 2.20 time: 0.477181 Jun 02 19:04:10.177988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 208/408] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1750 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:10.680353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54c45c8e-f1f3-45e2-b03b-09d1233f6f21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:10.681644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-54c45c8e-f1f3-45e2-b03b-09d1233f6f21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:10.695983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54c45c8e-f1f3-45e2-b03b-09d1233f6f21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:10.697063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54c45c8e-f1f3-45e2-b03b-09d1233f6f21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:10.700650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54c45c8e-f1f3-45e2-b03b-09d1233f6f21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:10.706540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54c45c8e-f1f3-45e2-b03b-09d1233f6f21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:10.988083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-54c45c8e-f1f3-45e2-b03b-09d1233f6f21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:10.996980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-54c45c8e-f1f3-45e2-b03b-09d1233f6f21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.321558 Jun 02 19:04:11.011082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 201/409] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:10 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:11.176830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:11.177567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:11.185540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-e8a94e69-65f9-4e8d-93b0-a3ceb7cf4ce3 req-713cbaf9-1408-4a3e-8518-79ad82f1e37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721b511d-9547-41f5-a72c-47179f69b6af", "tag": "dcfd3ee8-9442-4031-bf79-1d94f38ef91a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:11.212212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-e8a94e69-65f9-4e8d-93b0-a3ceb7cf4ce3 req-713cbaf9-1408-4a3e-8518-79ad82f1e37b service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:11.213786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:11.215075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:11.218886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-e8a94e69-65f9-4e8d-93b0-a3ceb7cf4ce3 req-713cbaf9-1408-4a3e-8518-79ad82f1e37b service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:11.230276 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:11.230873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:11.272892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-e8a94e69-65f9-4e8d-93b0-a3ceb7cf4ce3 req-713cbaf9-1408-4a3e-8518-79ad82f1e37b service nova] Creating event network-changed:dcfd3ee8-9442-4031-bf79-1d94f38ef91a for instance 721b511d-9547-41f5-a72c-47179f69b6af on hv-cinder-79760 Jun 02 19:04:11.282593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-e8a94e69-65f9-4e8d-93b0-a3ceb7cf4ce3 req-713cbaf9-1408-4a3e-8518-79ad82f1e37b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100780 Jun 02 19:04:11.286481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 202/410] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:11.657920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:11.682208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:11.688975 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:11.693544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0af1e644-60a4-46a7-b0d6-559d6daee4f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1750 microversion: 2.20 time: 0.520966 Jun 02 19:04:11.716259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 209/411] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1750 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:12.020914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e25d6dd5-26d8-42b8-9092-f4376239591d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:12.022413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e25d6dd5-26d8-42b8-9092-f4376239591d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:12.035964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e25d6dd5-26d8-42b8-9092-f4376239591d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:12.036712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e25d6dd5-26d8-42b8-9092-f4376239591d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:12.037986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e25d6dd5-26d8-42b8-9092-f4376239591d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:12.038606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e25d6dd5-26d8-42b8-9092-f4376239591d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:12.724614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:12.725377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:12.733898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:12.734305 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:12.735088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:12.735531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:12.841032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e25d6dd5-26d8-42b8-9092-f4376239591d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:12.854177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e25d6dd5-26d8-42b8-9092-f4376239591d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.838025 Jun 02 19:04:12.856089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 203/412] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:12 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:13.199497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:13.215840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:13.217929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:13.221906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b045f680-cf7e-44a0-acb9-0b6c13832410 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1750 microversion: 2.20 time: 0.501581 Jun 02 19:04:13.222988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 210/413] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1750 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:13.873614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d93dba86-3cf7-4867-b316-e49fa5209bd6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:13.874974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d93dba86-3cf7-4867-b316-e49fa5209bd6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:13.881980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d93dba86-3cf7-4867-b316-e49fa5209bd6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:13.882441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d93dba86-3cf7-4867-b316-e49fa5209bd6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:13.883232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d93dba86-3cf7-4867-b316-e49fa5209bd6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:13.883661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d93dba86-3cf7-4867-b316-e49fa5209bd6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:13.931696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6fe9f949-cee4-4dfc-be5b-37d6735e38d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-967396446"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:13.932254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6fe9f949-cee4-4dfc-be5b-37d6735e38d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:13.942579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fe9f949-cee4-4dfc-be5b-37d6735e38d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:13.943026 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fe9f949-cee4-4dfc-be5b-37d6735e38d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:13.943882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fe9f949-cee4-4dfc-be5b-37d6735e38d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:13.944315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fe9f949-cee4-4dfc-be5b-37d6735e38d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:14.723798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d93dba86-3cf7-4867-b316-e49fa5209bd6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:14.733006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d93dba86-3cf7-4867-b316-e49fa5209bd6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.864919 Jun 02 19:04:14.737092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.network.security_group_api [None req-6fe9f949-cee4-4dfc-be5b-37d6735e38d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Adding security group 632a6aa2-8785-40da-9459-c4c725130424 to port dcfd3ee8-9442-4031-bf79-1d94f38ef91a Jun 02 19:04:14.737956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 204/414] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:13 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:14.747467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:14.748187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:14.762759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:14.763501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:14.764385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:14.765109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:15.160416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:15.186143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:15.190401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:15.194521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cc7620c2-c44c-4532-a3e7-bcd9a486b706 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.454315 Jun 02 19:04:15.201731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 205/415] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:15.556606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6fe9f949-cee4-4dfc-be5b-37d6735e38d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/action" status: 202 len: 0 microversion: 2.1 time: 1.629116 Jun 02 19:04:15.557604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 211/416] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:04:13 2022] POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/action => generated 0 bytes in 1631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:04:15.567400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1dbee52-1cc9-47bd-89cd-4684d60495db tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:15.577562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d1dbee52-1cc9-47bd-89cd-4684d60495db tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:15.587744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-e65419af-eef2-44de-ab74-eac33bdd2b4f req-52a28008-2b90-4575-b680-5a24e046515b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721b511d-9547-41f5-a72c-47179f69b6af", "tag": "dcfd3ee8-9442-4031-bf79-1d94f38ef91a"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:15.606771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1dbee52-1cc9-47bd-89cd-4684d60495db tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:15.609100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1dbee52-1cc9-47bd-89cd-4684d60495db tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:15.612791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1dbee52-1cc9-47bd-89cd-4684d60495db tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:15.613501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1dbee52-1cc9-47bd-89cd-4684d60495db tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:15.623613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-e65419af-eef2-44de-ab74-eac33bdd2b4f req-52a28008-2b90-4575-b680-5a24e046515b service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:15.624094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-e65419af-eef2-44de-ab74-eac33bdd2b4f req-52a28008-2b90-4575-b680-5a24e046515b service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:15.676450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-e65419af-eef2-44de-ab74-eac33bdd2b4f req-52a28008-2b90-4575-b680-5a24e046515b service nova] Creating event network-changed:dcfd3ee8-9442-4031-bf79-1d94f38ef91a for instance 721b511d-9547-41f5-a72c-47179f69b6af on hv-cinder-79760 Jun 02 19:04:15.693865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-e65419af-eef2-44de-ab74-eac33bdd2b4f req-52a28008-2b90-4575-b680-5a24e046515b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124731 Jun 02 19:04:15.697348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 212/417] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:15.752244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1ffe990b-836c-45c8-bc83-6f3056fd4f0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:15.752963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1ffe990b-836c-45c8-bc83-6f3056fd4f0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:15.765739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ffe990b-836c-45c8-bc83-6f3056fd4f0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:15.766226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ffe990b-836c-45c8-bc83-6f3056fd4f0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:15.767023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ffe990b-836c-45c8-bc83-6f3056fd4f0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:15.767465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ffe990b-836c-45c8-bc83-6f3056fd4f0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:16.030719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1dbee52-1cc9-47bd-89cd-4684d60495db tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:16.045097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d1dbee52-1cc9-47bd-89cd-4684d60495db tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1755 microversion: 2.1 time: 0.481634 Jun 02 19:04:16.051591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 206/418] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1755 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:16.220739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:16.221585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:16.237631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:16.238253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:16.238908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:16.239342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:16.248692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1ffe990b-836c-45c8-bc83-6f3056fd4f0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:16.284967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1ffe990b-836c-45c8-bc83-6f3056fd4f0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.537380 Jun 02 19:04:16.287950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 213/419] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:15 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:16.635994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:16.647116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:16.648639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:16.649886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2b0bc8c2-e044-468e-b838-0d4c69a83bd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.433527 Jun 02 19:04:16.650455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 207/420] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:04:17.308752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fe7912dc-3104-4f92-92fe-d9e0ce826fa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:17.311372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fe7912dc-3104-4f92-92fe-d9e0ce826fa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:17.332150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=92 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:17.336898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe7912dc-3104-4f92-92fe-d9e0ce826fa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:17.338600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe7912dc-3104-4f92-92fe-d9e0ce826fa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:17.342467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe7912dc-3104-4f92-92fe-d9e0ce826fa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:17.343161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe7912dc-3104-4f92-92fe-d9e0ce826fa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:17.586724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fe7912dc-3104-4f92-92fe-d9e0ce826fa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:17.603353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fe7912dc-3104-4f92-92fe-d9e0ce826fa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.302449 Jun 02 19:04:17.604705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 214/421] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:17 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:17.673952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:17.677239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:17.710350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:17.711607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:17.714861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:17.718235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:18.068426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:18.101596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:18.103958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:18.111762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7e99a852-5256-42fb-aecf-f5a5d4ca6cbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.446038 Jun 02 19:04:18.130976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 208/422] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:18.625342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b4475892-9160-4abb-8cab-b0fd2bc91251 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:18.626420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b4475892-9160-4abb-8cab-b0fd2bc91251 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:18.649123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4475892-9160-4abb-8cab-b0fd2bc91251 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:18.650370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4475892-9160-4abb-8cab-b0fd2bc91251 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:18.653780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4475892-9160-4abb-8cab-b0fd2bc91251 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:18.656270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4475892-9160-4abb-8cab-b0fd2bc91251 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:19.010761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b4475892-9160-4abb-8cab-b0fd2bc91251 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:19.057872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b4475892-9160-4abb-8cab-b0fd2bc91251 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.440608 Jun 02 19:04:19.059195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 215/423] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:18 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:19.137786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:19.138599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:19.148432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:19.148885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:19.149684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:19.150183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:19.754535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:19.777596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:19.779130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:19.780316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-65c6d3ea-f551-4315-822b-2cec33401a75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.646727 Jun 02 19:04:19.788680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 209/424] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:20.092681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5666814e-4018-448c-a734-f8579befb009 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:20.093554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5666814e-4018-448c-a734-f8579befb009 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:20.103908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5666814e-4018-448c-a734-f8579befb009 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:20.104362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5666814e-4018-448c-a734-f8579befb009 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:20.105182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5666814e-4018-448c-a734-f8579befb009 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:20.118078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5666814e-4018-448c-a734-f8579befb009 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:20.688027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5666814e-4018-448c-a734-f8579befb009 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:20.699160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5666814e-4018-448c-a734-f8579befb009 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.616971 Jun 02 19:04:20.700010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 216/425] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:20 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:20.810873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:20.812532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:20.821279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:20.821723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:20.822537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:20.836236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:21.723270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89bfc2c6-e2c1-42c5-845d-dd86be0a3aa3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:21.729019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-89bfc2c6-e2c1-42c5-845d-dd86be0a3aa3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:21.744792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89bfc2c6-e2c1-42c5-845d-dd86be0a3aa3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:21.747708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89bfc2c6-e2c1-42c5-845d-dd86be0a3aa3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:21.751134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89bfc2c6-e2c1-42c5-845d-dd86be0a3aa3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:21.752568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89bfc2c6-e2c1-42c5-845d-dd86be0a3aa3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:22.179929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:22.195711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:22.214976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:22.216297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ace82dac-09d3-46db-b240-4bd57353c9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 1.409727 Jun 02 19:04:22.219014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 210/426] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:22.756342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-89bfc2c6-e2c1-42c5-845d-dd86be0a3aa3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:22.780988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-89bfc2c6-e2c1-42c5-845d-dd86be0a3aa3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 1.065772 Jun 02 19:04:22.785353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 217/427] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:21 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:23.239870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:23.241132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:23.262117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:23.262700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:23.263619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:23.264090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:23.705772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:23.721188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:23.725614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:23.727065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-51ce5b53-fbd5-4fc3-bc1e-744c37db4304 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.494509 Jun 02 19:04:23.749215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 211/428] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:23.798136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-36887236-07a6-40df-aff1-b875c7cce3d8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:23.798752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-36887236-07a6-40df-aff1-b875c7cce3d8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:23.820854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36887236-07a6-40df-aff1-b875c7cce3d8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:23.821309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36887236-07a6-40df-aff1-b875c7cce3d8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:23.831517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36887236-07a6-40df-aff1-b875c7cce3d8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:23.832653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36887236-07a6-40df-aff1-b875c7cce3d8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:24.293769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-36887236-07a6-40df-aff1-b875c7cce3d8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:24.311864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-36887236-07a6-40df-aff1-b875c7cce3d8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.517180 Jun 02 19:04:24.325836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 218/429] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:23 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:24.749287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:24.750254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:24.796002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:24.796494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:24.797650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:24.807521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:25.245418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:25.268993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:25.279884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:25.285243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5051068a-de67-4a53-baab-a34a5830d32e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.543108 Jun 02 19:04:25.294742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 212/430] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:25.347173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7b969a70-cdaa-451c-a1a9-02cd955f0d2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:25.347949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7b969a70-cdaa-451c-a1a9-02cd955f0d2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:25.364840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b969a70-cdaa-451c-a1a9-02cd955f0d2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:25.375850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b969a70-cdaa-451c-a1a9-02cd955f0d2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:25.376903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b969a70-cdaa-451c-a1a9-02cd955f0d2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:25.386540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b969a70-cdaa-451c-a1a9-02cd955f0d2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:25.969357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7b969a70-cdaa-451c-a1a9-02cd955f0d2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:25.986660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7b969a70-cdaa-451c-a1a9-02cd955f0d2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.649157 Jun 02 19:04:26.007723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 219/431] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:25 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:26.314850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:26.316108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:26.327939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:26.328705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:26.330995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:26.332503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:26.679449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:26.696036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:26.705748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:26.708897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f335e480-4a41-4232-8aa4-983d1a470caf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.397282 Jun 02 19:04:26.711021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 213/432] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:27.030751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-befc7c6b-d788-450e-bdac-26b8fcab6137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:27.033313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-befc7c6b-d788-450e-bdac-26b8fcab6137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:27.056319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-befc7c6b-d788-450e-bdac-26b8fcab6137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:27.057560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-befc7c6b-d788-450e-bdac-26b8fcab6137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:27.058540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-befc7c6b-d788-450e-bdac-26b8fcab6137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:27.059272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-befc7c6b-d788-450e-bdac-26b8fcab6137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:27.316852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-befc7c6b-d788-450e-bdac-26b8fcab6137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:27.331854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-befc7c6b-d788-450e-bdac-26b8fcab6137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.310727 Jun 02 19:04:27.333238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 220/433] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:27 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:27.732181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:27.736640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:27.748543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:27.752590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:27.771465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:27.772024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:28.061453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:28.089079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:28.091803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:28.093234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-725bf9a5-64bb-4643-bfa0-fb6485e1b2f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.366411 Jun 02 19:04:28.104352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 214/434] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:28.353219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1f75b511-5bfd-40f6-90cb-2ca4fe76c30a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:28.354054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1f75b511-5bfd-40f6-90cb-2ca4fe76c30a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:28.364217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f75b511-5bfd-40f6-90cb-2ca4fe76c30a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:28.369680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f75b511-5bfd-40f6-90cb-2ca4fe76c30a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:28.372419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f75b511-5bfd-40f6-90cb-2ca4fe76c30a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:28.373109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f75b511-5bfd-40f6-90cb-2ca4fe76c30a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:28.472538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ed7c9b56-8736-4957-b47d-1a2a068ab01c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Action: 'create', calling method: .version_select at 0x7f5b78da6700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2119598037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBiSWOyOxzg0s/FsTqDVTTJXgjVCKy/u92GMoT2ZRY2i4vgl9arwrLauELj/UGOFKrumKGYDAILbIl73LZ+XpBBoPTynYdXqNkVKvtk4w9+pOn4DRTodz85q3KXMStuJg=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:28.535218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-ed7c9b56-8736-4957-b47d-1a2a068ab01c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Getting quotas for project 01f30f060e2444f9a2238c4c447c7dbd. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:04:28.543088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-ed7c9b56-8736-4957-b47d-1a2a068ab01c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Getting quotas for user f54c975b432a4678a5624ad5c9f54b74 and project 01f30f060e2444f9a2238c4c447c7dbd. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:04:28.628874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ed7c9b56-8736-4957-b47d-1a2a068ab01c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.531187 Jun 02 19:04:28.636753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 221/435] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:04:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:28.719146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1f75b511-5bfd-40f6-90cb-2ca4fe76c30a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:28.730959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1f75b511-5bfd-40f6-90cb-2ca4fe76c30a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.383230 Jun 02 19:04:28.743829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 215/436] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:28 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:29.113776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:29.114563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:29.139801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:29.140302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:29.141085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:29.141525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:29.155238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d88e01b1-9fc9-4383-bac7-ffcf119e01b8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "558384e3-596a-48e1-a452-43472980d424", "device": "/dev/sdb"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:29.156935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d88e01b1-9fc9-4383-bac7-ffcf119e01b8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:29.165675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d88e01b1-9fc9-4383-bac7-ffcf119e01b8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:29.166186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d88e01b1-9fc9-4383-bac7-ffcf119e01b8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:29.167548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d88e01b1-9fc9-4383-bac7-ffcf119e01b8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:29.168099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d88e01b1-9fc9-4383-bac7-ffcf119e01b8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:29.398854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:29.416550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:29.430992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:29.432599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-71c873ee-13fb-4bbc-b2d9-8697c23c1482 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.324481 Jun 02 19:04:29.433170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 222/437] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:29.751893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-740ca07f-9547-4738-9ae1-25818775c91c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:29.753973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-740ca07f-9547-4738-9ae1-25818775c91c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:29.773055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-740ca07f-9547-4738-9ae1-25818775c91c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:29.774719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-740ca07f-9547-4738-9ae1-25818775c91c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:29.775574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-740ca07f-9547-4738-9ae1-25818775c91c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:29.776019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-740ca07f-9547-4738-9ae1-25818775c91c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:30.072485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-740ca07f-9547-4738-9ae1-25818775c91c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:30.081162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-740ca07f-9547-4738-9ae1-25818775c91c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.334703 Jun 02 19:04:30.091572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 223/438] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:29 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:30.452426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:30.453483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:30.464233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:30.464977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:30.466125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:30.466791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:30.602349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:30.865486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:30.877260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:30.879810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:30.884864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-98fdcf72-3767-4b7e-920c-b6274e1c4358 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.434451 Jun 02 19:04:30.885827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 224/439] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:30.996699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d88e01b1-9fc9-4383-bac7-ffcf119e01b8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "POST /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.840530 Jun 02 19:04:30.997501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 216/440] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:04:29 2022] POST /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6/os-volume_attachments => generated 194 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:31.122910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2f81db30-fc45-4a5f-9036-2d413e03e6f5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:31.123584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2f81db30-fc45-4a5f-9036-2d413e03e6f5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:31.142019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f81db30-fc45-4a5f-9036-2d413e03e6f5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:31.144398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f81db30-fc45-4a5f-9036-2d413e03e6f5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:31.145263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f81db30-fc45-4a5f-9036-2d413e03e6f5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:31.145715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f81db30-fc45-4a5f-9036-2d413e03e6f5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:31.154566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:31.398233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2f81db30-fc45-4a5f-9036-2d413e03e6f5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:31.411649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2f81db30-fc45-4a5f-9036-2d413e03e6f5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.312860 Jun 02 19:04:31.412384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 225/441] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:31 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:31.914055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:31.915694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:31.931734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:31.932285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:31.933214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:31.933908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:32.079428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:32.088721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:32.090380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:32.091670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bf0cce55-1fa4-4c65-8f85-a0a4b1342ca7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.183973 Jun 02 19:04:32.092231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 217/442] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:32.430241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-59212bb4-c29d-4cb0-9729-dc697e448aa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:32.431507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-59212bb4-c29d-4cb0-9729-dc697e448aa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:32.453398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-59212bb4-c29d-4cb0-9729-dc697e448aa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:32.454264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-59212bb4-c29d-4cb0-9729-dc697e448aa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:32.456170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-59212bb4-c29d-4cb0-9729-dc697e448aa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:32.458473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-59212bb4-c29d-4cb0-9729-dc697e448aa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:32.636745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-59212bb4-c29d-4cb0-9729-dc697e448aa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:32.646534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-59212bb4-c29d-4cb0-9729-dc697e448aa4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.220832 Jun 02 19:04:32.647587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 226/443] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:32 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:33.111945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:33.112778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:33.121272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:33.121724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:33.122520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:33.123035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:33.283266 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:33.292956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:33.294495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:33.295696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1d9be114-965b-47ac-90de-b0664f92f3d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.188785 Jun 02 19:04:33.296252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 218/444] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:33.665377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3c133364-ea15-4c85-8d78-c4a6bc04bb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:33.666181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3c133364-ea15-4c85-8d78-c4a6bc04bb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:33.675007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c133364-ea15-4c85-8d78-c4a6bc04bb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:33.675460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c133364-ea15-4c85-8d78-c4a6bc04bb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:33.676500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c133364-ea15-4c85-8d78-c4a6bc04bb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:33.677127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c133364-ea15-4c85-8d78-c4a6bc04bb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:33.836171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3c133364-ea15-4c85-8d78-c4a6bc04bb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:33.843917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3c133364-ea15-4c85-8d78-c4a6bc04bb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.183022 Jun 02 19:04:33.844525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 227/445] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:33 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:34.322640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:34.323790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:34.332596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:34.332826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:34.333638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:34.335263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:34.488975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:34.498625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:34.500121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:34.501294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f310ecb3-d034-4850-affb-1f45c26fcd32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.183855 Jun 02 19:04:34.501870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 219/446] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:04:34.863566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0a90a52b-e391-4298-b98e-2676c3209879 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:34.864199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0a90a52b-e391-4298-b98e-2676c3209879 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:34.872368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0a90a52b-e391-4298-b98e-2676c3209879 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:34.872867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0a90a52b-e391-4298-b98e-2676c3209879 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:34.873819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0a90a52b-e391-4298-b98e-2676c3209879 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:34.874265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0a90a52b-e391-4298-b98e-2676c3209879 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.061676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0a90a52b-e391-4298-b98e-2676c3209879 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:35.071699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0a90a52b-e391-4298-b98e-2676c3209879 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1501 microversion: 2.1 time: 0.212567 Jun 02 19:04:35.072916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 228/447] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:34 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1501 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:35.094204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5b098e7-6f8a-4554-95b7-510c49bb654e"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:35.096267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:35.105380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:35.106075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.107134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:35.107820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.133146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] HTTP exception thrown: Cannot 'attach_volume' instance 9dc057ea-7c78-4621-9e75-8f9654f6157c while it is in vm_state rescued Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Request method failure captured: Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: POST /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c/os-volume_attachments HTTP/1.1 Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 74 Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQlS38G4DqtPiu3--ZxyayK6aSUxhLl-IYR-CTZyPuOEknapclGJxD19tyQbaOemAzNQqEbm7bIXrn0EpBoQJPbPyonI29v-O6oMXWhs7lPHfR2GtPoPY24Cexwy6IItuS6WPutF8nmEFt5TWOF6-2AsZdf3ggFOZbUpdX-xLTx4jwU Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: e2d79077c0654e55973512bc6d36a9e8 Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:04:35.134697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: e2d79077c0654e55973512bc6d36a9e8 Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-ServerRescueNegativeTestJSON-1063453713-project Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 4eda4b85484844ab8b424a1a42a97704 Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1063453713-project Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {"volumeAttachment": {"volumeId": "c5b098e7-6f8a-4554-95b7-510c49bb654e"}} Jun 02 19:04:35.142064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Cannot 'attach_volume' instance 9dc057ea-7c78-4621-9e75-8f9654f6157c while it is in vm_state rescued Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '9dc057ea-7c78-4621-9e75-8f9654f6157c', 'body': {'volumeAttachment': {'volumeId': 'c5b098e7-6f8a-4554-95b7-510c49bb654e'}}} Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9dc057ea-7c78-4621-9e75-8f9654f6157c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:04:35.142996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9dc057ea-7c78-4621-9e75-8f9654f6157c while it is in vm_state rescued Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:04:35.145041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:04:35.146482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:04:35.146482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:04:35.146482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9dc057ea-7c78-4621-9e75-8f9654f6157c while it is in vm_state rescued Jun 02 19:04:35.146482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:04:35.146482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Returning 409 to user: Cannot 'attach_volume' instance 9dc057ea-7c78-4621-9e75-8f9654f6157c while it is in vm_state rescued {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:04:35.146482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6ff73a4f-373a-4d07-b449-b39571a347b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049801 Jun 02 19:04:35.146482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 220/448] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:04:35 2022] POST /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 02 19:04:35.148452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fb4de3da-e715-4991-b140-c8f9a54dc17f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:35.149369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fb4de3da-e715-4991-b140-c8f9a54dc17f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:35.158663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb4de3da-e715-4991-b140-c8f9a54dc17f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:35.159121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb4de3da-e715-4991-b140-c8f9a54dc17f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.160460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb4de3da-e715-4991-b140-c8f9a54dc17f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:35.161230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb4de3da-e715-4991-b140-c8f9a54dc17f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.259691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fb4de3da-e715-4991-b140-c8f9a54dc17f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c/action" status: 202 len: 0 microversion: 2.1 time: 0.116693 Jun 02 19:04:35.264793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 229/449] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:04:35 2022] POST /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:04:35.271703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0e74772d-1d39-43d1-83e0-70ccecb9ebf5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:35.272875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0e74772d-1d39-43d1-83e0-70ccecb9ebf5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:35.280148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e74772d-1d39-43d1-83e0-70ccecb9ebf5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:35.280590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e74772d-1d39-43d1-83e0-70ccecb9ebf5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.281470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e74772d-1d39-43d1-83e0-70ccecb9ebf5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:35.281944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e74772d-1d39-43d1-83e0-70ccecb9ebf5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.535502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:35.537112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:35.551319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:35.551941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.553145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:35.553781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:35.559705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0e74772d-1d39-43d1-83e0-70ccecb9ebf5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:35.568715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0e74772d-1d39-43d1-83e0-70ccecb9ebf5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1509 microversion: 2.1 time: 0.302508 Jun 02 19:04:35.570146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 221/450] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:35 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:35.743049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:35.752263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:35.753765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:35.755086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c00e331c-95eb-465d-b581-641832545e0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.235151 Jun 02 19:04:35.755996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 230/451] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:36.590850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-07b0bd5e-7cfb-4da1-810f-9cdff1980a0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:36.593119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-07b0bd5e-7cfb-4da1-810f-9cdff1980a0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:36.611045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07b0bd5e-7cfb-4da1-810f-9cdff1980a0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:36.611045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07b0bd5e-7cfb-4da1-810f-9cdff1980a0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:36.611045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07b0bd5e-7cfb-4da1-810f-9cdff1980a0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:36.611045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07b0bd5e-7cfb-4da1-810f-9cdff1980a0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:36.763049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-07b0bd5e-7cfb-4da1-810f-9cdff1980a0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:36.773448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-07b0bd5e-7cfb-4da1-810f-9cdff1980a0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1509 microversion: 2.1 time: 0.190122 Jun 02 19:04:36.774049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 222/452] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:36 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:36.775114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:36.775773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:36.782591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:36.783051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:36.783826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:36.784268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:37.015532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:37.024955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:37.026542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:37.027728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-84d0b30f-e9db-42aa-a89f-dc8cd03036d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.256611 Jun 02 19:04:37.028530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 231/453] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:04:37.791500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3f33309c-bd76-4669-8411-253ed476c01f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:37.792080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3f33309c-bd76-4669-8411-253ed476c01f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:37.794556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=54 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:37.800452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f33309c-bd76-4669-8411-253ed476c01f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:37.800805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f33309c-bd76-4669-8411-253ed476c01f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:37.801599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f33309c-bd76-4669-8411-253ed476c01f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:37.802047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f33309c-bd76-4669-8411-253ed476c01f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:37.969766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3f33309c-bd76-4669-8411-253ed476c01f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:37.986211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3f33309c-bd76-4669-8411-253ed476c01f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1509 microversion: 2.1 time: 0.198230 Jun 02 19:04:37.987193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 223/454] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:37 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:38.047145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:38.047773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:38.056081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:38.056447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:38.057215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:38.057635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:38.202316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:38.211202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:38.212766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:38.213982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-983a2e5a-e096-48fd-9d37-d9c9f186cb13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.170816 Jun 02 19:04:38.214529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 232/455] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:39.006767 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8d5583f2-1175-420d-a338-515077f83bab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:39.008038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8d5583f2-1175-420d-a338-515077f83bab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:39.015193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d5583f2-1175-420d-a338-515077f83bab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:39.015639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d5583f2-1175-420d-a338-515077f83bab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:39.016403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d5583f2-1175-420d-a338-515077f83bab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:39.016836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d5583f2-1175-420d-a338-515077f83bab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:39.233713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:39.234533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:39.236748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:39.247973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:39.248706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:39.249507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:39.249977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:39.442438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8d5583f2-1175-420d-a338-515077f83bab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:39.451626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8d5583f2-1175-420d-a338-515077f83bab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1509 microversion: 2.1 time: 0.449217 Jun 02 19:04:39.456592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 224/456] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:39 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:39.462219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-a0606ac7-0a51-49bc-bca2-45ad0b01c976 req-922cb7bc-0691-4b70-8da4-aca0103d427d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2f3bad-3acd-4fe8-87bb-29f1424ea788", "name": "network-vif-plugged", "status": "completed", "tag": "907b11e3-1dc7-4e4c-9786-5e63f5dd0812"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:39.470815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-a0606ac7-0a51-49bc-bca2-45ad0b01c976 req-922cb7bc-0691-4b70-8da4-aca0103d427d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:39.471262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-a0606ac7-0a51-49bc-bca2-45ad0b01c976 req-922cb7bc-0691-4b70-8da4-aca0103d427d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:39.484444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-a0606ac7-0a51-49bc-bca2-45ad0b01c976 req-922cb7bc-0691-4b70-8da4-aca0103d427d service nova] Creating event network-vif-plugged:907b11e3-1dc7-4e4c-9786-5e63f5dd0812 for instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 on hv-cinder-79760 Jun 02 19:04:39.490335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-a0606ac7-0a51-49bc-bca2-45ad0b01c976 req-922cb7bc-0691-4b70-8da4-aca0103d427d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Jun 02 19:04:39.491181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 225/457] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:39.511408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:39.520486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:39.522753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:39.524294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-56e3bb47-dae3-4e4e-bca7-8ab977e6dd18 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.295167 Jun 02 19:04:39.525050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 233/458] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:40.479184 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e8cab25a-ca30-48db-b956-57811d263348 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:40.480088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e8cab25a-ca30-48db-b956-57811d263348 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:40.497680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8cab25a-ca30-48db-b956-57811d263348 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:40.498395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8cab25a-ca30-48db-b956-57811d263348 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:40.499502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8cab25a-ca30-48db-b956-57811d263348 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:40.500120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8cab25a-ca30-48db-b956-57811d263348 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:40.545779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:40.546406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:40.556952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:40.557401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:40.558216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:40.558657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:40.742272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e8cab25a-ca30-48db-b956-57811d263348 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:40.750604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e8cab25a-ca30-48db-b956-57811d263348 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1515 microversion: 2.1 time: 0.280074 Jun 02 19:04:40.752030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 226/459] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:40 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:40.767926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:40.785834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:40.802045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:40.802045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-39055f11-da80-4305-98e8-f67e5570b224 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.247277 Jun 02 19:04:40.802045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 234/460] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:04:41.812867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:41.813872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:41.823653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:41.824225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:41.825708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:41.826439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:41.977133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:41.986889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:41.988336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:41.992316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aa1bed48-aed8-4787-86d9-f52bd2a8fdc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.184242 Jun 02 19:04:41.993191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 227/461] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:04:42.151273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-abb56cfc-0003-4d1d-a94f-20a889058e15 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'create', calling method: .version_select at 0x7f5b78e005e0>, body: {"keypair": {"name": "tempest-keypair-762648889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhatCHeWuMxIzdoQB+GZCMF95Lp1K+rbeXYqsfQc9wbRCd3Ebfcn0UPoCzAPNUWo6G+W0yzF6jsM1sGzdzgM0lTcJLnYl6aDv1429YfJEKgAp4uKFxMqv251owoZyxMsw=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:42.168610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-abb56cfc-0003-4d1d-a94f-20a889058e15 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Getting quotas for project e2d79077c0654e55973512bc6d36a9e8. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:04:42.173361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-abb56cfc-0003-4d1d-a94f-20a889058e15 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Getting quotas for user 4eda4b85484844ab8b424a1a42a97704 and project e2d79077c0654e55973512bc6d36a9e8. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:04:42.200181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-abb56cfc-0003-4d1d-a94f-20a889058e15 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052969 Jun 02 19:04:42.200781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 235/462] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:04:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:43.012997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:43.013709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:43.021631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:43.022217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:43.022992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:43.023429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:43.178605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:43.192739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:43.197107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:43.199033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bfbb6152-68c3-4142-9a48-88b8804b7c8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.190156 Jun 02 19:04:43.200648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 228/463] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:43.711548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1764497862", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fa5403b-35dd-490e-b179-061107594334"}], "security_groups": [{"name": "tempest-securitygroup--2088195453"}], "key_name": "tempest-keypair-762648889", "user_data": "}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:43.823190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] validate_networks() for [('7fa5403b-35dd-490e-b179-061107594334', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:04:44.223553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:44.224516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:44.231503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:44.232069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:44.232861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:44.233290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:44.273588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:04:44.274104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:04:44.274606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:04:44.275249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:04:44.275655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:04:44.285310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:44.285893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:44.287359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:44.287788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:44.313384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Getting quotas for project e2d79077c0654e55973512bc6d36a9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:04:44.319582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Getting quotas for user 4eda4b85484844ab8b424a1a42a97704 and project e2d79077c0654e55973512bc6d36a9e8. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:04:44.337760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:04:44.340055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:04:44.395668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:44.406372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5df6e744-94b1-46bc-8c5f-b1763164d9e6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.699457 Jun 02 19:04:44.407168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:44.414351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 236/464] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:04:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:04:44.414596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:44.414596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7d18c7e9-54ce-4159-9744-c22dd5ffe7dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.190675 Jun 02 19:04:44.414596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 229/465] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:44.424659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b1bdffba-ff29-4bec-989d-ef33a8fe7d53 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:44.425976 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b1bdffba-ff29-4bec-989d-ef33a8fe7d53 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:44.493560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b1bdffba-ff29-4bec-989d-ef33a8fe7d53 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:44.501719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b1bdffba-ff29-4bec-989d-ef33a8fe7d53 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1245 microversion: 2.1 time: 0.082469 Jun 02 19:04:44.502359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 237/466] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:44 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:45.436051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:45.436689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:45.443704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:45.444145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:45.444912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:45.445469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:45.524008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-995ea799-be53-4125-aca0-3dbe314ec49b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:45.525674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-995ea799-be53-4125-aca0-3dbe314ec49b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:45.537888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-995ea799-be53-4125-aca0-3dbe314ec49b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:45.538371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-995ea799-be53-4125-aca0-3dbe314ec49b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:45.539621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-995ea799-be53-4125-aca0-3dbe314ec49b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:45.540405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-995ea799-be53-4125-aca0-3dbe314ec49b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:45.610353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:45.619932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:45.621408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:45.622595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-42b950be-9cbe-450b-bb9f-81265e8c78b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.190652 Jun 02 19:04:45.623153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 230/467] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:45.632052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-995ea799-be53-4125-aca0-3dbe314ec49b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:45.640667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-995ea799-be53-4125-aca0-3dbe314ec49b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1249 microversion: 2.1 time: 0.124363 Jun 02 19:04:45.641240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 238/468] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:45 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1249 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:46.645633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:46.647237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:46.654490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:46.654849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:46.655687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:46.656119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:46.662187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4e66ebf1-569a-4190-82d0-7ae0e3394cd5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:46.663742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4e66ebf1-569a-4190-82d0-7ae0e3394cd5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:46.678076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e66ebf1-569a-4190-82d0-7ae0e3394cd5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:46.679171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e66ebf1-569a-4190-82d0-7ae0e3394cd5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:46.680511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e66ebf1-569a-4190-82d0-7ae0e3394cd5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:46.681389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e66ebf1-569a-4190-82d0-7ae0e3394cd5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:46.766252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4e66ebf1-569a-4190-82d0-7ae0e3394cd5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:46.776088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4e66ebf1-569a-4190-82d0-7ae0e3394cd5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1305 microversion: 2.1 time: 0.121118 Jun 02 19:04:46.776930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 239/469] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:46 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:46.843053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:46.853739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:46.855318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:46.856643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-27d193f6-0310-4882-a3f4-37915c4fc1a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.217661 Jun 02 19:04:46.857285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 231/470] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:47.799944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3e45cc6-bd87-4e1a-85d5-f218e9cafa2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:47.800500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f3e45cc6-bd87-4e1a-85d5-f218e9cafa2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:47.803129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:47.810081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3e45cc6-bd87-4e1a-85d5-f218e9cafa2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:47.810547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3e45cc6-bd87-4e1a-85d5-f218e9cafa2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:47.811332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3e45cc6-bd87-4e1a-85d5-f218e9cafa2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:47.811761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3e45cc6-bd87-4e1a-85d5-f218e9cafa2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:47.875601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:47.876207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:47.883508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:47.884206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:47.884774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:47.885206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:47.892109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f3e45cc6-bd87-4e1a-85d5-f218e9cafa2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:47.899384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f3e45cc6-bd87-4e1a-85d5-f218e9cafa2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1305 microversion: 2.1 time: 0.103891 Jun 02 19:04:47.900194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 240/471] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:47 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:48.035069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:48.047395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:48.048878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:48.050137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad24a527-3f97-4e4f-a6f7-62f1baf2a5f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.178373 Jun 02 19:04:48.050619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 232/472] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:48.548516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1a5a8386-8673-4c7f-b9e6-f4a5982ec9e2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:48.549542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1a5a8386-8673-4c7f-b9e6-f4a5982ec9e2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:48.556316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5a8386-8673-4c7f-b9e6-f4a5982ec9e2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:48.556769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5a8386-8673-4c7f-b9e6-f4a5982ec9e2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:48.557553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5a8386-8673-4c7f-b9e6-f4a5982ec9e2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:48.558105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5a8386-8673-4c7f-b9e6-f4a5982ec9e2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:48.639278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1a5a8386-8673-4c7f-b9e6-f4a5982ec9e2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/action" status: 202 len: 0 microversion: 2.1 time: 0.095185 Jun 02 19:04:48.639998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 241/473] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:04:48 2022] POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:04:48.648739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-845590a9-a0bb-4000-82b0-3320fb082f4a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:48.649346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-845590a9-a0bb-4000-82b0-3320fb082f4a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:48.655675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-845590a9-a0bb-4000-82b0-3320fb082f4a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:48.656120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-845590a9-a0bb-4000-82b0-3320fb082f4a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:48.656882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-845590a9-a0bb-4000-82b0-3320fb082f4a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:48.657309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-845590a9-a0bb-4000-82b0-3320fb082f4a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:48.672956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:48.836544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-845590a9-a0bb-4000-82b0-3320fb082f4a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:48.846269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-845590a9-a0bb-4000-82b0-3320fb082f4a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1747 microversion: 2.1 time: 0.201782 Jun 02 19:04:48.846835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 233/474] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1747 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:48.917159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3551469e-a70f-486c-8953-72506ef1db1a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:48.917928 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3551469e-a70f-486c-8953-72506ef1db1a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:48.924937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3551469e-a70f-486c-8953-72506ef1db1a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:48.925394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3551469e-a70f-486c-8953-72506ef1db1a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:48.926217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3551469e-a70f-486c-8953-72506ef1db1a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:48.926660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3551469e-a70f-486c-8953-72506ef1db1a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:48.942212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:48.996566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3551469e-a70f-486c-8953-72506ef1db1a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:49.004328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3551469e-a70f-486c-8953-72506ef1db1a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1305 microversion: 2.1 time: 0.091672 Jun 02 19:04:49.004898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 242/475] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:48 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:49.070150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:49.070782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:49.078978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:49.078978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:49.079585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:49.079946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:49.220508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:49.230302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:49.232017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:49.233565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5b948335-ad66-4cd4-9957-a9e5a71965ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1808 microversion: 2.20 time: 0.168113 Jun 02 19:04:49.234086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 234/476] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:49.864804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-33ffec05-a016-4ec7-8227-a70854ccf3fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:49.865420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-33ffec05-a016-4ec7-8227-a70854ccf3fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:49.872559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33ffec05-a016-4ec7-8227-a70854ccf3fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:49.873020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33ffec05-a016-4ec7-8227-a70854ccf3fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:49.873812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33ffec05-a016-4ec7-8227-a70854ccf3fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:49.874285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33ffec05-a016-4ec7-8227-a70854ccf3fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:50.020654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0cc5789b-9432-4cb6-9e0c-a6a850d78265 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:50.021264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0cc5789b-9432-4cb6-9e0c-a6a850d78265 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:50.028018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0cc5789b-9432-4cb6-9e0c-a6a850d78265 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:50.028454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0cc5789b-9432-4cb6-9e0c-a6a850d78265 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:50.029220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0cc5789b-9432-4cb6-9e0c-a6a850d78265 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:50.029644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0cc5789b-9432-4cb6-9e0c-a6a850d78265 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:50.044797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-33ffec05-a016-4ec7-8227-a70854ccf3fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:50.054665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-33ffec05-a016-4ec7-8227-a70854ccf3fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1747 microversion: 2.1 time: 0.193512 Jun 02 19:04:50.055880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 243/477] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1747 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:50.093775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0cc5789b-9432-4cb6-9e0c-a6a850d78265 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:50.101409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0cc5789b-9432-4cb6-9e0c-a6a850d78265 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1305 microversion: 2.1 time: 0.084635 Jun 02 19:04:50.102082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 235/478] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:50 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1305 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:50.253603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:50.254374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:50.261287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:50.262220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:50.263047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:50.263550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:50.496882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:50.507147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:50.508875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:50.510498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ab9b3c5c-5e91-43dc-ba5b-08878d890f64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1795 microversion: 2.20 time: 0.261508 Jun 02 19:04:50.511070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 244/479] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:04:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1795 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:04:51.072890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3f0631c-6345-4ea1-891b-1324643ad3ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:51.073603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c3f0631c-6345-4ea1-891b-1324643ad3ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:51.081271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3f0631c-6345-4ea1-891b-1324643ad3ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:51.081719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3f0631c-6345-4ea1-891b-1324643ad3ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:51.082543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3f0631c-6345-4ea1-891b-1324643ad3ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:51.082979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3f0631c-6345-4ea1-891b-1324643ad3ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:51.119336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bebe26fa-7724-455a-af60-c49ba8da8c8a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:51.120624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bebe26fa-7724-455a-af60-c49ba8da8c8a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:51.129925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bebe26fa-7724-455a-af60-c49ba8da8c8a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:51.130386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bebe26fa-7724-455a-af60-c49ba8da8c8a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:51.131149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bebe26fa-7724-455a-af60-c49ba8da8c8a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:51.132460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bebe26fa-7724-455a-af60-c49ba8da8c8a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:51.237989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bebe26fa-7724-455a-af60-c49ba8da8c8a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:51.246913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bebe26fa-7724-455a-af60-c49ba8da8c8a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1303 microversion: 2.1 time: 0.131354 Jun 02 19:04:51.247501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 245/480] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:51 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:51.319808 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c3f0631c-6345-4ea1-891b-1324643ad3ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:51.333788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3f0631c-6345-4ea1-891b-1324643ad3ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1747 microversion: 2.1 time: 0.264546 Jun 02 19:04:51.334479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 236/481] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1747 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:52.263923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b71510b5-73de-4530-8f6e-71e5c04dd32c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:52.264626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b71510b5-73de-4530-8f6e-71e5c04dd32c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:52.271483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b71510b5-73de-4530-8f6e-71e5c04dd32c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:52.271942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b71510b5-73de-4530-8f6e-71e5c04dd32c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:52.272723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b71510b5-73de-4530-8f6e-71e5c04dd32c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:52.273166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b71510b5-73de-4530-8f6e-71e5c04dd32c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:52.355592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8f6ba258-9684-4dc5-bfc7-46171462bbd2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:52.356206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8f6ba258-9684-4dc5-bfc7-46171462bbd2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:52.363439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f6ba258-9684-4dc5-bfc7-46171462bbd2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:52.363895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f6ba258-9684-4dc5-bfc7-46171462bbd2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:52.364677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f6ba258-9684-4dc5-bfc7-46171462bbd2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:52.365111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f6ba258-9684-4dc5-bfc7-46171462bbd2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:52.458156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b71510b5-73de-4530-8f6e-71e5c04dd32c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:52.466616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b71510b5-73de-4530-8f6e-71e5c04dd32c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.206527 Jun 02 19:04:52.467313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 246/482] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:52 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:52.546286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8f6ba258-9684-4dc5-bfc7-46171462bbd2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:52.557488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8f6ba258-9684-4dc5-bfc7-46171462bbd2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1747 microversion: 2.1 time: 0.206065 Jun 02 19:04:52.558430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 237/483] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1747 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:53.483710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2d57a31e-76b1-412a-a36f-1d21a7e7bb63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:53.484351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2d57a31e-76b1-412a-a36f-1d21a7e7bb63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:53.491145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d57a31e-76b1-412a-a36f-1d21a7e7bb63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:53.491608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d57a31e-76b1-412a-a36f-1d21a7e7bb63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:53.492379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d57a31e-76b1-412a-a36f-1d21a7e7bb63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:53.492818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d57a31e-76b1-412a-a36f-1d21a7e7bb63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:53.580596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1d886f57-7917-44fc-9d3b-d2e19fb67162 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:53.581212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1d886f57-7917-44fc-9d3b-d2e19fb67162 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:53.588791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d886f57-7917-44fc-9d3b-d2e19fb67162 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:53.589241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d886f57-7917-44fc-9d3b-d2e19fb67162 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:53.590031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d886f57-7917-44fc-9d3b-d2e19fb67162 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:53.590465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d886f57-7917-44fc-9d3b-d2e19fb67162 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:53.654091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2d57a31e-76b1-412a-a36f-1d21a7e7bb63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:53.661974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2d57a31e-76b1-412a-a36f-1d21a7e7bb63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.182135 Jun 02 19:04:53.662775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 247/484] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:53 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:53.763226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1d886f57-7917-44fc-9d3b-d2e19fb67162 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:53.771657 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1d886f57-7917-44fc-9d3b-d2e19fb67162 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1747 microversion: 2.1 time: 0.194948 Jun 02 19:04:53.772236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 238/485] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1747 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:54.687147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dad3c401-9519-4513-8547-eddc6af70046 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:54.687991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dad3c401-9519-4513-8547-eddc6af70046 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:54.690570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:54.691796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=12 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:54.699074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dad3c401-9519-4513-8547-eddc6af70046 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:54.699850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dad3c401-9519-4513-8547-eddc6af70046 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:54.700671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dad3c401-9519-4513-8547-eddc6af70046 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:54.701352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dad3c401-9519-4513-8547-eddc6af70046 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:54.797776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4eefd26a-c355-44aa-988f-e836d9ad9afa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:54.798782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4eefd26a-c355-44aa-988f-e836d9ad9afa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:54.812449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4eefd26a-c355-44aa-988f-e836d9ad9afa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:54.813057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4eefd26a-c355-44aa-988f-e836d9ad9afa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:54.813939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4eefd26a-c355-44aa-988f-e836d9ad9afa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:54.814578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4eefd26a-c355-44aa-988f-e836d9ad9afa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:54.990857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dad3c401-9519-4513-8547-eddc6af70046 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:55.000339 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dad3c401-9519-4513-8547-eddc6af70046 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.318760 Jun 02 19:04:55.001059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 248/486] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:54 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:55.062514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-518c1bee-9582-4e78-a02e-e40ab7febb9f req-18702fd0-507d-4b58-b7bc-0389dc03efef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55119d3-172d-4b7c-87ad-7423adea1aba", "tag": "029f6b36-13f6-4804-b5ae-07f754bd87bb"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:55.084434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-518c1bee-9582-4e78-a02e-e40ab7febb9f req-18702fd0-507d-4b58-b7bc-0389dc03efef service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:55.084972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-518c1bee-9582-4e78-a02e-e40ab7febb9f req-18702fd0-507d-4b58-b7bc-0389dc03efef service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:55.101005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-518c1bee-9582-4e78-a02e-e40ab7febb9f req-18702fd0-507d-4b58-b7bc-0389dc03efef service nova] Creating event network-changed:029f6b36-13f6-4804-b5ae-07f754bd87bb for instance d55119d3-172d-4b7c-87ad-7423adea1aba on hv-cinder-79760 Jun 02 19:04:55.107301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-518c1bee-9582-4e78-a02e-e40ab7febb9f req-18702fd0-507d-4b58-b7bc-0389dc03efef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050672 Jun 02 19:04:55.108400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 249/487] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:04:55.156590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4eefd26a-c355-44aa-988f-e836d9ad9afa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:55.165613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4eefd26a-c355-44aa-988f-e836d9ad9afa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.379412 Jun 02 19:04:55.170409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 239/488] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:55.778984 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905704535", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2119598037", "security_groups": [{"name": "tempest-secgroup-smoke-1200134340"}], "block_device_mapping_v2": [{"uuid": "fce58c0f-d1f9-4796-ba19-0fdf7c28575a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6064eca4-5613-4af6-96db-526e4ffae33e"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:04:55.911518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] validate_networks() for [('6064eca4-5613-4af6-96db-526e4ffae33e', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:04:56.018012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e6a48992-990f-49aa-9a80-50a5266e8e7b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:56.018585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e6a48992-990f-49aa-9a80-50a5266e8e7b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:56.025829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e6a48992-990f-49aa-9a80-50a5266e8e7b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:56.026285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e6a48992-990f-49aa-9a80-50a5266e8e7b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:56.027092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e6a48992-990f-49aa-9a80-50a5266e8e7b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:56.027520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e6a48992-990f-49aa-9a80-50a5266e8e7b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:56.268068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e6a48992-990f-49aa-9a80-50a5266e8e7b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:56.276576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e6a48992-990f-49aa-9a80-50a5266e8e7b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.262486 Jun 02 19:04:56.277163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 240/489] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:56 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:56.281732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b12acb3f-81f3-459f-b529-b82b8dca7847 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:56.282370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b12acb3f-81f3-459f-b529-b82b8dca7847 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:56.288530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b12acb3f-81f3-459f-b529-b82b8dca7847 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:56.288982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b12acb3f-81f3-459f-b529-b82b8dca7847 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:56.289753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b12acb3f-81f3-459f-b529-b82b8dca7847 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:56.290631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b12acb3f-81f3-459f-b529-b82b8dca7847 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:56.664146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:04:56.664780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:04:56.665406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:04:56.665651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:04:56.666256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:04:56.676319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:56.676891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:56.677700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:56.678246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:56.697894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Getting quotas for project 01f30f060e2444f9a2238c4c447c7dbd. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:04:56.702841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Getting quotas for user f54c975b432a4678a5624ad5c9f54b74 and project 01f30f060e2444f9a2238c4c447c7dbd. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:04:56.718706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b12acb3f-81f3-459f-b529-b82b8dca7847 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:56.729984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b12acb3f-81f3-459f-b529-b82b8dca7847 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.451744 Jun 02 19:04:56.730585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 241/490] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:56.765781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:04:56.768029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fce58c0f-d1f9-4796-ba19-0fdf7c28575a',volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:04:56.913323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-24cd3be5-bc79-43fa-9696-fe6c59c5683f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.138841 Jun 02 19:04:56.914334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 250/491] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:04:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 19:04:56.924238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5cb7868e-e5b8-4898-8ca4-93b10926afb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:56.925175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5cb7868e-e5b8-4898-8ca4-93b10926afb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:56.997061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5cb7868e-e5b8-4898-8ca4-93b10926afb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:57.005292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5cb7868e-e5b8-4898-8ca4-93b10926afb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1095 microversion: 2.1 time: 0.084889 Jun 02 19:04:57.005831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 242/492] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:56 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:57.294742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-343b9ae7-5d08-43dd-8220-3570fc6ce56b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:57.295367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-343b9ae7-5d08-43dd-8220-3570fc6ce56b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:57.304350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-343b9ae7-5d08-43dd-8220-3570fc6ce56b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:57.304801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-343b9ae7-5d08-43dd-8220-3570fc6ce56b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:57.305834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-343b9ae7-5d08-43dd-8220-3570fc6ce56b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:57.306471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-343b9ae7-5d08-43dd-8220-3570fc6ce56b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:57.486761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-343b9ae7-5d08-43dd-8220-3570fc6ce56b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:57.496527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-343b9ae7-5d08-43dd-8220-3570fc6ce56b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.206547 Jun 02 19:04:57.497112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 251/493] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:57 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:57.747694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-27cee0fa-0163-477a-8fb6-a344f41165b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:57.748269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-27cee0fa-0163-477a-8fb6-a344f41165b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:57.755434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27cee0fa-0163-477a-8fb6-a344f41165b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:57.755879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27cee0fa-0163-477a-8fb6-a344f41165b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:57.756677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27cee0fa-0163-477a-8fb6-a344f41165b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:57.757100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27cee0fa-0163-477a-8fb6-a344f41165b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:57.906433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-27cee0fa-0163-477a-8fb6-a344f41165b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:57.914500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-27cee0fa-0163-477a-8fb6-a344f41165b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.170856 Jun 02 19:04:57.915057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 243/494] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:58.022624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b32db668-d0d7-4008-ae81-30e0aa0e402f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:58.023175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b32db668-d0d7-4008-ae81-30e0aa0e402f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:58.032301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b32db668-d0d7-4008-ae81-30e0aa0e402f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:58.032873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b32db668-d0d7-4008-ae81-30e0aa0e402f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:58.033688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b32db668-d0d7-4008-ae81-30e0aa0e402f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:58.034149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b32db668-d0d7-4008-ae81-30e0aa0e402f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:58.144485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b32db668-d0d7-4008-ae81-30e0aa0e402f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:58.163221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b32db668-d0d7-4008-ae81-30e0aa0e402f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1201 microversion: 2.1 time: 0.144519 Jun 02 19:04:58.164170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 252/495] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:58 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1201 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:58.349831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d269d6fb-a9bf-47eb-9167-eb8081513dc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:58.350443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d269d6fb-a9bf-47eb-9167-eb8081513dc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:58.362761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d269d6fb-a9bf-47eb-9167-eb8081513dc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:58.363456 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d269d6fb-a9bf-47eb-9167-eb8081513dc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:58.364714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d269d6fb-a9bf-47eb-9167-eb8081513dc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:58.365500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d269d6fb-a9bf-47eb-9167-eb8081513dc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:58.502875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-d269d6fb-a9bf-47eb-9167-eb8081513dc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lazy-loading 'services' on Instance uuid 6aaab800-95de-43b9-972d-b65ccd2a7ec6 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:04:58.512837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ed9d398d-0617-475e-8e9b-1b5cbda15425 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:58.514398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ed9d398d-0617-475e-8e9b-1b5cbda15425 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:58.520714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed9d398d-0617-475e-8e9b-1b5cbda15425 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:58.521716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed9d398d-0617-475e-8e9b-1b5cbda15425 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:58.522534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed9d398d-0617-475e-8e9b-1b5cbda15425 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:58.523062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed9d398d-0617-475e-8e9b-1b5cbda15425 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:58.633952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d269d6fb-a9bf-47eb-9167-eb8081513dc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6/os-volume_attachments/558384e3-596a-48e1-a452-43472980d424" status: 202 len: 0 microversion: 2.1 time: 0.287828 Jun 02 19:04:58.635059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 244/496] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:04:58 2022] DELETE /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6/os-volume_attachments/558384e3-596a-48e1-a452-43472980d424 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:04:58.755693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ed9d398d-0617-475e-8e9b-1b5cbda15425 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:58.775254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ed9d398d-0617-475e-8e9b-1b5cbda15425 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.266264 Jun 02 19:04:58.776943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 253/497] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:58 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:58.932507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d669a0c1-4796-4a41-a6cb-b5413edd0e5e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:58.933369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d669a0c1-4796-4a41-a6cb-b5413edd0e5e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:58.940479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d669a0c1-4796-4a41-a6cb-b5413edd0e5e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:58.940922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d669a0c1-4796-4a41-a6cb-b5413edd0e5e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:58.941685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d669a0c1-4796-4a41-a6cb-b5413edd0e5e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:58.942152 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d669a0c1-4796-4a41-a6cb-b5413edd0e5e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:59.165619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d669a0c1-4796-4a41-a6cb-b5413edd0e5e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:59.174643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d669a0c1-4796-4a41-a6cb-b5413edd0e5e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.247191 Jun 02 19:04:59.175187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 245/498] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:04:59.180710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-95467c0d-2e2d-4ada-96a0-e28de5d819cf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:59.181390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-95467c0d-2e2d-4ada-96a0-e28de5d819cf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:59.189102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95467c0d-2e2d-4ada-96a0-e28de5d819cf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:59.189857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95467c0d-2e2d-4ada-96a0-e28de5d819cf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:59.190955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95467c0d-2e2d-4ada-96a0-e28de5d819cf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:59.191546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95467c0d-2e2d-4ada-96a0-e28de5d819cf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:59.328018 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-95467c0d-2e2d-4ada-96a0-e28de5d819cf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:04:59.338949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-95467c0d-2e2d-4ada-96a0-e28de5d819cf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1279 microversion: 2.1 time: 0.162192 Jun 02 19:04:59.339516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 254/499] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:59 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:04:59.794828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0d685866-231d-4036-bf7f-c040ece02137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:04:59.795412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0d685866-231d-4036-bf7f-c040ece02137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:04:59.805555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d685866-231d-4036-bf7f-c040ece02137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:59.806777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d685866-231d-4036-bf7f-c040ece02137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:04:59.808135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d685866-231d-4036-bf7f-c040ece02137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:04:59.808916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d685866-231d-4036-bf7f-c040ece02137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.033913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0d685866-231d-4036-bf7f-c040ece02137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:00.042167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0d685866-231d-4036-bf7f-c040ece02137 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.251162 Jun 02 19:05:00.042753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 246/500] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:04:59 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:00.193631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e37fce71-3a20-41a3-89bd-ee890e1ed2d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:00.194565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e37fce71-3a20-41a3-89bd-ee890e1ed2d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:00.207343 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e37fce71-3a20-41a3-89bd-ee890e1ed2d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.207903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e37fce71-3a20-41a3-89bd-ee890e1ed2d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.208968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e37fce71-3a20-41a3-89bd-ee890e1ed2d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.209903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e37fce71-3a20-41a3-89bd-ee890e1ed2d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.327498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-49f4e175-5971-41cf-91a5-28739ff3f8b7 req-33612f2b-a03a-4c39-a291-3b83aafdebcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55119d3-172d-4b7c-87ad-7423adea1aba", "name": "network-vif-plugged", "status": "completed", "tag": "029f6b36-13f6-4804-b5ae-07f754bd87bb"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:00.341297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-49f4e175-5971-41cf-91a5-28739ff3f8b7 req-33612f2b-a03a-4c39-a291-3b83aafdebcd service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.341817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-49f4e175-5971-41cf-91a5-28739ff3f8b7 req-33612f2b-a03a-4c39-a291-3b83aafdebcd service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.359071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-49f4e175-5971-41cf-91a5-28739ff3f8b7 req-33612f2b-a03a-4c39-a291-3b83aafdebcd service nova] Creating event network-vif-plugged:029f6b36-13f6-4804-b5ae-07f754bd87bb for instance d55119d3-172d-4b7c-87ad-7423adea1aba on hv-cinder-79760 Jun 02 19:05:00.365458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-49f4e175-5971-41cf-91a5-28739ff3f8b7 req-33612f2b-a03a-4c39-a291-3b83aafdebcd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043714 Jun 02 19:05:00.366603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 247/501] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:00.373103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-be6e96f8-17f6-42ad-845a-d080189d7f29 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:00.373786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-be6e96f8-17f6-42ad-845a-d080189d7f29 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:00.395909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be6e96f8-17f6-42ad-845a-d080189d7f29 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.398822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be6e96f8-17f6-42ad-845a-d080189d7f29 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.400134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be6e96f8-17f6-42ad-845a-d080189d7f29 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.400744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be6e96f8-17f6-42ad-845a-d080189d7f29 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.521672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e37fce71-3a20-41a3-89bd-ee890e1ed2d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:00.532136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e37fce71-3a20-41a3-89bd-ee890e1ed2d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.342586 Jun 02 19:05:00.533860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 255/502] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:00.541106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-a1ef89af-9b36-4894-8a47-4b49378cf80d req-af4e3b23-7728-4b7f-aeab-380843a0f2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0a9be2-f2c0-4fa4-919b-44afcbdbae67", "tag": "93850d4b-abd8-487e-8508-5f0e1963d248"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:00.552448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-a1ef89af-9b36-4894-8a47-4b49378cf80d req-af4e3b23-7728-4b7f-aeab-380843a0f2a6 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.553624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-a1ef89af-9b36-4894-8a47-4b49378cf80d req-af4e3b23-7728-4b7f-aeab-380843a0f2a6 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.567515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-a1ef89af-9b36-4894-8a47-4b49378cf80d req-af4e3b23-7728-4b7f-aeab-380843a0f2a6 service nova] Creating event network-changed:93850d4b-abd8-487e-8508-5f0e1963d248 for instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 on hv-cinder-79760 Jun 02 19:05:00.572715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-a1ef89af-9b36-4894-8a47-4b49378cf80d req-af4e3b23-7728-4b7f-aeab-380843a0f2a6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037269 Jun 02 19:05:00.573335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 256/503] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:00.685718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-be6e96f8-17f6-42ad-845a-d080189d7f29 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:00.694249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-be6e96f8-17f6-42ad-845a-d080189d7f29 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.326331 Jun 02 19:05:00.695297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 248/504] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:00 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:00.838437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7714c584-c343-49f3-88c1-769754227dbd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:00.839146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7714c584-c343-49f3-88c1-769754227dbd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:00.845876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7714c584-c343-49f3-88c1-769754227dbd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.846328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7714c584-c343-49f3-88c1-769754227dbd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.847096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7714c584-c343-49f3-88c1-769754227dbd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.847532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7714c584-c343-49f3-88c1-769754227dbd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.875345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7714c584-c343-49f3-88c1-769754227dbd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:05:00.959107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7714c584-c343-49f3-88c1-769754227dbd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 204 len: 0 microversion: 2.1 time: 0.125052 Jun 02 19:05:00.959601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 257/505] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:05:00 2022] DELETE /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:05:00.968048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8601df57-c8df-42cc-9d99-ce7aec491788 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:00.968652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8601df57-c8df-42cc-9d99-ce7aec491788 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:00.975431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8601df57-c8df-42cc-9d99-ce7aec491788 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.975847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8601df57-c8df-42cc-9d99-ce7aec491788 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:00.976600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8601df57-c8df-42cc-9d99-ce7aec491788 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:00.977031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8601df57-c8df-42cc-9d99-ce7aec491788 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:01.067279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dbb51d03-ad4f-49ac-b401-d4e765343214 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:01.068002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dbb51d03-ad4f-49ac-b401-d4e765343214 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:01.074863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbb51d03-ad4f-49ac-b401-d4e765343214 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:01.075316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbb51d03-ad4f-49ac-b401-d4e765343214 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:01.076105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbb51d03-ad4f-49ac-b401-d4e765343214 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:01.076567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbb51d03-ad4f-49ac-b401-d4e765343214 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:01.213570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8601df57-c8df-42cc-9d99-ce7aec491788 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:01.222154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8601df57-c8df-42cc-9d99-ce7aec491788 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1514 microversion: 2.1 time: 0.257843 Jun 02 19:05:01.222735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 249/506] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:00 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:01.251331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dbb51d03-ad4f-49ac-b401-d4e765343214 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:01.259538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dbb51d03-ad4f-49ac-b401-d4e765343214 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.196444 Jun 02 19:05:01.260124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 258/507] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:01 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:01.551883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-117c9c62-7611-4848-a8d2-4571f020aca6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:01.552499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-117c9c62-7611-4848-a8d2-4571f020aca6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:01.559023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-117c9c62-7611-4848-a8d2-4571f020aca6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:01.559485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-117c9c62-7611-4848-a8d2-4571f020aca6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:01.560257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-117c9c62-7611-4848-a8d2-4571f020aca6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:01.560695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-117c9c62-7611-4848-a8d2-4571f020aca6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:01.710931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-117c9c62-7611-4848-a8d2-4571f020aca6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:01.712292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-26647911-922d-4eef-97aa-d953ebe6ca27 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:01.712932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-26647911-922d-4eef-97aa-d953ebe6ca27 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:01.719578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-26647911-922d-4eef-97aa-d953ebe6ca27 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:01.720034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-26647911-922d-4eef-97aa-d953ebe6ca27 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:01.720186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-117c9c62-7611-4848-a8d2-4571f020aca6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.172113 Jun 02 19:05:01.720732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 250/508] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:01.720872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-26647911-922d-4eef-97aa-d953ebe6ca27 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:01.721267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-26647911-922d-4eef-97aa-d953ebe6ca27 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:01.737415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:01.859195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-26647911-922d-4eef-97aa-d953ebe6ca27 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:01.867120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-26647911-922d-4eef-97aa-d953ebe6ca27 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.158708 Jun 02 19:05:01.867697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 259/509] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:01 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:02.239605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b955b6de-cd0a-4da0-b82e-e28c5596c83b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:02.240263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b955b6de-cd0a-4da0-b82e-e28c5596c83b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:02.247419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b955b6de-cd0a-4da0-b82e-e28c5596c83b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:02.247868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b955b6de-cd0a-4da0-b82e-e28c5596c83b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:02.248640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b955b6de-cd0a-4da0-b82e-e28c5596c83b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:02.249099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b955b6de-cd0a-4da0-b82e-e28c5596c83b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:02.251898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:02.276588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-06f4627c-8c0a-40b5-8e64-a3b94fe1f764 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:02.277231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-06f4627c-8c0a-40b5-8e64-a3b94fe1f764 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:02.284279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06f4627c-8c0a-40b5-8e64-a3b94fe1f764 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:02.284733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06f4627c-8c0a-40b5-8e64-a3b94fe1f764 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:02.285509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06f4627c-8c0a-40b5-8e64-a3b94fe1f764 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:02.285984 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06f4627c-8c0a-40b5-8e64-a3b94fe1f764 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:02.448464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b955b6de-cd0a-4da0-b82e-e28c5596c83b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:02.457237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b955b6de-cd0a-4da0-b82e-e28c5596c83b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1514 microversion: 2.1 time: 0.221478 Jun 02 19:05:02.457842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 251/510] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:02 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:02.474051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-06f4627c-8c0a-40b5-8e64-a3b94fe1f764 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:02.482597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-06f4627c-8c0a-40b5-8e64-a3b94fe1f764 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.209884 Jun 02 19:05:02.483189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 260/511] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:02 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:02.746516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cffff6da-3c64-4d39-99dc-2defa11c822d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:02.747023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cffff6da-3c64-4d39-99dc-2defa11c822d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:02.753613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cffff6da-3c64-4d39-99dc-2defa11c822d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:02.754102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cffff6da-3c64-4d39-99dc-2defa11c822d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:02.754863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cffff6da-3c64-4d39-99dc-2defa11c822d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:02.755292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cffff6da-3c64-4d39-99dc-2defa11c822d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:02.886409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-da3421c6-d3b6-4686-98bc-64414666ef82 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:02.887062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-da3421c6-d3b6-4686-98bc-64414666ef82 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:02.893609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da3421c6-d3b6-4686-98bc-64414666ef82 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:02.894234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da3421c6-d3b6-4686-98bc-64414666ef82 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:02.895040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da3421c6-d3b6-4686-98bc-64414666ef82 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:02.895481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da3421c6-d3b6-4686-98bc-64414666ef82 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:02.910944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cffff6da-3c64-4d39-99dc-2defa11c822d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:02.919231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cffff6da-3c64-4d39-99dc-2defa11c822d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.177019 Jun 02 19:05:02.920017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 252/512] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:03.037312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-da3421c6-d3b6-4686-98bc-64414666ef82 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:03.045590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-da3421c6-d3b6-4686-98bc-64414666ef82 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.163641 Jun 02 19:05:03.046205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 261/513] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:02 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:03.474934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea56db1d-2d73-4811-b9a8-6a505923e7ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:03.475737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ea56db1d-2d73-4811-b9a8-6a505923e7ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:03.482849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea56db1d-2d73-4811-b9a8-6a505923e7ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:03.483283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea56db1d-2d73-4811-b9a8-6a505923e7ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:03.484070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea56db1d-2d73-4811-b9a8-6a505923e7ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:03.484492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea56db1d-2d73-4811-b9a8-6a505923e7ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:03.499328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f0e4b65c-87c1-4e91-9614-cacc5cb8f31f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:03.499951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f0e4b65c-87c1-4e91-9614-cacc5cb8f31f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:03.507603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0e4b65c-87c1-4e91-9614-cacc5cb8f31f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:03.508061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0e4b65c-87c1-4e91-9614-cacc5cb8f31f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:03.508861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0e4b65c-87c1-4e91-9614-cacc5cb8f31f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:03.509911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0e4b65c-87c1-4e91-9614-cacc5cb8f31f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:03.725146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ea56db1d-2d73-4811-b9a8-6a505923e7ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:03.729054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f0e4b65c-87c1-4e91-9614-cacc5cb8f31f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:03.734049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ea56db1d-2d73-4811-b9a8-6a505923e7ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1514 microversion: 2.1 time: 0.262938 Jun 02 19:05:03.734663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 253/514] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:03 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:03.737131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f0e4b65c-87c1-4e91-9614-cacc5cb8f31f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1371 microversion: 2.1 time: 0.241663 Jun 02 19:05:03.737709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 262/515] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:03 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:03.937233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-440b10f5-b70b-474b-9834-e69c8f66e0d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:03.937822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-440b10f5-b70b-474b-9834-e69c8f66e0d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:03.944269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-440b10f5-b70b-474b-9834-e69c8f66e0d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:03.944724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-440b10f5-b70b-474b-9834-e69c8f66e0d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:03.945486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-440b10f5-b70b-474b-9834-e69c8f66e0d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:03.945958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-440b10f5-b70b-474b-9834-e69c8f66e0d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:04.062882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e0b6cb6e-e426-444d-b96b-fffd29fa0b01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:04.063496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e0b6cb6e-e426-444d-b96b-fffd29fa0b01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:04.069780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0b6cb6e-e426-444d-b96b-fffd29fa0b01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:04.070272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0b6cb6e-e426-444d-b96b-fffd29fa0b01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:04.071055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0b6cb6e-e426-444d-b96b-fffd29fa0b01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:04.071554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0b6cb6e-e426-444d-b96b-fffd29fa0b01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:04.105551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-440b10f5-b70b-474b-9834-e69c8f66e0d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:04.114329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-440b10f5-b70b-474b-9834-e69c8f66e0d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.181171 Jun 02 19:05:04.115033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 254/516] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:04.208864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e0b6cb6e-e426-444d-b96b-fffd29fa0b01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:04.216774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e0b6cb6e-e426-444d-b96b-fffd29fa0b01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.157818 Jun 02 19:05:04.217346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 263/517] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:04 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:04.754441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e8eb7aa6-c5e4-4934-a553-e55a419a2b93 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:04.755774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e8eb7aa6-c5e4-4934-a553-e55a419a2b93 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:04.757378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-710d913b-84e2-4e85-9372-a27d97391813 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:04.758301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-710d913b-84e2-4e85-9372-a27d97391813 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:04.764274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8eb7aa6-c5e4-4934-a553-e55a419a2b93 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:04.765047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8eb7aa6-c5e4-4934-a553-e55a419a2b93 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:04.766095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8eb7aa6-c5e4-4934-a553-e55a419a2b93 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:04.766724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8eb7aa6-c5e4-4934-a553-e55a419a2b93 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:04.767302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-710d913b-84e2-4e85-9372-a27d97391813 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:04.767832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-710d913b-84e2-4e85-9372-a27d97391813 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:04.768879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-710d913b-84e2-4e85-9372-a27d97391813 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:04.769541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-710d913b-84e2-4e85-9372-a27d97391813 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:05.083016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-710d913b-84e2-4e85-9372-a27d97391813 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:05.092471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-710d913b-84e2-4e85-9372-a27d97391813 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 200 len: 1472 microversion: 2.1 time: 0.339035 Jun 02 19:05:05.102382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 264/518] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:04 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:05.102382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-a356c55a-f3e5-494c-9869-eedc4fc6ad5c req-795d70a9-7fd1-4660-8ffb-a9ca51e141c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaab800-95de-43b9-972d-b65ccd2a7ec6", "name": "network-vif-deleted", "tag": "a498d4bf-e238-41a8-aeab-abeda8df24c7"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:05.106481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-a356c55a-f3e5-494c-9869-eedc4fc6ad5c req-795d70a9-7fd1-4660-8ffb-a9ca51e141c8 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:05.106937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-a356c55a-f3e5-494c-9869-eedc4fc6ad5c req-795d70a9-7fd1-4660-8ffb-a9ca51e141c8 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:05.119926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-a356c55a-f3e5-494c-9869-eedc4fc6ad5c req-795d70a9-7fd1-4660-8ffb-a9ca51e141c8 service nova] Creating event network-vif-deleted:a498d4bf-e238-41a8-aeab-abeda8df24c7 for instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 on hv-cinder-79760 Jun 02 19:05:05.124162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-a356c55a-f3e5-494c-9869-eedc4fc6ad5c req-795d70a9-7fd1-4660-8ffb-a9ca51e141c8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029956 Jun 02 19:05:05.124927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 265/519] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:05.132787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0000df8d-ffaf-45af-9404-41458f1bb841 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:05.133516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0000df8d-ffaf-45af-9404-41458f1bb841 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:05.141127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0000df8d-ffaf-45af-9404-41458f1bb841 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:05.141580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0000df8d-ffaf-45af-9404-41458f1bb841 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:05.142389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0000df8d-ffaf-45af-9404-41458f1bb841 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:05.142825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0000df8d-ffaf-45af-9404-41458f1bb841 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:05.175661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e8eb7aa6-c5e4-4934-a553-e55a419a2b93 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:05.184000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e8eb7aa6-c5e4-4934-a553-e55a419a2b93 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1565 microversion: 2.1 time: 0.433661 Jun 02 19:05:05.184595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 255/520] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:04 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1565 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:05.201180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-598328d1-20de-4738-9263-7a9690046ef8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:05.201663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-598328d1-20de-4738-9263-7a9690046ef8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:05.207936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-598328d1-20de-4738-9263-7a9690046ef8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:05.208379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-598328d1-20de-4738-9263-7a9690046ef8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:05.209149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-598328d1-20de-4738-9263-7a9690046ef8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:05.209571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-598328d1-20de-4738-9263-7a9690046ef8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:05.316164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-598328d1-20de-4738-9263-7a9690046ef8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119324 Jun 02 19:05:05.316764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 256/521] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Jun 2 19:05:05 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:05:05.322361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f25fb8b1-0ca3-416d-9793-9d78f7130af0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:05.322829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f25fb8b1-0ca3-416d-9793-9d78f7130af0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:05.329603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f25fb8b1-0ca3-416d-9793-9d78f7130af0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:05.330085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f25fb8b1-0ca3-416d-9793-9d78f7130af0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:05.330863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f25fb8b1-0ca3-416d-9793-9d78f7130af0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:05.331485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f25fb8b1-0ca3-416d-9793-9d78f7130af0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:05.335770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0000df8d-ffaf-45af-9404-41458f1bb841 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:05.344221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0000df8d-ffaf-45af-9404-41458f1bb841 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.215592 Jun 02 19:05:05.345009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 266/522] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:05:05.588611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f25fb8b1-0ca3-416d-9793-9d78f7130af0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:05.596528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f25fb8b1-0ca3-416d-9793-9d78f7130af0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.278489 Jun 02 19:05:05.601596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 257/523] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:05 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:06.110849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:06.111428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 6aaab800-95de-43b9-972d-b65ccd2a7ec6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:06.118571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:06.119151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:06.120112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:06.120559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:06.134742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] HTTP exception thrown: Instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 could not be found. Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Request method failure captured: Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 HTTP/1.1 Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQmJCntEs0UlPtC_rP0kiTT0FDR3FEvaC7SuHwz5mcMRJwuXnEHFwYhKuXzJpygudeuIe988fO3d8tnjGSXIAyysJ1Uw50mO6bi-QvZR42ofapozonBIAeXVYtWs3a-z6SF4ukCpoa0WH_kOov-bCFEqmwJdNRqmjw1ZN7udTwvt3Ho Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:05:06.136444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 5c5875c5cba841a28560a475bb18d595 Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 could not be found. Jun 02 19:05:06.137829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '6aaab800-95de-43b9-972d-b65ccd2a7ec6'} Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 could not be found. Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:05:06.138978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 could not be found. Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 could not be found. Jun 02 19:05:06.140197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:06.141294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Returning 404 to user: Instance 6aaab800-95de-43b9-972d-b65ccd2a7ec6 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:05:06.141294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4f029f6c-0c73-4227-910f-c94adf14518d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6" status: 404 len: 111 microversion: 2.1 time: 0.031573 Jun 02 19:05:06.141294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 267/524] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:06 2022] GET /compute/v2.1/servers/6aaab800-95de-43b9-972d-b65ccd2a7ec6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:05:06.363180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e42829b5-5dbc-4f7a-8420-7e89ecb98afe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:06.364432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e42829b5-5dbc-4f7a-8420-7e89ecb98afe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:06.372117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e42829b5-5dbc-4f7a-8420-7e89ecb98afe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:06.372677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e42829b5-5dbc-4f7a-8420-7e89ecb98afe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:06.373613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e42829b5-5dbc-4f7a-8420-7e89ecb98afe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:06.374058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e42829b5-5dbc-4f7a-8420-7e89ecb98afe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:06.519733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e42829b5-5dbc-4f7a-8420-7e89ecb98afe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:06.528939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e42829b5-5dbc-4f7a-8420-7e89ecb98afe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.169655 Jun 02 19:05:06.534092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 258/525] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:06.612831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-25745479-5e7a-4c88-9e13-23bae11fa482 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:06.613596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-25745479-5e7a-4c88-9e13-23bae11fa482 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:06.620419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25745479-5e7a-4c88-9e13-23bae11fa482 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:06.620841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25745479-5e7a-4c88-9e13-23bae11fa482 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:06.621735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25745479-5e7a-4c88-9e13-23bae11fa482 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:06.622232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25745479-5e7a-4c88-9e13-23bae11fa482 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:06.686772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:06.711072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:06.770455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-25745479-5e7a-4c88-9e13-23bae11fa482 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:06.778935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-25745479-5e7a-4c88-9e13-23bae11fa482 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.170038 Jun 02 19:05:06.779505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 268/526] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:06 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:07.139228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-8481e982-30c5-4540-99a1-22d6a9842d2b req-56a420df-1a28-431f-bab8-21fccaf05652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55119d3-172d-4b7c-87ad-7423adea1aba", "tag": "029f6b36-13f6-4804-b5ae-07f754bd87bb"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:07.143016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:07.149319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-8481e982-30c5-4540-99a1-22d6a9842d2b req-56a420df-1a28-431f-bab8-21fccaf05652 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:07.149758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-8481e982-30c5-4540-99a1-22d6a9842d2b req-56a420df-1a28-431f-bab8-21fccaf05652 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:07.164551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-8481e982-30c5-4540-99a1-22d6a9842d2b req-56a420df-1a28-431f-bab8-21fccaf05652 service nova] Creating event network-changed:029f6b36-13f6-4804-b5ae-07f754bd87bb for instance d55119d3-172d-4b7c-87ad-7423adea1aba on hv-cinder-79760 Jun 02 19:05:07.170336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-8481e982-30c5-4540-99a1-22d6a9842d2b req-56a420df-1a28-431f-bab8-21fccaf05652 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034642 Jun 02 19:05:07.170946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 259/527] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:07.546258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3c1be156-3b7d-4c10-a4e3-a26d92eae623 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:07.546841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3c1be156-3b7d-4c10-a4e3-a26d92eae623 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:07.553827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c1be156-3b7d-4c10-a4e3-a26d92eae623 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:07.554302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c1be156-3b7d-4c10-a4e3-a26d92eae623 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:07.555066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c1be156-3b7d-4c10-a4e3-a26d92eae623 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:07.555499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c1be156-3b7d-4c10-a4e3-a26d92eae623 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:07.718723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3c1be156-3b7d-4c10-a4e3-a26d92eae623 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:07.730766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3c1be156-3b7d-4c10-a4e3-a26d92eae623 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.188245 Jun 02 19:05:07.731632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 269/528] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:07.797281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-de15f829-8233-45a2-ae00-8b80e1010920 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:07.797869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-de15f829-8233-45a2-ae00-8b80e1010920 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:07.804630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de15f829-8233-45a2-ae00-8b80e1010920 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:07.805077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de15f829-8233-45a2-ae00-8b80e1010920 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:07.805823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de15f829-8233-45a2-ae00-8b80e1010920 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:07.806304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de15f829-8233-45a2-ae00-8b80e1010920 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:07.948911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-de15f829-8233-45a2-ae00-8b80e1010920 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:07.957105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-de15f829-8233-45a2-ae00-8b80e1010920 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.164710 Jun 02 19:05:07.957667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 260/529] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:07 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:08.753008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bfdd0c53-6611-4074-87cc-751f3d3ce982 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:08.753631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bfdd0c53-6611-4074-87cc-751f3d3ce982 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:08.760664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfdd0c53-6611-4074-87cc-751f3d3ce982 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:08.761114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfdd0c53-6611-4074-87cc-751f3d3ce982 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:08.761918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfdd0c53-6611-4074-87cc-751f3d3ce982 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:08.762361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfdd0c53-6611-4074-87cc-751f3d3ce982 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:08.927302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bfdd0c53-6611-4074-87cc-751f3d3ce982 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:08.935484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bfdd0c53-6611-4074-87cc-751f3d3ce982 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.186727 Jun 02 19:05:08.936083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 270/530] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:08.974978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd702fe2-f97f-44ed-bbb8-fef1364439ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:08.975603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bd702fe2-f97f-44ed-bbb8-fef1364439ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:08.978293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=78 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:08.983461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd702fe2-f97f-44ed-bbb8-fef1364439ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:08.983815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd702fe2-f97f-44ed-bbb8-fef1364439ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:08.984574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd702fe2-f97f-44ed-bbb8-fef1364439ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:08.985003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd702fe2-f97f-44ed-bbb8-fef1364439ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.142035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bd702fe2-f97f-44ed-bbb8-fef1364439ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:09.150107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bd702fe2-f97f-44ed-bbb8-fef1364439ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.178866 Jun 02 19:05:09.150803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 261/531] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:08 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:09.170508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f6c5152e-ae12-47bb-b26f-655cebb4c5cc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:09.171004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f6c5152e-ae12-47bb-b26f-655cebb4c5cc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:09.177312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6c5152e-ae12-47bb-b26f-655cebb4c5cc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.177766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6c5152e-ae12-47bb-b26f-655cebb4c5cc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.178560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6c5152e-ae12-47bb-b26f-655cebb4c5cc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.178993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6c5152e-ae12-47bb-b26f-655cebb4c5cc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.205058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f6c5152e-ae12-47bb-b26f-655cebb4c5cc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20/ips" status: 200 len: 150 microversion: 2.1 time: 0.039145 Jun 02 19:05:09.205625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 271/532] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:05:09 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:09.217337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77197eb9-d3d2-4d14-950a-aac26709c4fa"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:09.218446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:09.224802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.225244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.226060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.226494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.311802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Invalid volume: volume 77197eb9-d3d2-4d14-950a-aac26709c4fa is already attached to instances: 0cada17e-c4a7-434f-adc8-fea531c47cd8 Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: POST /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20/os-volume_attachments HTTP/1.1 Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 74 Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:05:09.313538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {"volumeAttachment": {"volumeId": "77197eb9-d3d2-4d14-950a-aac26709c4fa"}} Jun 02 19:05:09.315060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Invalid volume: volume 77197eb9-d3d2-4d14-950a-aac26709c4fa is already attached to instances: 0cada17e-c4a7-434f-adc8-fea531c47cd8 Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '1ac72221-56c7-4928-a41f-7bf89b4cab20', 'body': {'volumeAttachment': {'volumeId': '77197eb9-d3d2-4d14-950a-aac26709c4fa'}}} Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 77197eb9-d3d2-4d14-950a-aac26709c4fa is already attached to instances: 0cada17e-c4a7-434f-adc8-fea531c47cd8 Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:09.315818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 77197eb9-d3d2-4d14-950a-aac26709c4fa is already attached to instances: 0cada17e-c4a7-434f-adc8-fea531c47cd8 Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:09.317364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:05:09.319154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:05:09.319154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:05:09.319154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:05:09.319154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 77197eb9-d3d2-4d14-950a-aac26709c4fa is already attached to instances: 0cada17e-c4a7-434f-adc8-fea531c47cd8 Jun 02 19:05:09.319154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:09.319154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 400 to user: Invalid volume: volume 77197eb9-d3d2-4d14-950a-aac26709c4fa is already attached to instances: 0cada17e-c4a7-434f-adc8-fea531c47cd8 {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:05:09.319154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bf2c36dd-fa3f-4440-9060-a3a1a7d5f188 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102884 Jun 02 19:05:09.319154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 262/533] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:05:09 2022] POST /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:05:09.325942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-07bb1ef6-21a2-49f0-9861-960801685f81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:09.326453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-07bb1ef6-21a2-49f0-9861-960801685f81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:09.332812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07bb1ef6-21a2-49f0-9861-960801685f81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.333272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07bb1ef6-21a2-49f0-9861-960801685f81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.334121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07bb1ef6-21a2-49f0-9861-960801685f81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.334518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07bb1ef6-21a2-49f0-9861-960801685f81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.361015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-07bb1ef6-21a2-49f0-9861-960801685f81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:05:09.467124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-07bb1ef6-21a2-49f0-9861-960801685f81 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 204 len: 0 microversion: 2.1 time: 0.143391 Jun 02 19:05:09.468602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 272/534] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:05:09 2022] DELETE /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:05:09.477079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ab4a4353-a6d9-4d18-9eb7-7044eefad59b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:09.477687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ab4a4353-a6d9-4d18-9eb7-7044eefad59b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:09.487628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab4a4353-a6d9-4d18-9eb7-7044eefad59b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.488077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab4a4353-a6d9-4d18-9eb7-7044eefad59b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.488849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab4a4353-a6d9-4d18-9eb7-7044eefad59b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.489279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab4a4353-a6d9-4d18-9eb7-7044eefad59b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.637561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ab4a4353-a6d9-4d18-9eb7-7044eefad59b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:09.649385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ab4a4353-a6d9-4d18-9eb7-7044eefad59b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1682 microversion: 2.1 time: 0.175997 Jun 02 19:05:09.650300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 263/535] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:09 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:09.955512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-baa2c486-3888-4f6f-8e33-564531b4b614 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:09.956356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-baa2c486-3888-4f6f-8e33-564531b4b614 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:09.965150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-baa2c486-3888-4f6f-8e33-564531b4b614 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.965601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-baa2c486-3888-4f6f-8e33-564531b4b614 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:09.966400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-baa2c486-3888-4f6f-8e33-564531b4b614 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:09.966832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-baa2c486-3888-4f6f-8e33-564531b4b614 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:10.131455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-baa2c486-3888-4f6f-8e33-564531b4b614 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:10.141246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-baa2c486-3888-4f6f-8e33-564531b4b614 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.190433 Jun 02 19:05:10.141878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 273/536] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:10.169591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-af12334a-83b0-4096-afe5-29dacbd6c1d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:10.170294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-af12334a-83b0-4096-afe5-29dacbd6c1d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:10.177601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af12334a-83b0-4096-afe5-29dacbd6c1d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:10.178086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af12334a-83b0-4096-afe5-29dacbd6c1d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:10.178891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af12334a-83b0-4096-afe5-29dacbd6c1d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:10.179325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af12334a-83b0-4096-afe5-29dacbd6c1d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:10.325694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-af12334a-83b0-4096-afe5-29dacbd6c1d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:10.333501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-af12334a-83b0-4096-afe5-29dacbd6c1d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.168025 Jun 02 19:05:10.334110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 264/537] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:10 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:10.676149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bca9c759-5d06-4d63-812b-8030f4482956 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:10.677066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bca9c759-5d06-4d63-812b-8030f4482956 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:10.684330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca9c759-5d06-4d63-812b-8030f4482956 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:10.684677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca9c759-5d06-4d63-812b-8030f4482956 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:10.685464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca9c759-5d06-4d63-812b-8030f4482956 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:10.686112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca9c759-5d06-4d63-812b-8030f4482956 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:10.865846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bca9c759-5d06-4d63-812b-8030f4482956 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:10.877964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bca9c759-5d06-4d63-812b-8030f4482956 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1682 microversion: 2.1 time: 0.207683 Jun 02 19:05:10.878825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 274/538] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:10 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:11.159719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-47bde6ec-741d-4aec-b726-87693abad403 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:11.160320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-47bde6ec-741d-4aec-b726-87693abad403 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:11.168037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47bde6ec-741d-4aec-b726-87693abad403 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:11.168482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47bde6ec-741d-4aec-b726-87693abad403 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:11.169484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47bde6ec-741d-4aec-b726-87693abad403 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:11.169953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47bde6ec-741d-4aec-b726-87693abad403 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:11.354756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2675608e-911f-41c4-93c6-ceb946a952b8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:11.355968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2675608e-911f-41c4-93c6-ceb946a952b8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:11.364843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2675608e-911f-41c4-93c6-ceb946a952b8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:11.365391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2675608e-911f-41c4-93c6-ceb946a952b8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:11.366270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2675608e-911f-41c4-93c6-ceb946a952b8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:11.367064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2675608e-911f-41c4-93c6-ceb946a952b8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:11.385257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-47bde6ec-741d-4aec-b726-87693abad403 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:11.393646 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-47bde6ec-741d-4aec-b726-87693abad403 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.238046 Jun 02 19:05:11.394574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 265/539] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:11.563301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2675608e-911f-41c4-93c6-ceb946a952b8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:11.576334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2675608e-911f-41c4-93c6-ceb946a952b8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.227018 Jun 02 19:05:11.577212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 275/540] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:11 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:11.900585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-05d87a00-aa62-4788-a682-9a2b5da6727b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:11.901642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-05d87a00-aa62-4788-a682-9a2b5da6727b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:11.915472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-05d87a00-aa62-4788-a682-9a2b5da6727b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:11.916207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-05d87a00-aa62-4788-a682-9a2b5da6727b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:11.917209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-05d87a00-aa62-4788-a682-9a2b5da6727b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:11.917786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-05d87a00-aa62-4788-a682-9a2b5da6727b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:12.060930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-05d87a00-aa62-4788-a682-9a2b5da6727b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:12.068888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-05d87a00-aa62-4788-a682-9a2b5da6727b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1682 microversion: 2.1 time: 0.172366 Jun 02 19:05:12.069452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 266/541] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:11 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:12.412954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a8bf39e-a483-4294-a343-0ae1b01b9432 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:12.413592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a8bf39e-a483-4294-a343-0ae1b01b9432 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:12.416775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:12.429325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a8bf39e-a483-4294-a343-0ae1b01b9432 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:12.429999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a8bf39e-a483-4294-a343-0ae1b01b9432 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:12.431443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a8bf39e-a483-4294-a343-0ae1b01b9432 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:12.431887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a8bf39e-a483-4294-a343-0ae1b01b9432 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:12.435205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:12.578858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2a8bf39e-a483-4294-a343-0ae1b01b9432 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:12.590362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a8bf39e-a483-4294-a343-0ae1b01b9432 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.180923 Jun 02 19:05:12.591160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 276/542] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:12.596264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ca122cf-6201-40a4-8364-a837da7523a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:12.596941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ca122cf-6201-40a4-8364-a837da7523a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:12.606065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ca122cf-6201-40a4-8364-a837da7523a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:12.606441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ca122cf-6201-40a4-8364-a837da7523a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:12.607202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ca122cf-6201-40a4-8364-a837da7523a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:12.607629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ca122cf-6201-40a4-8364-a837da7523a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:12.751282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0ca122cf-6201-40a4-8364-a837da7523a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:12.760921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ca122cf-6201-40a4-8364-a837da7523a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.170145 Jun 02 19:05:12.761607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 267/543] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:12 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:13.087910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2f0e4085-792d-424e-8444-10fa1581ebfb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:13.088536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2f0e4085-792d-424e-8444-10fa1581ebfb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:13.095286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f0e4085-792d-424e-8444-10fa1581ebfb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:13.095733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f0e4085-792d-424e-8444-10fa1581ebfb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:13.096515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f0e4085-792d-424e-8444-10fa1581ebfb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:13.096956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f0e4085-792d-424e-8444-10fa1581ebfb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:13.236948 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2f0e4085-792d-424e-8444-10fa1581ebfb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:13.244701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2f0e4085-792d-424e-8444-10fa1581ebfb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1682 microversion: 2.1 time: 0.160799 Jun 02 19:05:13.245271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 277/544] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:13 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:13.612699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-525473e0-f1b8-4b49-99b0-d1e63dcdbc6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:13.613323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-525473e0-f1b8-4b49-99b0-d1e63dcdbc6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:13.622468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-525473e0-f1b8-4b49-99b0-d1e63dcdbc6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:13.622931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-525473e0-f1b8-4b49-99b0-d1e63dcdbc6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:13.623704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-525473e0-f1b8-4b49-99b0-d1e63dcdbc6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:13.624144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-525473e0-f1b8-4b49-99b0-d1e63dcdbc6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:13.778455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6d6adb42-ea04-46c1-8abe-edc2d78c9fc8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:13.779189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6d6adb42-ea04-46c1-8abe-edc2d78c9fc8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:13.783597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-525473e0-f1b8-4b49-99b0-d1e63dcdbc6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:13.786086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:13.786274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d6adb42-ea04-46c1-8abe-edc2d78c9fc8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:13.786612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d6adb42-ea04-46c1-8abe-edc2d78c9fc8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:13.787440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d6adb42-ea04-46c1-8abe-edc2d78c9fc8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:13.787840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d6adb42-ea04-46c1-8abe-edc2d78c9fc8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:13.793778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-525473e0-f1b8-4b49-99b0-d1e63dcdbc6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.184855 Jun 02 19:05:13.794345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 268/545] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:13.927025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d6adb42-ea04-46c1-8abe-edc2d78c9fc8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:13.935766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6d6adb42-ea04-46c1-8abe-edc2d78c9fc8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.161251 Jun 02 19:05:13.936319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 278/546] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:13 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:14.264307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2e9822e9-21c2-4c60-b54f-71627e779bcc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:14.264908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2e9822e9-21c2-4c60-b54f-71627e779bcc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:14.271733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e9822e9-21c2-4c60-b54f-71627e779bcc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:14.272176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e9822e9-21c2-4c60-b54f-71627e779bcc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:14.272936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e9822e9-21c2-4c60-b54f-71627e779bcc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:14.273361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e9822e9-21c2-4c60-b54f-71627e779bcc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:14.426030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2e9822e9-21c2-4c60-b54f-71627e779bcc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:14.434278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2e9822e9-21c2-4c60-b54f-71627e779bcc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1682 microversion: 2.1 time: 0.174744 Jun 02 19:05:14.434987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 269/547] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:14 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:14.814257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fcd8c267-90d1-4782-840f-5c19a47363ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:14.814838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fcd8c267-90d1-4782-840f-5c19a47363ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:14.823358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fcd8c267-90d1-4782-840f-5c19a47363ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:14.824645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fcd8c267-90d1-4782-840f-5c19a47363ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:14.824934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fcd8c267-90d1-4782-840f-5c19a47363ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:14.825382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fcd8c267-90d1-4782-840f-5c19a47363ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:14.955850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1fbcb41c-82f0-41dd-93e1-f2b76b3e2308 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:14.957219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1fbcb41c-82f0-41dd-93e1-f2b76b3e2308 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:14.967138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fbcb41c-82f0-41dd-93e1-f2b76b3e2308 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:14.967935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fbcb41c-82f0-41dd-93e1-f2b76b3e2308 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:14.968960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fbcb41c-82f0-41dd-93e1-f2b76b3e2308 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:14.969399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fbcb41c-82f0-41dd-93e1-f2b76b3e2308 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:14.999074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fcd8c267-90d1-4782-840f-5c19a47363ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:15.008979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fcd8c267-90d1-4782-840f-5c19a47363ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1752 microversion: 2.1 time: 0.200880 Jun 02 19:05:15.020094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 279/548] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1752 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:15.022322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-466b6b79-1e2f-4725-8ef0-67514e0cc831 req-4c3be3f0-ce2e-4784-a2bf-8eb6a06d34e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac72221-56c7-4928-a41f-7bf89b4cab20", "name": "network-vif-unplugged", "status": "completed", "tag": "6ccfd62c-96b8-4126-8fcb-55c08b439177"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:15.031982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-466b6b79-1e2f-4725-8ef0-67514e0cc831 req-4c3be3f0-ce2e-4784-a2bf-8eb6a06d34e0 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:15.032432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-466b6b79-1e2f-4725-8ef0-67514e0cc831 req-4c3be3f0-ce2e-4784-a2bf-8eb6a06d34e0 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:15.046932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-466b6b79-1e2f-4725-8ef0-67514e0cc831 req-4c3be3f0-ce2e-4784-a2bf-8eb6a06d34e0 service nova] Creating event network-vif-unplugged:6ccfd62c-96b8-4126-8fcb-55c08b439177 for instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 on hv-cinder-79760 Jun 02 19:05:15.053878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-466b6b79-1e2f-4725-8ef0-67514e0cc831 req-4c3be3f0-ce2e-4784-a2bf-8eb6a06d34e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034744 Jun 02 19:05:15.054168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 280/549] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:15.224279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1fbcb41c-82f0-41dd-93e1-f2b76b3e2308 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:15.234489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1fbcb41c-82f0-41dd-93e1-f2b76b3e2308 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.282734 Jun 02 19:05:15.235396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 270/550] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:14 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:15.454689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ed60e160-70f4-4236-ab2e-ead61d38ba0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:15.455505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ed60e160-70f4-4236-ab2e-ead61d38ba0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:15.461931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed60e160-70f4-4236-ab2e-ead61d38ba0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:15.462422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed60e160-70f4-4236-ab2e-ead61d38ba0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:15.463193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed60e160-70f4-4236-ab2e-ead61d38ba0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:15.463622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed60e160-70f4-4236-ab2e-ead61d38ba0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:15.627582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ed60e160-70f4-4236-ab2e-ead61d38ba0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:15.639326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ed60e160-70f4-4236-ab2e-ead61d38ba0b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1682 microversion: 2.1 time: 0.188977 Jun 02 19:05:15.649702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 281/551] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:15 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:16.001860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-93da1c0d-56b2-4842-b95d-7ae52fdda766 req-d292737d-529e-48cd-9c85-9bbcaf960d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac72221-56c7-4928-a41f-7bf89b4cab20", "name": "network-vif-deleted", "tag": "6ccfd62c-96b8-4126-8fcb-55c08b439177"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:16.014322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-93da1c0d-56b2-4842-b95d-7ae52fdda766 req-d292737d-529e-48cd-9c85-9bbcaf960d14 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.015635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-93da1c0d-56b2-4842-b95d-7ae52fdda766 req-d292737d-529e-48cd-9c85-9bbcaf960d14 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.028421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c541fda1-108e-4b1a-b4d5-07af70c59e3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:16.029686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c541fda1-108e-4b1a-b4d5-07af70c59e3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:16.038887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c541fda1-108e-4b1a-b4d5-07af70c59e3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.040538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c541fda1-108e-4b1a-b4d5-07af70c59e3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.041838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c541fda1-108e-4b1a-b4d5-07af70c59e3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.042643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c541fda1-108e-4b1a-b4d5-07af70c59e3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.050332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-93da1c0d-56b2-4842-b95d-7ae52fdda766 req-d292737d-529e-48cd-9c85-9bbcaf960d14 service nova] Creating event network-vif-deleted:6ccfd62c-96b8-4126-8fcb-55c08b439177 for instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 on hv-cinder-79760 Jun 02 19:05:16.063372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-93da1c0d-56b2-4842-b95d-7ae52fdda766 req-d292737d-529e-48cd-9c85-9bbcaf960d14 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064941 Jun 02 19:05:16.064847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 271/552] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:16.253215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-002781ba-ab64-4143-a622-9ba083498d26 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:16.254119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-002781ba-ab64-4143-a622-9ba083498d26 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:16.268390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-002781ba-ab64-4143-a622-9ba083498d26 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.269083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-002781ba-ab64-4143-a622-9ba083498d26 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.270488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-002781ba-ab64-4143-a622-9ba083498d26 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.271090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-002781ba-ab64-4143-a622-9ba083498d26 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.327737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c541fda1-108e-4b1a-b4d5-07af70c59e3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:16.336725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c541fda1-108e-4b1a-b4d5-07af70c59e3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1755 microversion: 2.1 time: 0.312614 Jun 02 19:05:16.337712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 282/553] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1755 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:05:16.343620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-271717061", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "networks": [{"uuid": "669b9edc-30e0-44b4-9f6c-43848b6da576"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:16.413911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] validate_networks() for [('669b9edc-30e0-44b4-9f6c-43848b6da576', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:05:16.482860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-002781ba-ab64-4143-a622-9ba083498d26 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:16.491112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-002781ba-ab64-4143-a622-9ba083498d26 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.241993 Jun 02 19:05:16.501259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 272/554] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:16 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:05:16.656850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:16.657561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:16.665614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.668181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.670141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.670772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.718508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.719263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.719942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lazy-loading 'fault' on Instance uuid 1ac72221-56c7-4928-a41f-7bf89b4cab20 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:05:16.775611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:16.785346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd37335a-cb08-471f-b207-75950681fa70 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 200 len: 1332 microversion: 2.1 time: 0.132329 Jun 02 19:05:16.786545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 273/555] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:16 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:16.866163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:05:16.866595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:05:16.867070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:05:16.867695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:05:16.868113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:05:16.879255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.879950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.882181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:16.882632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:16.907498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Getting quotas for project 6ad466a7fdbb4ef18dddf54fb200971d. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:05:16.914146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Getting quotas for user 5c5875c5cba841a28560a475bb18d595 and project 6ad466a7fdbb4ef18dddf54fb200971d. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:05:16.929244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:05:16.933020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:05:16.990393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e24becf5-28db-4dda-b831-f24573fec95b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651206 Jun 02 19:05:16.991534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 283/556] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:05:17.005424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4eed9159-7945-4f23-b331-88ab4ee87f80 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:17.005971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4eed9159-7945-4f23-b331-88ab4ee87f80 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:17.090123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4eed9159-7945-4f23-b331-88ab4ee87f80 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:17.097566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-cc75ffc8-34b6-4606-837a-8586870dc04a req-10fdf36e-7bde-4e86-987f-36c934936c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0a9be2-f2c0-4fa4-919b-44afcbdbae67", "name": "network-vif-plugged", "status": "completed", "tag": "93850d4b-abd8-487e-8508-5f0e1963d248"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:17.112098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4eed9159-7945-4f23-b331-88ab4ee87f80 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1218 microversion: 2.1 time: 0.110265 Jun 02 19:05:17.113954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 274/557] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:16 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:17.139901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-cc75ffc8-34b6-4606-837a-8586870dc04a req-10fdf36e-7bde-4e86-987f-36c934936c56 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:17.140567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-cc75ffc8-34b6-4606-837a-8586870dc04a req-10fdf36e-7bde-4e86-987f-36c934936c56 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:17.156902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-cc75ffc8-34b6-4606-837a-8586870dc04a req-10fdf36e-7bde-4e86-987f-36c934936c56 service nova] Creating event network-vif-plugged:93850d4b-abd8-487e-8508-5f0e1963d248 for instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 on hv-cinder-79760 Jun 02 19:05:17.164148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-cc75ffc8-34b6-4606-837a-8586870dc04a req-10fdf36e-7bde-4e86-987f-36c934936c56 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071729 Jun 02 19:05:17.165952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 284/558] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:17.508348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-940396f9-707e-4807-b6bb-5260c47708b5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:17.508975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-940396f9-707e-4807-b6bb-5260c47708b5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:17.516118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-940396f9-707e-4807-b6bb-5260c47708b5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:17.516483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-940396f9-707e-4807-b6bb-5260c47708b5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:17.517263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-940396f9-707e-4807-b6bb-5260c47708b5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:17.517717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-940396f9-707e-4807-b6bb-5260c47708b5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:17.678444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-940396f9-707e-4807-b6bb-5260c47708b5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:17.686807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-940396f9-707e-4807-b6bb-5260c47708b5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.182205 Jun 02 19:05:17.687381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 275/559] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:17 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:17.805195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:17.805814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:17.813682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:17.814170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:17.814941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:17.815374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:17.830950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 HTTP/1.1 Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:05:17.832655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:05:17.834232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '1ac72221-56c7-4928-a41f-7bf89b4cab20'} Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:05:17.835032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:05:17.836166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:05:17.837251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:05:17.837251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c4266017-049c-4481-83d5-3e814be995e2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 404 len: 111 microversion: 2.1 time: 0.033284 Jun 02 19:05:17.837251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 285/560] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:17 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:05:17.843609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e582faa4-7f09-46e5-a458-fc90b83bdf3d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '.version_select at 0x7f5b7873e310>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:17.865253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e582faa4-7f09-46e5-a458-fc90b83bdf3d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914833208" status: 202 len: 0 microversion: 2.1 time: 0.025430 Jun 02 19:05:17.866028 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 276/561] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Jun 2 19:05:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914833208 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:05:18.130718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3b5b79d8-f90f-41ec-a083-be888992815d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:18.131342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3b5b79d8-f90f-41ec-a083-be888992815d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:18.140791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b5b79d8-f90f-41ec-a083-be888992815d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:18.141240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b5b79d8-f90f-41ec-a083-be888992815d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:18.142057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b5b79d8-f90f-41ec-a083-be888992815d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:18.142551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b5b79d8-f90f-41ec-a083-be888992815d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:18.257031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3b5b79d8-f90f-41ec-a083-be888992815d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:18.274814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3b5b79d8-f90f-41ec-a083-be888992815d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1270 microversion: 2.1 time: 0.148191 Jun 02 19:05:18.279827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 286/562] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:18 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:18.644102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-531db9b8-bf16-4ae4-8885-a63aa99bb271 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:18.644632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-531db9b8-bf16-4ae4-8885-a63aa99bb271 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:18.652079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-531db9b8-bf16-4ae4-8885-a63aa99bb271 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:18.652526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-531db9b8-bf16-4ae4-8885-a63aa99bb271 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:18.653292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-531db9b8-bf16-4ae4-8885-a63aa99bb271 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:18.653724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-531db9b8-bf16-4ae4-8885-a63aa99bb271 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:18.704655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f73df20a-1680-4305-82c4-669f2d0c435e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:18.705307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f73df20a-1680-4305-82c4-669f2d0c435e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:18.711882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f73df20a-1680-4305-82c4-669f2d0c435e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:18.712716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f73df20a-1680-4305-82c4-669f2d0c435e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:18.713859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f73df20a-1680-4305-82c4-669f2d0c435e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:18.714361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f73df20a-1680-4305-82c4-669f2d0c435e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:18.742384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-531db9b8-bf16-4ae4-8885-a63aa99bb271 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lazy-loading 'services' on Instance uuid 0cada17e-c4a7-434f-adc8-fea531c47cd8 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:05:18.832431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-531db9b8-bf16-4ae4-8885-a63aa99bb271 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments/77197eb9-d3d2-4d14-950a-aac26709c4fa" status: 202 len: 0 microversion: 2.1 time: 0.191750 Jun 02 19:05:18.833722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 277/563] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:05:18 2022] DELETE /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments/77197eb9-d3d2-4d14-950a-aac26709c4fa => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:05:18.844275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6bf5d3e2-658c-4da8-8eb2-dc0393a7bc67 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:18.845577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6bf5d3e2-658c-4da8-8eb2-dc0393a7bc67 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:18.852473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bf5d3e2-658c-4da8-8eb2-dc0393a7bc67 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:18.853679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bf5d3e2-658c-4da8-8eb2-dc0393a7bc67 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:18.854750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bf5d3e2-658c-4da8-8eb2-dc0393a7bc67 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:18.855193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bf5d3e2-658c-4da8-8eb2-dc0393a7bc67 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:18.880049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f73df20a-1680-4305-82c4-669f2d0c435e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:18.890347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f73df20a-1680-4305-82c4-669f2d0c435e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1267 microversion: 2.1 time: 0.189895 Jun 02 19:05:18.891420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 287/564] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:18 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:05:18.900334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6bf5d3e2-658c-4da8-8eb2-dc0393a7bc67 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060932 Jun 02 19:05:18.901188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 278/565] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:05:18 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:05:19.295797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4835e5c5-4bb5-46a0-9c80-70b958f72c14 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:19.296460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4835e5c5-4bb5-46a0-9c80-70b958f72c14 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:19.303127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4835e5c5-4bb5-46a0-9c80-70b958f72c14 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:19.303582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4835e5c5-4bb5-46a0-9c80-70b958f72c14 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:19.304369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4835e5c5-4bb5-46a0-9c80-70b958f72c14 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:19.304807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4835e5c5-4bb5-46a0-9c80-70b958f72c14 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:19.373432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4835e5c5-4bb5-46a0-9c80-70b958f72c14 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:19.382511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4835e5c5-4bb5-46a0-9c80-70b958f72c14 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1276 microversion: 2.1 time: 0.090525 Jun 02 19:05:19.383038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 288/566] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:19 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:05:19.909571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-955c0616-1de5-4e03-b453-9c178d2d58f1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:19.910233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-955c0616-1de5-4e03-b453-9c178d2d58f1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:19.913272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-71d30e90-d96f-47e0-b103-f022320f55a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:19.914491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-71d30e90-d96f-47e0-b103-f022320f55a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:19.917809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-955c0616-1de5-4e03-b453-9c178d2d58f1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:19.918267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-955c0616-1de5-4e03-b453-9c178d2d58f1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:19.919047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-955c0616-1de5-4e03-b453-9c178d2d58f1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:19.919475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-955c0616-1de5-4e03-b453-9c178d2d58f1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:19.921155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71d30e90-d96f-47e0-b103-f022320f55a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:19.921614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71d30e90-d96f-47e0-b103-f022320f55a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:19.922465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71d30e90-d96f-47e0-b103-f022320f55a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:19.922909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71d30e90-d96f-47e0-b103-f022320f55a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:19.956802 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-71d30e90-d96f-47e0-b103-f022320f55a7 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047446 Jun 02 19:05:19.961892 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 289/567] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:05:19 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:20.092775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-955c0616-1de5-4e03-b453-9c178d2d58f1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:20.117181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-955c0616-1de5-4e03-b453-9c178d2d58f1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1454 microversion: 2.1 time: 0.212875 Jun 02 19:05:20.129825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 279/568] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:19 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1454 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:20.138410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6243ef55-f0dc-420e-a6f7-0acb8352a64c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:20.139617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6243ef55-f0dc-420e-a6f7-0acb8352a64c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:20.147357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6243ef55-f0dc-420e-a6f7-0acb8352a64c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:20.148164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6243ef55-f0dc-420e-a6f7-0acb8352a64c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:20.149127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6243ef55-f0dc-420e-a6f7-0acb8352a64c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:20.149607 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6243ef55-f0dc-420e-a6f7-0acb8352a64c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:20.319219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6243ef55-f0dc-420e-a6f7-0acb8352a64c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:20.327751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6243ef55-f0dc-420e-a6f7-0acb8352a64c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1454 microversion: 2.1 time: 0.194930 Jun 02 19:05:20.328436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 290/569] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:20 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1454 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:20.401101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2a63e807-f689-45d4-a442-508617df525d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:20.401823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2a63e807-f689-45d4-a442-508617df525d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:20.408843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a63e807-f689-45d4-a442-508617df525d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:20.409477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a63e807-f689-45d4-a442-508617df525d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:20.411071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a63e807-f689-45d4-a442-508617df525d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:20.413283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a63e807-f689-45d4-a442-508617df525d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:20.612083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2a63e807-f689-45d4-a442-508617df525d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:20.623520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2a63e807-f689-45d4-a442-508617df525d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.226943 Jun 02 19:05:20.624102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 280/570] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:20 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:20.971548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c0297855-8f2e-4a84-90e2-186184d2f7c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:20.973679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c0297855-8f2e-4a84-90e2-186184d2f7c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:20.989996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0297855-8f2e-4a84-90e2-186184d2f7c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:20.990661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0297855-8f2e-4a84-90e2-186184d2f7c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:20.991783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0297855-8f2e-4a84-90e2-186184d2f7c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:20.992795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0297855-8f2e-4a84-90e2-186184d2f7c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:21.031829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c0297855-8f2e-4a84-90e2-186184d2f7c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066246 Jun 02 19:05:21.032807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 291/571] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:05:20 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 19:05:21.113738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a30f2ea1-462c-459a-b65c-d648dfb6b225 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:21.114587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a30f2ea1-462c-459a-b65c-d648dfb6b225 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:21.122937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a30f2ea1-462c-459a-b65c-d648dfb6b225 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:21.123903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a30f2ea1-462c-459a-b65c-d648dfb6b225 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:21.125059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a30f2ea1-462c-459a-b65c-d648dfb6b225 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:21.125428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a30f2ea1-462c-459a-b65c-d648dfb6b225 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:21.158635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a30f2ea1-462c-459a-b65c-d648dfb6b225 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:05:21.226031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-810a806f-797c-4b31-80d7-b0210951854a req-c5ec27ae-479c-4042-80cb-f7e6185eb89e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423ad810-dacf-4ac6-9fa1-68964373fa1a", "tag": "f7d313b1-4be3-4e8e-b816-59916cddd268"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:21.242533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-810a806f-797c-4b31-80d7-b0210951854a req-c5ec27ae-479c-4042-80cb-f7e6185eb89e service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:21.243447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-810a806f-797c-4b31-80d7-b0210951854a req-c5ec27ae-479c-4042-80cb-f7e6185eb89e service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:21.258535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-810a806f-797c-4b31-80d7-b0210951854a req-c5ec27ae-479c-4042-80cb-f7e6185eb89e service nova] Creating event network-changed:f7d313b1-4be3-4e8e-b816-59916cddd268 for instance 423ad810-dacf-4ac6-9fa1-68964373fa1a on hv-cinder-79760 Jun 02 19:05:21.264255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-810a806f-797c-4b31-80d7-b0210951854a req-c5ec27ae-479c-4042-80cb-f7e6185eb89e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043283 Jun 02 19:05:21.265844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 292/572] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:05:21.291050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a30f2ea1-462c-459a-b65c-d648dfb6b225 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 204 len: 0 microversion: 2.1 time: 0.181622 Jun 02 19:05:21.292477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 281/573] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:05:21 2022] DELETE /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:05:21.302633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ff20429a-4685-49e1-889a-a252d0c31d60 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:21.303346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ff20429a-4685-49e1-889a-a252d0c31d60 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:21.313921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff20429a-4685-49e1-889a-a252d0c31d60 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:21.314368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff20429a-4685-49e1-889a-a252d0c31d60 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:21.315144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff20429a-4685-49e1-889a-a252d0c31d60 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:21.315575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff20429a-4685-49e1-889a-a252d0c31d60 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:21.538217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff20429a-4685-49e1-889a-a252d0c31d60 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:21.547265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ff20429a-4685-49e1-889a-a252d0c31d60 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1682 microversion: 2.1 time: 0.249002 Jun 02 19:05:21.547849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 293/574] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:21 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:21.641274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-00c95f2c-9241-407e-98f5-dc86b7e6efab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:21.642011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-00c95f2c-9241-407e-98f5-dc86b7e6efab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:21.648339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00c95f2c-9241-407e-98f5-dc86b7e6efab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:21.648788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00c95f2c-9241-407e-98f5-dc86b7e6efab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:21.649589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00c95f2c-9241-407e-98f5-dc86b7e6efab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:21.650318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00c95f2c-9241-407e-98f5-dc86b7e6efab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:21.895330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-00c95f2c-9241-407e-98f5-dc86b7e6efab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:21.917963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-00c95f2c-9241-407e-98f5-dc86b7e6efab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.280788 Jun 02 19:05:21.918892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 282/575] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:21 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:22.565120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7fb38266-dd42-4043-bb31-a0ad875e2a75 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:22.565745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7fb38266-dd42-4043-bb31-a0ad875e2a75 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:22.572901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fb38266-dd42-4043-bb31-a0ad875e2a75 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:22.573361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fb38266-dd42-4043-bb31-a0ad875e2a75 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:22.574525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fb38266-dd42-4043-bb31-a0ad875e2a75 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:22.574969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fb38266-dd42-4043-bb31-a0ad875e2a75 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:22.761346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7fb38266-dd42-4043-bb31-a0ad875e2a75 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:22.769456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7fb38266-dd42-4043-bb31-a0ad875e2a75 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1682 microversion: 2.1 time: 0.208411 Jun 02 19:05:22.770118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 294/576] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:22 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:22.942381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-494686fc-30bb-4fbb-8bd1-618ccb02c56a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:22.942381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-494686fc-30bb-4fbb-8bd1-618ccb02c56a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:22.952621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-494686fc-30bb-4fbb-8bd1-618ccb02c56a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:22.953405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-494686fc-30bb-4fbb-8bd1-618ccb02c56a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:22.976974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-494686fc-30bb-4fbb-8bd1-618ccb02c56a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:22.979200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-494686fc-30bb-4fbb-8bd1-618ccb02c56a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:22.981624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-a113e0c3-691e-4c28-b7a7-3a7378c586a8 req-988a65c7-e794-4c04-a57d-819849d8add4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0a9be2-f2c0-4fa4-919b-44afcbdbae67", "tag": "93850d4b-abd8-487e-8508-5f0e1963d248"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:22.995765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-a113e0c3-691e-4c28-b7a7-3a7378c586a8 req-988a65c7-e794-4c04-a57d-819849d8add4 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:22.996206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-a113e0c3-691e-4c28-b7a7-3a7378c586a8 req-988a65c7-e794-4c04-a57d-819849d8add4 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:23.023764 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-a113e0c3-691e-4c28-b7a7-3a7378c586a8 req-988a65c7-e794-4c04-a57d-819849d8add4 service nova] Creating event network-changed:93850d4b-abd8-487e-8508-5f0e1963d248 for instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 on hv-cinder-79760 Jun 02 19:05:23.036762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-a113e0c3-691e-4c28-b7a7-3a7378c586a8 req-988a65c7-e794-4c04-a57d-819849d8add4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058546 Jun 02 19:05:23.039012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 295/577] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:05:23.178512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-494686fc-30bb-4fbb-8bd1-618ccb02c56a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:23.187144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-494686fc-30bb-4fbb-8bd1-618ccb02c56a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.251115 Jun 02 19:05:23.187640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 283/578] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:22 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:23.788643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47be4f20-deb2-4647-bbd0-ce9d7cd89929 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:23.789422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47be4f20-deb2-4647-bbd0-ce9d7cd89929 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:23.796891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47be4f20-deb2-4647-bbd0-ce9d7cd89929 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:23.797339 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47be4f20-deb2-4647-bbd0-ce9d7cd89929 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:23.798138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47be4f20-deb2-4647-bbd0-ce9d7cd89929 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:23.798570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47be4f20-deb2-4647-bbd0-ce9d7cd89929 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:23.977434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47be4f20-deb2-4647-bbd0-ce9d7cd89929 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:23.980296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:23.987598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47be4f20-deb2-4647-bbd0-ce9d7cd89929 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1682 microversion: 2.1 time: 0.203343 Jun 02 19:05:23.989857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 296/579] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:23 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:24.204116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-af6029b9-1c2d-40e0-a0c5-d3bec58f3f06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:24.204942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-af6029b9-1c2d-40e0-a0c5-d3bec58f3f06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:24.221122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af6029b9-1c2d-40e0-a0c5-d3bec58f3f06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:24.221578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af6029b9-1c2d-40e0-a0c5-d3bec58f3f06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:24.222415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af6029b9-1c2d-40e0-a0c5-d3bec58f3f06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:24.222856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af6029b9-1c2d-40e0-a0c5-d3bec58f3f06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:24.381694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-af6029b9-1c2d-40e0-a0c5-d3bec58f3f06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:24.390341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-af6029b9-1c2d-40e0-a0c5-d3bec58f3f06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.190138 Jun 02 19:05:24.390883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 284/580] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:24 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:24.499565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-f83c2c71-d4b8-4b18-9600-535fc17e002e req-c1ccea53-013a-499b-add0-42d8de68cfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cada17e-c4a7-434f-adc8-fea531c47cd8", "name": "network-vif-deleted", "tag": "46c45669-3669-4e67-9482-9b7f07ba9355"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:24.507793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f83c2c71-d4b8-4b18-9600-535fc17e002e req-c1ccea53-013a-499b-add0-42d8de68cfee service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:24.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f83c2c71-d4b8-4b18-9600-535fc17e002e req-c1ccea53-013a-499b-add0-42d8de68cfee service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:24.519944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-f83c2c71-d4b8-4b18-9600-535fc17e002e req-c1ccea53-013a-499b-add0-42d8de68cfee service nova] Creating event network-vif-deleted:46c45669-3669-4e67-9482-9b7f07ba9355 for instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 on hv-cinder-79760 Jun 02 19:05:24.525378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-f83c2c71-d4b8-4b18-9600-535fc17e002e req-c1ccea53-013a-499b-add0-42d8de68cfee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029213 Jun 02 19:05:24.526228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 297/581] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:25.006955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad5f29f7-c314-4462-a675-5f827b305555 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:25.018260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad5f29f7-c314-4462-a675-5f827b305555 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:25.034684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad5f29f7-c314-4462-a675-5f827b305555 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:25.035245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad5f29f7-c314-4462-a675-5f827b305555 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:25.038423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad5f29f7-c314-4462-a675-5f827b305555 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:25.039374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad5f29f7-c314-4462-a675-5f827b305555 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:25.068363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:25.133284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad5f29f7-c314-4462-a675-5f827b305555 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:25.143595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad5f29f7-c314-4462-a675-5f827b305555 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 200 len: 1327 microversion: 2.1 time: 0.140875 Jun 02 19:05:25.153167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 285/582] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:25 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 1327 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:25.412149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90df4f7f-0548-4a4a-9c3e-7307e427ca78 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:25.412954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-90df4f7f-0548-4a4a-9c3e-7307e427ca78 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:25.420553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90df4f7f-0548-4a4a-9c3e-7307e427ca78 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:25.420997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90df4f7f-0548-4a4a-9c3e-7307e427ca78 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:25.421775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90df4f7f-0548-4a4a-9c3e-7307e427ca78 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:25.422245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90df4f7f-0548-4a4a-9c3e-7307e427ca78 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:25.597187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-90df4f7f-0548-4a4a-9c3e-7307e427ca78 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:25.606311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-90df4f7f-0548-4a4a-9c3e-7307e427ca78 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.199001 Jun 02 19:05:25.608829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 298/583] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:25 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:26.165162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:26.166457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:26.173605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:26.174087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:26.174859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:26.175287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:26.190679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 HTTP/1.1 Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:05:26.192358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:05:26.194759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '0cada17e-c4a7-434f-adc8-fea531c47cd8'} Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:05:26.196059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:05:26.198438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:05:26.201086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:05:26.201086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-084f062a-c14c-49f0-b925-857c4e38bf5a tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 404 len: 111 microversion: 2.1 time: 0.035519 Jun 02 19:05:26.201086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 286/584] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:26 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:05:26.203591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3a860ad-8bd9-41d7-9bb4-c62bbfd57e66 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '.version_select at 0x7f5b78d69f70>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:26.225254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f3a860ad-8bd9-41d7-9bb4-c62bbfd57e66 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916304051" status: 202 len: 0 microversion: 2.1 time: 0.025428 Jun 02 19:05:26.225913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 299/585] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Jun 2 19:05:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916304051 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 19:05:26.624254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b32da504-ffe4-4910-8522-6be91e19139a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:26.625241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b32da504-ffe4-4910-8522-6be91e19139a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:26.632188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b32da504-ffe4-4910-8522-6be91e19139a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:26.632637 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b32da504-ffe4-4910-8522-6be91e19139a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:26.633440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b32da504-ffe4-4910-8522-6be91e19139a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:26.634016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b32da504-ffe4-4910-8522-6be91e19139a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:26.784537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b32da504-ffe4-4910-8522-6be91e19139a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:26.792373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b32da504-ffe4-4910-8522-6be91e19139a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.172184 Jun 02 19:05:26.792935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 287/586] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:26 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:27.184223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:27.185009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:27.189143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eb41429b-ef50-4ac5-bb36-bc8f28377a1f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: .version_select at 0x7f5b78d99ee0>, body: {"keypair": {"name": "tempest-keypair-452202010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxEJbFiPL7yT1xDyDltuiJH1e/gX4tmJAPLjoiZX7IFvwZ0PtHIXgbmbGnd+wywvz4fcylpOGF9RN9sSvwT56wiOK25Y8giH1IoHvgCBY+avLkeiLqctljx56RHeuVjag=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:27.205755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-eb41429b-ef50-4ac5-bb36-bc8f28377a1f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for project 5a66e7666ca24a079738eea09c470cdd. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:05:27.209543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-eb41429b-ef50-4ac5-bb36-bc8f28377a1f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for user 4a660a47927140d6b4d0543de5e281a1 and project 5a66e7666ca24a079738eea09c470cdd. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:05:27.235125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eb41429b-ef50-4ac5-bb36-bc8f28377a1f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052112 Jun 02 19:05:27.235748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 300/587] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:05:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:27.806549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:27.811979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-949347df-92c2-488c-acc3-d790106bfe40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:27.812602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-949347df-92c2-488c-acc3-d790106bfe40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:27.819871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-949347df-92c2-488c-acc3-d790106bfe40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:27.820323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-949347df-92c2-488c-acc3-d790106bfe40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:27.821111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-949347df-92c2-488c-acc3-d790106bfe40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:27.821659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-949347df-92c2-488c-acc3-d790106bfe40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:28.181694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-949347df-92c2-488c-acc3-d790106bfe40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:28.190283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-949347df-92c2-488c-acc3-d790106bfe40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.384405 Jun 02 19:05:28.190869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 288/588] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:27 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:29.002069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-61d90815-d50c-4361-8f7d-c024e9b43397 req-f54cd75d-2eb6-4bec-9525-e3ffe99e9e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423ad810-dacf-4ac6-9fa1-68964373fa1a", "name": "network-vif-plugged", "status": "completed", "tag": "f7d313b1-4be3-4e8e-b816-59916cddd268"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:29.008925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-5999548", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60bdcf03-2f93-4152-823f-c85a0a62a5ae"}], "security_groups": [{"name": "tempest-securitygroup--1126895991"}], "key_name": "tempest-keypair-452202010", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:29.022995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-61d90815-d50c-4361-8f7d-c024e9b43397 req-f54cd75d-2eb6-4bec-9525-e3ffe99e9e3d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:29.023722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-61d90815-d50c-4361-8f7d-c024e9b43397 req-f54cd75d-2eb6-4bec-9525-e3ffe99e9e3d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:29.049277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-61d90815-d50c-4361-8f7d-c024e9b43397 req-f54cd75d-2eb6-4bec-9525-e3ffe99e9e3d service nova] Creating event network-vif-plugged:f7d313b1-4be3-4e8e-b816-59916cddd268 for instance 423ad810-dacf-4ac6-9fa1-68964373fa1a on hv-cinder-79760 Jun 02 19:05:29.056598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-61d90815-d50c-4361-8f7d-c024e9b43397 req-f54cd75d-2eb6-4bec-9525-e3ffe99e9e3d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062001 Jun 02 19:05:29.057218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 301/589] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:29.140371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] validate_networks() for [('60bdcf03-2f93-4152-823f-c85a0a62a5ae', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:05:29.209127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-133ae8a2-681d-46a7-a6b7-77d7c97d38a1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:29.209932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-133ae8a2-681d-46a7-a6b7-77d7c97d38a1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:29.217849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-133ae8a2-681d-46a7-a6b7-77d7c97d38a1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:29.218663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-133ae8a2-681d-46a7-a6b7-77d7c97d38a1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:29.219627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-133ae8a2-681d-46a7-a6b7-77d7c97d38a1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:29.220137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-133ae8a2-681d-46a7-a6b7-77d7c97d38a1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:29.442884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-133ae8a2-681d-46a7-a6b7-77d7c97d38a1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:29.452974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-133ae8a2-681d-46a7-a6b7-77d7c97d38a1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.248864 Jun 02 19:05:29.453563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 302/590] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:29 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:05:29.648841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:05:29.649328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:05:29.649840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:05:29.650287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:05:29.650697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:05:29.661644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:29.662263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:29.663044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:29.663537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:29.687395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for project 5a66e7666ca24a079738eea09c470cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:05:29.691711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for user 4a660a47927140d6b4d0543de5e281a1 and project 5a66e7666ca24a079738eea09c470cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:05:29.704543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:05:29.707211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:05:29.766261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0f989e99-dd23-4bbf-bc20-e68ac1526f94 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.762761 Jun 02 19:05:29.766925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 289/591] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:05:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:05:29.777578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-beec947d-f350-4690-a6fa-863360e7cd6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:29.778540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-beec947d-f350-4690-a6fa-863360e7cd6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:29.837614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-beec947d-f350-4690-a6fa-863360e7cd6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:29.845103 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-beec947d-f350-4690-a6fa-863360e7cd6b tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1238 microversion: 2.1 time: 0.071450 Jun 02 19:05:29.846514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 303/592] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:29 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:30.471240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-00110a6c-2448-4877-8b93-a77deeda16c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:30.471964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-00110a6c-2448-4877-8b93-a77deeda16c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:30.479316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00110a6c-2448-4877-8b93-a77deeda16c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:30.479921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00110a6c-2448-4877-8b93-a77deeda16c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:30.480760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00110a6c-2448-4877-8b93-a77deeda16c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:30.481330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00110a6c-2448-4877-8b93-a77deeda16c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:30.616326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-00110a6c-2448-4877-8b93-a77deeda16c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:30.628394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-00110a6c-2448-4877-8b93-a77deeda16c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1318 microversion: 2.1 time: 0.161357 Jun 02 19:05:30.629314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 290/593] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:30 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:30.869882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-83efc8b6-4b98-4ecc-a43c-c272b00e0e25 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:30.870491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-83efc8b6-4b98-4ecc-a43c-c272b00e0e25 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:30.877304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83efc8b6-4b98-4ecc-a43c-c272b00e0e25 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:30.877759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83efc8b6-4b98-4ecc-a43c-c272b00e0e25 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:30.878564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83efc8b6-4b98-4ecc-a43c-c272b00e0e25 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:30.879003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83efc8b6-4b98-4ecc-a43c-c272b00e0e25 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:30.950521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-83efc8b6-4b98-4ecc-a43c-c272b00e0e25 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:30.958700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-83efc8b6-4b98-4ecc-a43c-c272b00e0e25 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1290 microversion: 2.1 time: 0.096380 Jun 02 19:05:30.959268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 304/594] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:30 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:31.650625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-40207aad-b1b2-4452-9547-a78a3b0322d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:31.651196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-40207aad-b1b2-4452-9547-a78a3b0322d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:31.658238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-40207aad-b1b2-4452-9547-a78a3b0322d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:31.658685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-40207aad-b1b2-4452-9547-a78a3b0322d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:31.659438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-40207aad-b1b2-4452-9547-a78a3b0322d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:31.659864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-40207aad-b1b2-4452-9547-a78a3b0322d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:31.800316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-40207aad-b1b2-4452-9547-a78a3b0322d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:31.808764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-40207aad-b1b2-4452-9547-a78a3b0322d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1508 microversion: 2.1 time: 0.164488 Jun 02 19:05:31.810005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 291/595] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:31 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:31.827691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-09ce2436-f69e-47ab-ab68-db178283c165 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34a74491-2a21-466f-ba26-5d931a14891f", "device": "/dev/sdb"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:31.829659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-09ce2436-f69e-47ab-ab68-db178283c165 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:31.837704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09ce2436-f69e-47ab-ab68-db178283c165 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:31.838233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09ce2436-f69e-47ab-ab68-db178283c165 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:31.839079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09ce2436-f69e-47ab-ab68-db178283c165 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:31.839476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09ce2436-f69e-47ab-ab68-db178283c165 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:31.976581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7e4018fa-d573-416a-b045-c3f91b848322 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:31.977244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7e4018fa-d573-416a-b045-c3f91b848322 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:31.984115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e4018fa-d573-416a-b045-c3f91b848322 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:31.984545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e4018fa-d573-416a-b045-c3f91b848322 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:31.985375 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e4018fa-d573-416a-b045-c3f91b848322 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:31.985822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e4018fa-d573-416a-b045-c3f91b848322 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:32.057629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7e4018fa-d573-416a-b045-c3f91b848322 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:32.071554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7e4018fa-d573-416a-b045-c3f91b848322 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1296 microversion: 2.1 time: 0.098686 Jun 02 19:05:32.072248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 292/596] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:31 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:32.184795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-09ce2436-f69e-47ab-ab68-db178283c165 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "POST /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362029 Jun 02 19:05:32.186087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 305/597] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:05:31 2022] POST /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:33.090153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-47f5061d-bfa6-42b1-b1d9-23a0becbde40 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:33.090995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-47f5061d-bfa6-42b1-b1d9-23a0becbde40 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:33.099334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47f5061d-bfa6-42b1-b1d9-23a0becbde40 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:33.099890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47f5061d-bfa6-42b1-b1d9-23a0becbde40 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:33.100891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47f5061d-bfa6-42b1-b1d9-23a0becbde40 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:33.101412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47f5061d-bfa6-42b1-b1d9-23a0becbde40 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:33.155654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-11e0ff49-85c6-408f-a5de-e994f5a36c5d req-1dd25409-a3cf-43bc-8587-fef3b9438542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d285abbb-bcf6-43c7-be53-6b909c9bcce1", "tag": "45ad7fdf-8670-45bd-9a90-0be0f9bd7366"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:33.169344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-11e0ff49-85c6-408f-a5de-e994f5a36c5d req-1dd25409-a3cf-43bc-8587-fef3b9438542 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:33.169829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-11e0ff49-85c6-408f-a5de-e994f5a36c5d req-1dd25409-a3cf-43bc-8587-fef3b9438542 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:33.196686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-11e0ff49-85c6-408f-a5de-e994f5a36c5d req-1dd25409-a3cf-43bc-8587-fef3b9438542 service nova] Creating event network-changed:45ad7fdf-8670-45bd-9a90-0be0f9bd7366 for instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 on hv-cinder-79760 Jun 02 19:05:33.203839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-11e0ff49-85c6-408f-a5de-e994f5a36c5d req-1dd25409-a3cf-43bc-8587-fef3b9438542 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052439 Jun 02 19:05:33.205045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 306/598] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:33.297929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-47f5061d-bfa6-42b1-b1d9-23a0becbde40 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:33.309463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-47f5061d-bfa6-42b1-b1d9-23a0becbde40 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.224354 Jun 02 19:05:33.310704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 293/599] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:33 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:34.329998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-07a2f5d6-8212-4899-8159-ebb4e70ce31e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:34.330984 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-07a2f5d6-8212-4899-8159-ebb4e70ce31e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:34.338224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a2f5d6-8212-4899-8159-ebb4e70ce31e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:34.338695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a2f5d6-8212-4899-8159-ebb4e70ce31e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:34.339476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a2f5d6-8212-4899-8159-ebb4e70ce31e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:34.339915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a2f5d6-8212-4899-8159-ebb4e70ce31e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:34.488375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-07a2f5d6-8212-4899-8159-ebb4e70ce31e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:34.496687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-07a2f5d6-8212-4899-8159-ebb4e70ce31e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.171760 Jun 02 19:05:34.497268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 307/600] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:34 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:35.514987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-da58b0ff-708c-44a6-b1a2-6074b145ec02 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:35.515548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-da58b0ff-708c-44a6-b1a2-6074b145ec02 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:35.522752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da58b0ff-708c-44a6-b1a2-6074b145ec02 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:35.523203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da58b0ff-708c-44a6-b1a2-6074b145ec02 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:35.524037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da58b0ff-708c-44a6-b1a2-6074b145ec02 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:35.525317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da58b0ff-708c-44a6-b1a2-6074b145ec02 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:35.662458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-da58b0ff-708c-44a6-b1a2-6074b145ec02 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:35.670783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-da58b0ff-708c-44a6-b1a2-6074b145ec02 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.159630 Jun 02 19:05:35.671381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 294/601] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:35 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:36.687995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b4978504-e71b-4359-8ee2-413684523e5f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:36.688613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b4978504-e71b-4359-8ee2-413684523e5f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:36.695628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4978504-e71b-4359-8ee2-413684523e5f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:36.696232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4978504-e71b-4359-8ee2-413684523e5f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:36.697032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4978504-e71b-4359-8ee2-413684523e5f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:36.697472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4978504-e71b-4359-8ee2-413684523e5f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:36.840451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b4978504-e71b-4359-8ee2-413684523e5f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:36.848530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b4978504-e71b-4359-8ee2-413684523e5f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.164505 Jun 02 19:05:36.849108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 308/602] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:36 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:37.868125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fce8a28a-c9e6-454d-86b3-4efbeb71e3c2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:37.868768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fce8a28a-c9e6-454d-86b3-4efbeb71e3c2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:37.875879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fce8a28a-c9e6-454d-86b3-4efbeb71e3c2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:37.876342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fce8a28a-c9e6-454d-86b3-4efbeb71e3c2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:37.877141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fce8a28a-c9e6-454d-86b3-4efbeb71e3c2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:37.877567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fce8a28a-c9e6-454d-86b3-4efbeb71e3c2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:38.015496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fce8a28a-c9e6-454d-86b3-4efbeb71e3c2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:38.023211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fce8a28a-c9e6-454d-86b3-4efbeb71e3c2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.159162 Jun 02 19:05:38.023752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 295/603] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:37 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:39.042842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-736aa6b9-5d6b-4d4a-9517-a749d344d2aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:39.044336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-736aa6b9-5d6b-4d4a-9517-a749d344d2aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:39.051716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-736aa6b9-5d6b-4d4a-9517-a749d344d2aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:39.052529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-736aa6b9-5d6b-4d4a-9517-a749d344d2aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:39.053711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-736aa6b9-5d6b-4d4a-9517-a749d344d2aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:39.054442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-736aa6b9-5d6b-4d4a-9517-a749d344d2aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:39.077095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-5c715b8d-0413-4641-8c08-ad4b144635c4 req-fb3e339b-ebd5-43db-a241-9e470a4df122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d285abbb-bcf6-43c7-be53-6b909c9bcce1", "name": "network-vif-plugged", "status": "completed", "tag": "45ad7fdf-8670-45bd-9a90-0be0f9bd7366"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:39.090358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:39.097130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-5c715b8d-0413-4641-8c08-ad4b144635c4 req-fb3e339b-ebd5-43db-a241-9e470a4df122 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:39.097987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-5c715b8d-0413-4641-8c08-ad4b144635c4 req-fb3e339b-ebd5-43db-a241-9e470a4df122 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:39.114659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-5c715b8d-0413-4641-8c08-ad4b144635c4 req-fb3e339b-ebd5-43db-a241-9e470a4df122 service nova] Creating event network-vif-plugged:45ad7fdf-8670-45bd-9a90-0be0f9bd7366 for instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 on hv-cinder-79760 Jun 02 19:05:39.121034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-5c715b8d-0413-4641-8c08-ad4b144635c4 req-fb3e339b-ebd5-43db-a241-9e470a4df122 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052092 Jun 02 19:05:39.122452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 296/604] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:39.232309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-736aa6b9-5d6b-4d4a-9517-a749d344d2aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:39.239802 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-736aa6b9-5d6b-4d4a-9517-a749d344d2aa tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.202681 Jun 02 19:05:39.240393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 309/605] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:39 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:39.848222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:39.849010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:39.853935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ecb6735c-d177-46a3-9285-6377696d5dbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:39.854527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ecb6735c-d177-46a3-9285-6377696d5dbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:39.862698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecb6735c-d177-46a3-9285-6377696d5dbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:39.872917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecb6735c-d177-46a3-9285-6377696d5dbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:39.874031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecb6735c-d177-46a3-9285-6377696d5dbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:39.874294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecb6735c-d177-46a3-9285-6377696d5dbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:39.914904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ecb6735c-d177-46a3-9285-6377696d5dbd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments/a5f4c21f-be1f-41eb-8297-953ab7566441" status: 200 len: 194 microversion: 2.20 time: 0.067498 Jun 02 19:05:39.915585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 297/606] 10.222.0.15 () {60 vars in 1453 bytes} [Thu Jun 2 19:05:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments/a5f4c21f-be1f-41eb-8297-953ab7566441 => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:39.987938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-77132d27-bf76-4f9b-858f-569c87a3c3dc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:39.988439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-77132d27-bf76-4f9b-858f-569c87a3c3dc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:39.990827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:39.996839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77132d27-bf76-4f9b-858f-569c87a3c3dc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:39.997299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77132d27-bf76-4f9b-858f-569c87a3c3dc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:39.998116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77132d27-bf76-4f9b-858f-569c87a3c3dc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:39.998559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77132d27-bf76-4f9b-858f-569c87a3c3dc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:40.132977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-77132d27-bf76-4f9b-858f-569c87a3c3dc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lazy-loading 'services' on Instance uuid 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:05:40.261012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8ed2f2ed-fccf-4380-b479-f15aa6895790 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:40.261663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8ed2f2ed-fccf-4380-b479-f15aa6895790 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:40.266369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-77132d27-bf76-4f9b-858f-569c87a3c3dc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments/a5f4c21f-be1f-41eb-8297-953ab7566441" status: 202 len: 0 microversion: 2.20 time: 0.282832 Jun 02 19:05:40.270515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 310/607] 10.222.0.15 () {60 vars in 1456 bytes} [Thu Jun 2 19:05:39 2022] DELETE /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments/a5f4c21f-be1f-41eb-8297-953ab7566441 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:05:40.270705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ed2f2ed-fccf-4380-b479-f15aa6895790 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:40.270705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ed2f2ed-fccf-4380-b479-f15aa6895790 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:40.270705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ed2f2ed-fccf-4380-b479-f15aa6895790 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:40.271077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ed2f2ed-fccf-4380-b479-f15aa6895790 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:40.283237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-62b33c3a-8017-4747-8049-4bc8e51d2813 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:40.283237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-62b33c3a-8017-4747-8049-4bc8e51d2813 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:40.286861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62b33c3a-8017-4747-8049-4bc8e51d2813 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:40.288371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62b33c3a-8017-4747-8049-4bc8e51d2813 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:40.288371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62b33c3a-8017-4747-8049-4bc8e51d2813 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:40.288592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62b33c3a-8017-4747-8049-4bc8e51d2813 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:40.321827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-62b33c3a-8017-4747-8049-4bc8e51d2813 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048867 Jun 02 19:05:40.325393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 311/608] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 19:05:40.419528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8ed2f2ed-fccf-4380-b479-f15aa6895790 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:40.427656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8ed2f2ed-fccf-4380-b479-f15aa6895790 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.171889 Jun 02 19:05:40.428228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 298/609] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:40 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:05:41.334456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-35ff0009-f949-4675-acad-26f591f27901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:41.335308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-35ff0009-f949-4675-acad-26f591f27901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:41.337971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:41.343723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35ff0009-f949-4675-acad-26f591f27901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:41.344180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35ff0009-f949-4675-acad-26f591f27901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:41.344968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35ff0009-f949-4675-acad-26f591f27901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:41.345409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35ff0009-f949-4675-acad-26f591f27901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:41.378795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-35ff0009-f949-4675-acad-26f591f27901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048325 Jun 02 19:05:41.379372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 312/610] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:41.445425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fff13b88-6812-4654-ab26-0b97eabd6254 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:41.446604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fff13b88-6812-4654-ab26-0b97eabd6254 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:41.454930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fff13b88-6812-4654-ab26-0b97eabd6254 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:41.455371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fff13b88-6812-4654-ab26-0b97eabd6254 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:41.456141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fff13b88-6812-4654-ab26-0b97eabd6254 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:41.456564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fff13b88-6812-4654-ab26-0b97eabd6254 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:41.607675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fff13b88-6812-4654-ab26-0b97eabd6254 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:41.615621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fff13b88-6812-4654-ab26-0b97eabd6254 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.173987 Jun 02 19:05:41.616189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 299/611] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:41 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:42.391868 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1c99d95c-e916-426c-a946-b1648fb4dfaa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:42.392812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1c99d95c-e916-426c-a946-b1648fb4dfaa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:42.400009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c99d95c-e916-426c-a946-b1648fb4dfaa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:42.400467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c99d95c-e916-426c-a946-b1648fb4dfaa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:42.401262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c99d95c-e916-426c-a946-b1648fb4dfaa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:42.401704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c99d95c-e916-426c-a946-b1648fb4dfaa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:42.433078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1c99d95c-e916-426c-a946-b1648fb4dfaa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045017 Jun 02 19:05:42.433586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 313/612] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:42.636192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b61e0719-80f2-43f7-830f-0e8bfe11e5ac tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:42.636802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b61e0719-80f2-43f7-830f-0e8bfe11e5ac tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:42.645454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b61e0719-80f2-43f7-830f-0e8bfe11e5ac tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:42.645935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b61e0719-80f2-43f7-830f-0e8bfe11e5ac tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:42.646699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b61e0719-80f2-43f7-830f-0e8bfe11e5ac tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:42.647144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b61e0719-80f2-43f7-830f-0e8bfe11e5ac tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:42.787572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b61e0719-80f2-43f7-830f-0e8bfe11e5ac tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:42.795912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b61e0719-80f2-43f7-830f-0e8bfe11e5ac tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1364 microversion: 2.1 time: 0.164336 Jun 02 19:05:42.796480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 300/613] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:42 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:43.445309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9c1209ad-8d39-408f-adeb-22ac5dbfa53f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:43.446416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9c1209ad-8d39-408f-adeb-22ac5dbfa53f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:43.453737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c1209ad-8d39-408f-adeb-22ac5dbfa53f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:43.454229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c1209ad-8d39-408f-adeb-22ac5dbfa53f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:43.455014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c1209ad-8d39-408f-adeb-22ac5dbfa53f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:43.455455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c1209ad-8d39-408f-adeb-22ac5dbfa53f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:43.488567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9c1209ad-8d39-408f-adeb-22ac5dbfa53f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047184 Jun 02 19:05:43.489132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 314/614] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:43.817189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-34687393-e410-4d67-ae87-50cd281c57b4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:43.818129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-34687393-e410-4d67-ae87-50cd281c57b4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:43.830024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34687393-e410-4d67-ae87-50cd281c57b4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:43.830471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34687393-e410-4d67-ae87-50cd281c57b4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:43.831235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34687393-e410-4d67-ae87-50cd281c57b4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:43.831712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34687393-e410-4d67-ae87-50cd281c57b4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:43.974402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-34687393-e410-4d67-ae87-50cd281c57b4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:05:43.982396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-34687393-e410-4d67-ae87-50cd281c57b4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 200 len: 1555 microversion: 2.1 time: 0.169188 Jun 02 19:05:43.982978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 301/615] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:05:43 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:05:44.002031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c42d24f9-49fb-49db-812e-9d3d16be1f27 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:44.002856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c42d24f9-49fb-49db-812e-9d3d16be1f27 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:44.012355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c42d24f9-49fb-49db-812e-9d3d16be1f27 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:44.013067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c42d24f9-49fb-49db-812e-9d3d16be1f27 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:44.015636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c42d24f9-49fb-49db-812e-9d3d16be1f27 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:44.015636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c42d24f9-49fb-49db-812e-9d3d16be1f27 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:44.111736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c42d24f9-49fb-49db-812e-9d3d16be1f27 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116085 Jun 02 19:05:44.112308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 315/616] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Jun 2 19:05:43 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:44.501128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3b77ab7-05b1-444b-a6ba-ef635577487b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:44.502125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c3b77ab7-05b1-444b-a6ba-ef635577487b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:44.508252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3b77ab7-05b1-444b-a6ba-ef635577487b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:44.508783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3b77ab7-05b1-444b-a6ba-ef635577487b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:44.509567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3b77ab7-05b1-444b-a6ba-ef635577487b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:44.510020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3b77ab7-05b1-444b-a6ba-ef635577487b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:44.544799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3b77ab7-05b1-444b-a6ba-ef635577487b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047615 Jun 02 19:05:44.545597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 302/617] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:45.123886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-27432c8d-f0c5-4a25-b617-e0dcfdd84863 req-afd7183e-fe7c-4068-8652-7bbbbb503c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d285abbb-bcf6-43c7-be53-6b909c9bcce1", "tag": "45ad7fdf-8670-45bd-9a90-0be0f9bd7366"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:45.132379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-27432c8d-f0c5-4a25-b617-e0dcfdd84863 req-afd7183e-fe7c-4068-8652-7bbbbb503c41 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:45.132825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-27432c8d-f0c5-4a25-b617-e0dcfdd84863 req-afd7183e-fe7c-4068-8652-7bbbbb503c41 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:45.144842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-27432c8d-f0c5-4a25-b617-e0dcfdd84863 req-afd7183e-fe7c-4068-8652-7bbbbb503c41 service nova] Creating event network-changed:45ad7fdf-8670-45bd-9a90-0be0f9bd7366 for instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 on hv-cinder-79760 Jun 02 19:05:45.150479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-27432c8d-f0c5-4a25-b617-e0dcfdd84863 req-afd7183e-fe7c-4068-8652-7bbbbb503c41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030834 Jun 02 19:05:45.151105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 316/618] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:05:45.558462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3a27363-24bf-4faa-a28c-ecc9979e0361 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:45.559403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c3a27363-24bf-4faa-a28c-ecc9979e0361 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:45.566725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3a27363-24bf-4faa-a28c-ecc9979e0361 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:45.567527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3a27363-24bf-4faa-a28c-ecc9979e0361 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:45.568311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3a27363-24bf-4faa-a28c-ecc9979e0361 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:45.568739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3a27363-24bf-4faa-a28c-ecc9979e0361 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:45.605827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3a27363-24bf-4faa-a28c-ecc9979e0361 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052430 Jun 02 19:05:45.606423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 303/619] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:46.619430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ee24b12d-705b-4e91-8ace-796794f00c10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:46.620500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ee24b12d-705b-4e91-8ace-796794f00c10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:46.628000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee24b12d-705b-4e91-8ace-796794f00c10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:46.628457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee24b12d-705b-4e91-8ace-796794f00c10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:46.629238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee24b12d-705b-4e91-8ace-796794f00c10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:46.629673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee24b12d-705b-4e91-8ace-796794f00c10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:46.647291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:46.666762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ee24b12d-705b-4e91-8ace-796794f00c10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052572 Jun 02 19:05:46.667338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 317/620] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:47.680879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e8e5cd6a-5106-403c-aeb8-37bafa42cabc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:47.681864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e8e5cd6a-5106-403c-aeb8-37bafa42cabc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:47.689185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8e5cd6a-5106-403c-aeb8-37bafa42cabc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:47.689757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8e5cd6a-5106-403c-aeb8-37bafa42cabc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:47.690600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8e5cd6a-5106-403c-aeb8-37bafa42cabc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:47.691016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8e5cd6a-5106-403c-aeb8-37bafa42cabc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:47.693831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:47.724974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e8e5cd6a-5106-403c-aeb8-37bafa42cabc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048313 Jun 02 19:05:47.725567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 304/621] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:48.736650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-363d2393-2536-4646-9380-21f951532a1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:48.737576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-363d2393-2536-4646-9380-21f951532a1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:48.745235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-363d2393-2536-4646-9380-21f951532a1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:48.745689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-363d2393-2536-4646-9380-21f951532a1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:48.746577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-363d2393-2536-4646-9380-21f951532a1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:48.747018 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-363d2393-2536-4646-9380-21f951532a1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:48.781181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-363d2393-2536-4646-9380-21f951532a1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048458 Jun 02 19:05:48.781771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 318/622] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:49.794685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-66ec08f6-16a0-433e-89ad-bddb9d3cf85e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:49.797164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-66ec08f6-16a0-433e-89ad-bddb9d3cf85e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:49.804046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66ec08f6-16a0-433e-89ad-bddb9d3cf85e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:49.804480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66ec08f6-16a0-433e-89ad-bddb9d3cf85e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:49.805385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66ec08f6-16a0-433e-89ad-bddb9d3cf85e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:49.806091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66ec08f6-16a0-433e-89ad-bddb9d3cf85e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:49.842577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-66ec08f6-16a0-433e-89ad-bddb9d3cf85e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052033 Jun 02 19:05:49.843157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 305/623] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:50.855495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-be8d7651-2fc3-4a23-b84f-89a5e40f76d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:50.856380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-be8d7651-2fc3-4a23-b84f-89a5e40f76d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:50.863769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be8d7651-2fc3-4a23-b84f-89a5e40f76d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:50.864231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be8d7651-2fc3-4a23-b84f-89a5e40f76d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:50.865010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be8d7651-2fc3-4a23-b84f-89a5e40f76d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:50.865450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be8d7651-2fc3-4a23-b84f-89a5e40f76d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:50.896859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-be8d7651-2fc3-4a23-b84f-89a5e40f76d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045763 Jun 02 19:05:50.897442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 319/624] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:51.910028 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3957cdd3-deb5-4eda-b077-e6a298640240 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:51.910960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3957cdd3-deb5-4eda-b077-e6a298640240 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:51.919288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3957cdd3-deb5-4eda-b077-e6a298640240 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:51.919739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3957cdd3-deb5-4eda-b077-e6a298640240 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:51.920502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3957cdd3-deb5-4eda-b077-e6a298640240 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:51.921076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3957cdd3-deb5-4eda-b077-e6a298640240 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:51.954011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3957cdd3-deb5-4eda-b077-e6a298640240 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048442 Jun 02 19:05:51.954596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 306/625] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:52.966475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f3d46bf-402b-45be-836a-122b47805586 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:52.967428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1f3d46bf-402b-45be-836a-122b47805586 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:52.976015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f3d46bf-402b-45be-836a-122b47805586 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:52.976465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f3d46bf-402b-45be-836a-122b47805586 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:52.978007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f3d46bf-402b-45be-836a-122b47805586 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:52.978458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f3d46bf-402b-45be-836a-122b47805586 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:53.014979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1f3d46bf-402b-45be-836a-122b47805586 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053282 Jun 02 19:05:53.015556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 320/626] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:54.028611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-107aa5a1-3deb-47d6-8cf8-cd02b8f47776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:54.030642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-107aa5a1-3deb-47d6-8cf8-cd02b8f47776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:54.038043 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-107aa5a1-3deb-47d6-8cf8-cd02b8f47776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:54.038488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-107aa5a1-3deb-47d6-8cf8-cd02b8f47776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:54.039274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-107aa5a1-3deb-47d6-8cf8-cd02b8f47776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:54.039801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-107aa5a1-3deb-47d6-8cf8-cd02b8f47776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:54.077709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-107aa5a1-3deb-47d6-8cf8-cd02b8f47776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054254 Jun 02 19:05:54.078331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 307/627] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:55.089326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-088aa495-44a8-43ec-aed9-558aa66d6d29 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:55.090287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-088aa495-44a8-43ec-aed9-558aa66d6d29 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:55.097904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-088aa495-44a8-43ec-aed9-558aa66d6d29 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:55.098417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-088aa495-44a8-43ec-aed9-558aa66d6d29 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:55.099936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-088aa495-44a8-43ec-aed9-558aa66d6d29 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:55.100359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-088aa495-44a8-43ec-aed9-558aa66d6d29 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:55.133558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-088aa495-44a8-43ec-aed9-558aa66d6d29 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048415 Jun 02 19:05:55.134182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 321/628] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:56.145181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d8a628cf-3286-4da7-ab5b-030e843c50e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:56.146126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d8a628cf-3286-4da7-ab5b-030e843c50e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:56.153485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8a628cf-3286-4da7-ab5b-030e843c50e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:56.153972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8a628cf-3286-4da7-ab5b-030e843c50e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:56.154743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8a628cf-3286-4da7-ab5b-030e843c50e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:56.155176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8a628cf-3286-4da7-ab5b-030e843c50e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:56.188312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d8a628cf-3286-4da7-ab5b-030e843c50e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047109 Jun 02 19:05:56.188896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 308/629] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:57.201116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-25b18bc4-585a-4de0-a6de-299c58c0c449 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:57.202172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-25b18bc4-585a-4de0-a6de-299c58c0c449 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:57.209190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25b18bc4-585a-4de0-a6de-299c58c0c449 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:57.209645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25b18bc4-585a-4de0-a6de-299c58c0c449 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:57.210462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25b18bc4-585a-4de0-a6de-299c58c0c449 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:57.210899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25b18bc4-585a-4de0-a6de-299c58c0c449 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:57.242326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-25b18bc4-585a-4de0-a6de-299c58c0c449 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045674 Jun 02 19:05:57.242955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 322/630] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:58.254972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59ad6fd0-ba21-41e2-8d40-21b12853830a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:58.255894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-59ad6fd0-ba21-41e2-8d40-21b12853830a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:58.263478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59ad6fd0-ba21-41e2-8d40-21b12853830a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:58.263924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59ad6fd0-ba21-41e2-8d40-21b12853830a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:58.264671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59ad6fd0-ba21-41e2-8d40-21b12853830a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:58.265099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59ad6fd0-ba21-41e2-8d40-21b12853830a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:58.304428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-59ad6fd0-ba21-41e2-8d40-21b12853830a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053247 Jun 02 19:05:58.305332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 309/631] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:59.317849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0ff0def7-7d7c-4c53-95fd-d7ea98ea1a9f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:05:59.318733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0ff0def7-7d7c-4c53-95fd-d7ea98ea1a9f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:59.326376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ff0def7-7d7c-4c53-95fd-d7ea98ea1a9f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:59.326807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ff0def7-7d7c-4c53-95fd-d7ea98ea1a9f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:59.327590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ff0def7-7d7c-4c53-95fd-d7ea98ea1a9f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:59.328039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ff0def7-7d7c-4c53-95fd-d7ea98ea1a9f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:59.359557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0ff0def7-7d7c-4c53-95fd-d7ea98ea1a9f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045851 Jun 02 19:05:59.360144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 323/632] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:05:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:05:59.566171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7544c983-7798-4d0e-8a67-a78e77158093 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-967396446"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:05:59.567157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7544c983-7798-4d0e-8a67-a78e77158093 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:05:59.576655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7544c983-7798-4d0e-8a67-a78e77158093 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:59.577032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7544c983-7798-4d0e-8a67-a78e77158093 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:59.577777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7544c983-7798-4d0e-8a67-a78e77158093 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:05:59.578249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7544c983-7798-4d0e-8a67-a78e77158093 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:05:59.726579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.network.security_group_api [None req-7544c983-7798-4d0e-8a67-a78e77158093 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Removing security group 632a6aa2-8785-40da-9459-c4c725130424 from port dcfd3ee8-9442-4031-bf79-1d94f38ef91a Jun 02 19:06:00.139350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7544c983-7798-4d0e-8a67-a78e77158093 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/action" status: 202 len: 0 microversion: 2.1 time: 0.580056 Jun 02 19:06:00.140540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 310/633] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:05:59 2022] POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:06:00.153283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-08265380-5422-4513-a06c-13a89ae81380 req-85788e3c-d85a-445f-9c8c-71d4b0d410d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721b511d-9547-41f5-a72c-47179f69b6af", "tag": "dcfd3ee8-9442-4031-bf79-1d94f38ef91a"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:06:00.165922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-08265380-5422-4513-a06c-13a89ae81380 req-85788e3c-d85a-445f-9c8c-71d4b0d410d6 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:00.166779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-08265380-5422-4513-a06c-13a89ae81380 req-85788e3c-d85a-445f-9c8c-71d4b0d410d6 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:00.221962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-08265380-5422-4513-a06c-13a89ae81380 req-85788e3c-d85a-445f-9c8c-71d4b0d410d6 service nova] Creating event network-changed:dcfd3ee8-9442-4031-bf79-1d94f38ef91a for instance 721b511d-9547-41f5-a72c-47179f69b6af on hv-cinder-79760 Jun 02 19:06:00.231151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-08265380-5422-4513-a06c-13a89ae81380 req-85788e3c-d85a-445f-9c8c-71d4b0d410d6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084323 Jun 02 19:06:00.236035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 324/634] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:00.377405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0eb8e207-73df-4273-be51-23a88ed688d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:00.378570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0eb8e207-73df-4273-be51-23a88ed688d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:00.390254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0eb8e207-73df-4273-be51-23a88ed688d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:00.391194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0eb8e207-73df-4273-be51-23a88ed688d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:00.392271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0eb8e207-73df-4273-be51-23a88ed688d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:00.393901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0eb8e207-73df-4273-be51-23a88ed688d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:00.436763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0eb8e207-73df-4273-be51-23a88ed688d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068194 Jun 02 19:06:00.438259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 311/635] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:01.451245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9f16af5d-489d-4095-8933-ba63dbca34cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:01.452310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9f16af5d-489d-4095-8933-ba63dbca34cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:01.459485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f16af5d-489d-4095-8933-ba63dbca34cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:01.460185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f16af5d-489d-4095-8933-ba63dbca34cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:01.461488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f16af5d-489d-4095-8933-ba63dbca34cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:01.461961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f16af5d-489d-4095-8933-ba63dbca34cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:01.494667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9f16af5d-489d-4095-8933-ba63dbca34cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049451 Jun 02 19:06:01.495257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 325/636] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:01.593659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-21b93b8b-131a-4a07-b2b5-c122e2080c51 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d5cc27e-d3c0-40e3-bd95-99a6344b7e3a"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:06:01.594744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-21b93b8b-131a-4a07-b2b5-c122e2080c51 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:01.605214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21b93b8b-131a-4a07-b2b5-c122e2080c51 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:01.605354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21b93b8b-131a-4a07-b2b5-c122e2080c51 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:01.606379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21b93b8b-131a-4a07-b2b5-c122e2080c51 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:01.607089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21b93b8b-131a-4a07-b2b5-c122e2080c51 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:01.633863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c3e8b9a9-c9c7-4eea-8ad8-a64c68bf960f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:01.634745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c3e8b9a9-c9c7-4eea-8ad8-a64c68bf960f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:01.642451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c3e8b9a9-c9c7-4eea-8ad8-a64c68bf960f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:01.643523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c3e8b9a9-c9c7-4eea-8ad8-a64c68bf960f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:01.644634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c3e8b9a9-c9c7-4eea-8ad8-a64c68bf960f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:01.645302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c3e8b9a9-c9c7-4eea-8ad8-a64c68bf960f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:01.749384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-c3e8b9a9-c9c7-4eea-8ad8-a64c68bf960f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lazy-loading 'services' on Instance uuid 721b511d-9547-41f5-a72c-47179f69b6af {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:06:01.838372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c3e8b9a9-c9c7-4eea-8ad8-a64c68bf960f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c" status: 202 len: 0 microversion: 2.1 time: 0.208389 Jun 02 19:06:01.839972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 326/637] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:06:01 2022] DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 19:06:01.847769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-174ebdc2-853f-4835-be7b-b450a1b882bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:01.848801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-174ebdc2-853f-4835-be7b-b450a1b882bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:01.856212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-174ebdc2-853f-4835-be7b-b450a1b882bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:01.856652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-174ebdc2-853f-4835-be7b-b450a1b882bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:01.857428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-174ebdc2-853f-4835-be7b-b450a1b882bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:01.857891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-174ebdc2-853f-4835-be7b-b450a1b882bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:01.893917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-174ebdc2-853f-4835-be7b-b450a1b882bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050259 Jun 02 19:06:01.894510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 327/638] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:06:01.937201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-21b93b8b-131a-4a07-b2b5-c122e2080c51 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "POST /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347488 Jun 02 19:06:01.937857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 312/639] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:06:01 2022] POST /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:02.246456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-d1e25249-4612-4cf0-a548-5516fa9df558 req-535bdd76-0db8-4922-828d-1eeec3f1d4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721b511d-9547-41f5-a72c-47179f69b6af", "tag": "dcfd3ee8-9442-4031-bf79-1d94f38ef91a"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:06:02.255123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d1e25249-4612-4cf0-a548-5516fa9df558 req-535bdd76-0db8-4922-828d-1eeec3f1d4bc service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:02.255597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d1e25249-4612-4cf0-a548-5516fa9df558 req-535bdd76-0db8-4922-828d-1eeec3f1d4bc service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:02.268861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-d1e25249-4612-4cf0-a548-5516fa9df558 req-535bdd76-0db8-4922-828d-1eeec3f1d4bc service nova] Creating event network-changed:dcfd3ee8-9442-4031-bf79-1d94f38ef91a for instance 721b511d-9547-41f5-a72c-47179f69b6af on hv-cinder-79760 Jun 02 19:06:02.274250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-d1e25249-4612-4cf0-a548-5516fa9df558 req-535bdd76-0db8-4922-828d-1eeec3f1d4bc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Jun 02 19:06:02.274862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 328/640] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:02.509173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-73b35263-7dee-48af-9661-1316c27a4eb5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:02.509513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-73b35263-7dee-48af-9661-1316c27a4eb5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:02.516566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73b35263-7dee-48af-9661-1316c27a4eb5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:02.517225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73b35263-7dee-48af-9661-1316c27a4eb5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:02.518111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73b35263-7dee-48af-9661-1316c27a4eb5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:02.522550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73b35263-7dee-48af-9661-1316c27a4eb5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:02.558823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-73b35263-7dee-48af-9661-1316c27a4eb5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055645 Jun 02 19:06:02.562639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 313/641] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:02.907474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-faac062b-6b68-4822-95fa-6a227b8d8b29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:02.908479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-faac062b-6b68-4822-95fa-6a227b8d8b29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:02.915606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-faac062b-6b68-4822-95fa-6a227b8d8b29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:02.916050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-faac062b-6b68-4822-95fa-6a227b8d8b29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:02.916817 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-faac062b-6b68-4822-95fa-6a227b8d8b29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:02.917258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-faac062b-6b68-4822-95fa-6a227b8d8b29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:02.956072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-faac062b-6b68-4822-95fa-6a227b8d8b29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053493 Jun 02 19:06:02.956650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 329/642] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:03.570578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b7d7602-4ed1-40d7-bd63-acf1cf4bb051 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:03.572022 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b7d7602-4ed1-40d7-bd63-acf1cf4bb051 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:03.579561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b7d7602-4ed1-40d7-bd63-acf1cf4bb051 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:03.580012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b7d7602-4ed1-40d7-bd63-acf1cf4bb051 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:03.580780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b7d7602-4ed1-40d7-bd63-acf1cf4bb051 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:03.581214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b7d7602-4ed1-40d7-bd63-acf1cf4bb051 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:03.616454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b7d7602-4ed1-40d7-bd63-acf1cf4bb051 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050279 Jun 02 19:06:03.617043 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 314/643] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:03.968541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fde73371-61c2-46f0-9c06-99f19c1c1d0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:03.969465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fde73371-61c2-46f0-9c06-99f19c1c1d0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:03.976223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fde73371-61c2-46f0-9c06-99f19c1c1d0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:03.976679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fde73371-61c2-46f0-9c06-99f19c1c1d0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:03.977430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fde73371-61c2-46f0-9c06-99f19c1c1d0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:03.977888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fde73371-61c2-46f0-9c06-99f19c1c1d0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:04.008881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fde73371-61c2-46f0-9c06-99f19c1c1d0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Jun 02 19:06:04.009438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 330/644] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:04.630610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c27d6740-00db-4efe-9af6-4b49aff12f95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:04.631707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c27d6740-00db-4efe-9af6-4b49aff12f95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:04.639951 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c27d6740-00db-4efe-9af6-4b49aff12f95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:04.640669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c27d6740-00db-4efe-9af6-4b49aff12f95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:04.641494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c27d6740-00db-4efe-9af6-4b49aff12f95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:04.641945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c27d6740-00db-4efe-9af6-4b49aff12f95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:04.673883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c27d6740-00db-4efe-9af6-4b49aff12f95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048851 Jun 02 19:06:04.674483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 315/645] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:05.021182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ccfdf231-73bf-436e-b008-4944d293b5d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:05.022147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ccfdf231-73bf-436e-b008-4944d293b5d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:05.029418 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccfdf231-73bf-436e-b008-4944d293b5d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:05.029896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccfdf231-73bf-436e-b008-4944d293b5d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:05.030646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccfdf231-73bf-436e-b008-4944d293b5d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:05.031078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccfdf231-73bf-436e-b008-4944d293b5d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:05.064296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ccfdf231-73bf-436e-b008-4944d293b5d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Jun 02 19:06:05.064888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 331/646] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:05.687161 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-778a300e-f45a-43f6-967d-34f4dabe9507 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:05.688128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-778a300e-f45a-43f6-967d-34f4dabe9507 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:05.695154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-778a300e-f45a-43f6-967d-34f4dabe9507 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:05.695761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-778a300e-f45a-43f6-967d-34f4dabe9507 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:05.696457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-778a300e-f45a-43f6-967d-34f4dabe9507 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:05.696921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-778a300e-f45a-43f6-967d-34f4dabe9507 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:05.729119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-778a300e-f45a-43f6-967d-34f4dabe9507 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045975 Jun 02 19:06:05.729736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 316/647] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:06.078740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d3fb81a8-f58f-4f21-9d16-f5dfe4b1a0a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:06.080244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d3fb81a8-f58f-4f21-9d16-f5dfe4b1a0a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:06.088808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3fb81a8-f58f-4f21-9d16-f5dfe4b1a0a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:06.089262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3fb81a8-f58f-4f21-9d16-f5dfe4b1a0a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:06.090100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3fb81a8-f58f-4f21-9d16-f5dfe4b1a0a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:06.090530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3fb81a8-f58f-4f21-9d16-f5dfe4b1a0a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:06.121516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d3fb81a8-f58f-4f21-9d16-f5dfe4b1a0a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049381 Jun 02 19:06:06.122017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 332/648] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:06.744108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4dda54b3-2f9e-485a-a000-0eed80e500f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:06.745114 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4dda54b3-2f9e-485a-a000-0eed80e500f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:06.753092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dda54b3-2f9e-485a-a000-0eed80e500f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:06.753536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dda54b3-2f9e-485a-a000-0eed80e500f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:06.754337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dda54b3-2f9e-485a-a000-0eed80e500f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:06.754765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dda54b3-2f9e-485a-a000-0eed80e500f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:06.787664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4dda54b3-2f9e-485a-a000-0eed80e500f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048200 Jun 02 19:06:06.788224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 317/649] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:07.135397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fd3c786d-23eb-42a0-b391-c23e3447c391 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:07.136732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fd3c786d-23eb-42a0-b391-c23e3447c391 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:07.145047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd3c786d-23eb-42a0-b391-c23e3447c391 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:07.145413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd3c786d-23eb-42a0-b391-c23e3447c391 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:07.146786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd3c786d-23eb-42a0-b391-c23e3447c391 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:07.147504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd3c786d-23eb-42a0-b391-c23e3447c391 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:07.186114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fd3c786d-23eb-42a0-b391-c23e3447c391 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055216 Jun 02 19:06:07.186701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 333/650] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:07.802901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-78df21fa-157e-4177-9d78-5158ef13c89b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:07.804250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-78df21fa-157e-4177-9d78-5158ef13c89b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:07.811391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78df21fa-157e-4177-9d78-5158ef13c89b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:07.811840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78df21fa-157e-4177-9d78-5158ef13c89b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:07.812615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78df21fa-157e-4177-9d78-5158ef13c89b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:07.813046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78df21fa-157e-4177-9d78-5158ef13c89b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:07.847226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-78df21fa-157e-4177-9d78-5158ef13c89b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050604 Jun 02 19:06:07.847807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 318/651] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:08.199492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c18cc15c-ba5c-4d68-8860-f9a956fe30f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:08.200485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c18cc15c-ba5c-4d68-8860-f9a956fe30f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:08.207598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c18cc15c-ba5c-4d68-8860-f9a956fe30f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:08.208046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c18cc15c-ba5c-4d68-8860-f9a956fe30f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:08.208811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c18cc15c-ba5c-4d68-8860-f9a956fe30f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:08.209242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c18cc15c-ba5c-4d68-8860-f9a956fe30f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:08.234727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:08.241374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c18cc15c-ba5c-4d68-8860-f9a956fe30f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046996 Jun 02 19:06:08.242019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 334/652] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:08.863757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-52da9609-acef-4449-9192-527baaa3c11f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:08.864946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-52da9609-acef-4449-9192-527baaa3c11f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:08.872132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52da9609-acef-4449-9192-527baaa3c11f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:08.872604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52da9609-acef-4449-9192-527baaa3c11f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:08.873432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52da9609-acef-4449-9192-527baaa3c11f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:08.873898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52da9609-acef-4449-9192-527baaa3c11f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:08.899979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:08.907128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-52da9609-acef-4449-9192-527baaa3c11f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050385 Jun 02 19:06:08.907717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 319/653] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:09.255420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9bd944bf-3b65-4055-944c-a39ad69290e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:09.256356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9bd944bf-3b65-4055-944c-a39ad69290e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:09.263820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bd944bf-3b65-4055-944c-a39ad69290e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:09.264280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bd944bf-3b65-4055-944c-a39ad69290e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:09.265061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bd944bf-3b65-4055-944c-a39ad69290e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:09.265504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bd944bf-3b65-4055-944c-a39ad69290e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:09.300485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9bd944bf-3b65-4055-944c-a39ad69290e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049605 Jun 02 19:06:09.301058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 335/654] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:06:09.920291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-74677c05-255a-404b-86fb-2e7ba91e24d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:09.921244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-74677c05-255a-404b-86fb-2e7ba91e24d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:09.924366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=48 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:09.932509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74677c05-255a-404b-86fb-2e7ba91e24d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:09.932946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74677c05-255a-404b-86fb-2e7ba91e24d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:09.933714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74677c05-255a-404b-86fb-2e7ba91e24d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:09.934262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74677c05-255a-404b-86fb-2e7ba91e24d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:09.968339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-74677c05-255a-404b-86fb-2e7ba91e24d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052650 Jun 02 19:06:09.968923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 320/655] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:10.312861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f30f5293-a12a-4606-beb9-9b05b313a61a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:10.313905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f30f5293-a12a-4606-beb9-9b05b313a61a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:10.323641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f30f5293-a12a-4606-beb9-9b05b313a61a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:10.324087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f30f5293-a12a-4606-beb9-9b05b313a61a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:10.324863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f30f5293-a12a-4606-beb9-9b05b313a61a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:10.325291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f30f5293-a12a-4606-beb9-9b05b313a61a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:10.356574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f30f5293-a12a-4606-beb9-9b05b313a61a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047691 Jun 02 19:06:10.357125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 336/656] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:10.981745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-56beef6f-4043-4c91-bb24-3a5b5f1f2247 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:10.982711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-56beef6f-4043-4c91-bb24-3a5b5f1f2247 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:10.990032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56beef6f-4043-4c91-bb24-3a5b5f1f2247 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:10.990482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56beef6f-4043-4c91-bb24-3a5b5f1f2247 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:10.991256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56beef6f-4043-4c91-bb24-3a5b5f1f2247 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:10.991681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56beef6f-4043-4c91-bb24-3a5b5f1f2247 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:11.023809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-56beef6f-4043-4c91-bb24-3a5b5f1f2247 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046912 Jun 02 19:06:11.024404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 321/657] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:11.369156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3d39f6b5-40fa-48d1-8807-6e018b80e9a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:11.370099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3d39f6b5-40fa-48d1-8807-6e018b80e9a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:11.372533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=50 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:11.378918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d39f6b5-40fa-48d1-8807-6e018b80e9a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:11.379367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d39f6b5-40fa-48d1-8807-6e018b80e9a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:11.380133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d39f6b5-40fa-48d1-8807-6e018b80e9a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:11.380575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d39f6b5-40fa-48d1-8807-6e018b80e9a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:11.418794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3d39f6b5-40fa-48d1-8807-6e018b80e9a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054010 Jun 02 19:06:11.419370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 337/658] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:12.037660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b8a80995-a5a9-4fc6-ae3c-ba1793bce260 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:12.038789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b8a80995-a5a9-4fc6-ae3c-ba1793bce260 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:12.046118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8a80995-a5a9-4fc6-ae3c-ba1793bce260 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:12.046596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8a80995-a5a9-4fc6-ae3c-ba1793bce260 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:12.047377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8a80995-a5a9-4fc6-ae3c-ba1793bce260 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:12.047832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8a80995-a5a9-4fc6-ae3c-ba1793bce260 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:12.080851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b8a80995-a5a9-4fc6-ae3c-ba1793bce260 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047593 Jun 02 19:06:12.081421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 322/659] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:12.430886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d8bdf86-beb1-4a14-baa5-a0e4e25e51ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:12.431818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d8bdf86-beb1-4a14-baa5-a0e4e25e51ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:12.439034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf86-beb1-4a14-baa5-a0e4e25e51ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:12.439490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf86-beb1-4a14-baa5-a0e4e25e51ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:12.440262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf86-beb1-4a14-baa5-a0e4e25e51ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:12.440696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf86-beb1-4a14-baa5-a0e4e25e51ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:12.486080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d8bdf86-beb1-4a14-baa5-a0e4e25e51ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059265 Jun 02 19:06:12.486673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 338/660] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:13.094112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6bd07e10-86b3-4b56-bf39-f0945084ca80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:13.095176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6bd07e10-86b3-4b56-bf39-f0945084ca80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:13.102567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bd07e10-86b3-4b56-bf39-f0945084ca80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:13.103010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bd07e10-86b3-4b56-bf39-f0945084ca80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:13.103777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bd07e10-86b3-4b56-bf39-f0945084ca80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:13.104201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bd07e10-86b3-4b56-bf39-f0945084ca80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:13.135409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6bd07e10-86b3-4b56-bf39-f0945084ca80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045685 Jun 02 19:06:13.135956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 323/661] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:13.498592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bb1bb8d3-4065-4440-be70-d26e9afbcdc5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:13.499537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bb1bb8d3-4065-4440-be70-d26e9afbcdc5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:13.506986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb1bb8d3-4065-4440-be70-d26e9afbcdc5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:13.507599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb1bb8d3-4065-4440-be70-d26e9afbcdc5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:13.508388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb1bb8d3-4065-4440-be70-d26e9afbcdc5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:13.508828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb1bb8d3-4065-4440-be70-d26e9afbcdc5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:13.540954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bb1bb8d3-4065-4440-be70-d26e9afbcdc5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046383 Jun 02 19:06:13.541524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 339/662] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:14.148105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-58fcd98e-88cc-43e8-b1cc-d0cbdc0cfe07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:14.149116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-58fcd98e-88cc-43e8-b1cc-d0cbdc0cfe07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:14.156754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58fcd98e-88cc-43e8-b1cc-d0cbdc0cfe07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:14.157195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58fcd98e-88cc-43e8-b1cc-d0cbdc0cfe07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:14.158129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58fcd98e-88cc-43e8-b1cc-d0cbdc0cfe07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:14.158550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58fcd98e-88cc-43e8-b1cc-d0cbdc0cfe07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:14.191484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-58fcd98e-88cc-43e8-b1cc-d0cbdc0cfe07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047147 Jun 02 19:06:14.192105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 324/663] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:14.553012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cabf7b4f-8c89-41ee-a3fc-f1806e183aff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:14.553980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cabf7b4f-8c89-41ee-a3fc-f1806e183aff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:14.561175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cabf7b4f-8c89-41ee-a3fc-f1806e183aff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:14.561631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cabf7b4f-8c89-41ee-a3fc-f1806e183aff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:14.562441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cabf7b4f-8c89-41ee-a3fc-f1806e183aff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:14.562911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cabf7b4f-8c89-41ee-a3fc-f1806e183aff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:14.594701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cabf7b4f-8c89-41ee-a3fc-f1806e183aff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Jun 02 19:06:14.595301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 340/664] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:15.205682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fea4fe1a-7a56-4ae7-9f83-eeb4ace63b9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:15.206641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fea4fe1a-7a56-4ae7-9f83-eeb4ace63b9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:15.216072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fea4fe1a-7a56-4ae7-9f83-eeb4ace63b9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:15.216553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fea4fe1a-7a56-4ae7-9f83-eeb4ace63b9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:15.217353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fea4fe1a-7a56-4ae7-9f83-eeb4ace63b9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:15.217783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fea4fe1a-7a56-4ae7-9f83-eeb4ace63b9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:15.250281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fea4fe1a-7a56-4ae7-9f83-eeb4ace63b9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048609 Jun 02 19:06:15.250859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 325/665] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:15.606546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f010babb-e9d6-4fbc-9a9b-68a9dab18ede tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:15.607648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f010babb-e9d6-4fbc-9a9b-68a9dab18ede tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:15.616614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f010babb-e9d6-4fbc-9a9b-68a9dab18ede tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:15.617338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f010babb-e9d6-4fbc-9a9b-68a9dab18ede tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:15.618650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f010babb-e9d6-4fbc-9a9b-68a9dab18ede tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:15.619370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f010babb-e9d6-4fbc-9a9b-68a9dab18ede tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:15.821820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f010babb-e9d6-4fbc-9a9b-68a9dab18ede tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219217 Jun 02 19:06:15.822416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 341/666] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:16.264305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-da672d89-5f71-4e78-a9a1-91199c1f8dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:16.265666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-da672d89-5f71-4e78-a9a1-91199c1f8dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:16.274409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da672d89-5f71-4e78-a9a1-91199c1f8dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:16.275216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da672d89-5f71-4e78-a9a1-91199c1f8dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:16.276219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da672d89-5f71-4e78-a9a1-91199c1f8dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:16.276643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da672d89-5f71-4e78-a9a1-91199c1f8dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:16.311852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-da672d89-5f71-4e78-a9a1-91199c1f8dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052287 Jun 02 19:06:16.312412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 326/667] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:16.834020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0591e74a-df65-40f0-915e-facf998c97d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:16.834959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0591e74a-df65-40f0-915e-facf998c97d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:16.842137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0591e74a-df65-40f0-915e-facf998c97d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:16.842599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0591e74a-df65-40f0-915e-facf998c97d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:16.843523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0591e74a-df65-40f0-915e-facf998c97d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:16.844000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0591e74a-df65-40f0-915e-facf998c97d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:16.875696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0591e74a-df65-40f0-915e-facf998c97d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045636 Jun 02 19:06:16.876250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 342/668] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:17.329127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-845493e4-dd16-4f3b-ad4d-0f60fcbba731 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:17.331434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-845493e4-dd16-4f3b-ad4d-0f60fcbba731 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:17.342872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-845493e4-dd16-4f3b-ad4d-0f60fcbba731 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:17.343531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-845493e4-dd16-4f3b-ad4d-0f60fcbba731 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:17.344679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-845493e4-dd16-4f3b-ad4d-0f60fcbba731 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:17.345323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-845493e4-dd16-4f3b-ad4d-0f60fcbba731 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:17.383124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-845493e4-dd16-4f3b-ad4d-0f60fcbba731 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062061 Jun 02 19:06:17.383939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 327/669] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:17.887157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c1304a36-c164-465c-8bed-1ccc56679c8d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:17.888157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c1304a36-c164-465c-8bed-1ccc56679c8d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:17.895010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1304a36-c164-465c-8bed-1ccc56679c8d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:17.895456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1304a36-c164-465c-8bed-1ccc56679c8d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:17.896224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1304a36-c164-465c-8bed-1ccc56679c8d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:17.896660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1304a36-c164-465c-8bed-1ccc56679c8d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:17.928278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c1304a36-c164-465c-8bed-1ccc56679c8d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045541 Jun 02 19:06:17.928869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 343/670] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:18.395175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-297c3c15-e382-42c1-8b0b-b3b5226fb860 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:18.396136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-297c3c15-e382-42c1-8b0b-b3b5226fb860 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:18.403865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-297c3c15-e382-42c1-8b0b-b3b5226fb860 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:18.404300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-297c3c15-e382-42c1-8b0b-b3b5226fb860 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:18.405235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-297c3c15-e382-42c1-8b0b-b3b5226fb860 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:18.405670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-297c3c15-e382-42c1-8b0b-b3b5226fb860 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:18.439476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-297c3c15-e382-42c1-8b0b-b3b5226fb860 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048312 Jun 02 19:06:18.440058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 328/671] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:18.939622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f0bfc551-8bb8-418d-a946-0bb0b77f9e6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:18.940593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f0bfc551-8bb8-418d-a946-0bb0b77f9e6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:18.949137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0bfc551-8bb8-418d-a946-0bb0b77f9e6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:18.949618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0bfc551-8bb8-418d-a946-0bb0b77f9e6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:18.950462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0bfc551-8bb8-418d-a946-0bb0b77f9e6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:18.951100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0bfc551-8bb8-418d-a946-0bb0b77f9e6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:18.983457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f0bfc551-8bb8-418d-a946-0bb0b77f9e6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047758 Jun 02 19:06:18.983993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 344/672] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:19.453608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9dfff425-0de9-4508-beb8-7ab8cf219df2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:19.454570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9dfff425-0de9-4508-beb8-7ab8cf219df2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:19.464014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9dfff425-0de9-4508-beb8-7ab8cf219df2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:19.464462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9dfff425-0de9-4508-beb8-7ab8cf219df2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:19.465237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9dfff425-0de9-4508-beb8-7ab8cf219df2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:19.465674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9dfff425-0de9-4508-beb8-7ab8cf219df2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:19.495872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9dfff425-0de9-4508-beb8-7ab8cf219df2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046443 Jun 02 19:06:19.496451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 329/673] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:19.995132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f05d601c-dace-4b82-97f5-f7402d550f11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:19.996122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f05d601c-dace-4b82-97f5-f7402d550f11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:20.002989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f05d601c-dace-4b82-97f5-f7402d550f11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:20.003429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f05d601c-dace-4b82-97f5-f7402d550f11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:20.004287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f05d601c-dace-4b82-97f5-f7402d550f11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:20.004727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f05d601c-dace-4b82-97f5-f7402d550f11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:20.042092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f05d601c-dace-4b82-97f5-f7402d550f11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Jun 02 19:06:20.042092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 345/674] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:20.508627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea49c8b7-81ba-4ada-89b2-406251afb5ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:20.510538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ea49c8b7-81ba-4ada-89b2-406251afb5ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:20.518582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea49c8b7-81ba-4ada-89b2-406251afb5ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:20.519036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea49c8b7-81ba-4ada-89b2-406251afb5ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:20.519851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea49c8b7-81ba-4ada-89b2-406251afb5ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:20.520278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea49c8b7-81ba-4ada-89b2-406251afb5ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:20.552584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ea49c8b7-81ba-4ada-89b2-406251afb5ea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048248 Jun 02 19:06:20.553160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 330/675] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:21.048756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-35c1c78f-60f5-45ed-a21d-4ccfb69d253a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:21.049717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-35c1c78f-60f5-45ed-a21d-4ccfb69d253a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:21.057472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35c1c78f-60f5-45ed-a21d-4ccfb69d253a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:21.057972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35c1c78f-60f5-45ed-a21d-4ccfb69d253a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:21.058765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35c1c78f-60f5-45ed-a21d-4ccfb69d253a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:21.059218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35c1c78f-60f5-45ed-a21d-4ccfb69d253a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:21.092797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-35c1c78f-60f5-45ed-a21d-4ccfb69d253a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047971 Jun 02 19:06:21.096831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 346/676] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:21.162203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-de60b512-8bda-4e96-a9b0-7392696438c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:21.162696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-de60b512-8bda-4e96-a9b0-7392696438c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:21.169843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de60b512-8bda-4e96-a9b0-7392696438c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:21.170286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de60b512-8bda-4e96-a9b0-7392696438c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:21.171048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de60b512-8bda-4e96-a9b0-7392696438c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:21.171480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de60b512-8bda-4e96-a9b0-7392696438c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:21.196315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-de60b512-8bda-4e96-a9b0-7392696438c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1/ips" status: 200 len: 151 microversion: 2.1 time: 0.037974 Jun 02 19:06:21.202837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 331/677] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:06:21 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:21.566829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d164bc14-7172-4c5f-b277-eda0b21b82d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:21.568651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d164bc14-7172-4c5f-b277-eda0b21b82d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:21.576209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d164bc14-7172-4c5f-b277-eda0b21b82d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:21.576640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d164bc14-7172-4c5f-b277-eda0b21b82d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:21.577421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d164bc14-7172-4c5f-b277-eda0b21b82d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:21.577883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d164bc14-7172-4c5f-b277-eda0b21b82d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:21.611725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d164bc14-7172-4c5f-b277-eda0b21b82d4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050286 Jun 02 19:06:21.612296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 347/678] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:22.107187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4776ec0c-4a77-4f25-9dfc-c1918b9c67d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:22.108807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4776ec0c-4a77-4f25-9dfc-c1918b9c67d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:22.118422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4776ec0c-4a77-4f25-9dfc-c1918b9c67d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:22.118903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4776ec0c-4a77-4f25-9dfc-c1918b9c67d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:22.119654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4776ec0c-4a77-4f25-9dfc-c1918b9c67d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:22.120087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4776ec0c-4a77-4f25-9dfc-c1918b9c67d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:22.151523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4776ec0c-4a77-4f25-9dfc-c1918b9c67d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049617 Jun 02 19:06:22.152484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 332/679] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:22.625154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1abca888-356d-4159-b815-995b0f2997f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:22.626154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1abca888-356d-4159-b815-995b0f2997f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:22.636757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1abca888-356d-4159-b815-995b0f2997f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:22.637124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1abca888-356d-4159-b815-995b0f2997f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:22.637932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1abca888-356d-4159-b815-995b0f2997f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:22.638371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1abca888-356d-4159-b815-995b0f2997f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:22.678597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1abca888-356d-4159-b815-995b0f2997f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057476 Jun 02 19:06:22.679136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 348/680] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:23.164631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e08cace3-e896-4a46-88c9-a6f3e219d277 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:23.167679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e08cace3-e896-4a46-88c9-a6f3e219d277 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:23.173033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e08cace3-e896-4a46-88c9-a6f3e219d277 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:23.173443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e08cace3-e896-4a46-88c9-a6f3e219d277 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:23.174248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e08cace3-e896-4a46-88c9-a6f3e219d277 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:23.174660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e08cace3-e896-4a46-88c9-a6f3e219d277 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:23.207412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e08cace3-e896-4a46-88c9-a6f3e219d277 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047902 Jun 02 19:06:23.208035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 333/681] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:23.690356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b9b70447-deca-4f74-a57b-9200df59c4b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:23.691294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b9b70447-deca-4f74-a57b-9200df59c4b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:23.699015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9b70447-deca-4f74-a57b-9200df59c4b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:23.699469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9b70447-deca-4f74-a57b-9200df59c4b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:23.700252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9b70447-deca-4f74-a57b-9200df59c4b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:23.700710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9b70447-deca-4f74-a57b-9200df59c4b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:23.732097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b9b70447-deca-4f74-a57b-9200df59c4b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045751 Jun 02 19:06:23.732669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 349/682] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:24.218738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-341ce36a-3cf4-4924-82e4-82d263cb78ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:24.219658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-341ce36a-3cf4-4924-82e4-82d263cb78ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:24.227412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-341ce36a-3cf4-4924-82e4-82d263cb78ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:24.227799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-341ce36a-3cf4-4924-82e4-82d263cb78ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:24.229114 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-341ce36a-3cf4-4924-82e4-82d263cb78ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:24.229551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-341ce36a-3cf4-4924-82e4-82d263cb78ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:24.264432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-341ce36a-3cf4-4924-82e4-82d263cb78ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049681 Jun 02 19:06:24.265499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 334/683] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:24.744796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-040ac4ad-d0bb-495f-9e7d-884d105207a3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:24.745876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-040ac4ad-d0bb-495f-9e7d-884d105207a3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:24.757041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-040ac4ad-d0bb-495f-9e7d-884d105207a3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:24.757865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-040ac4ad-d0bb-495f-9e7d-884d105207a3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:24.759265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-040ac4ad-d0bb-495f-9e7d-884d105207a3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:24.759686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-040ac4ad-d0bb-495f-9e7d-884d105207a3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:24.791706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-040ac4ad-d0bb-495f-9e7d-884d105207a3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051003 Jun 02 19:06:24.792169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 350/684] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:25.277106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f9b7b077-2ee5-4771-a8b5-eb0c23a1436b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:25.278083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f9b7b077-2ee5-4771-a8b5-eb0c23a1436b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:25.285104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9b7b077-2ee5-4771-a8b5-eb0c23a1436b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:25.285552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9b7b077-2ee5-4771-a8b5-eb0c23a1436b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:25.286345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9b7b077-2ee5-4771-a8b5-eb0c23a1436b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:25.286780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9b7b077-2ee5-4771-a8b5-eb0c23a1436b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:25.322175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f9b7b077-2ee5-4771-a8b5-eb0c23a1436b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049606 Jun 02 19:06:25.323350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 335/685] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:25.804961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bdc2546c-f81d-4f7e-af3d-6ad8258b8dda tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:25.806007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bdc2546c-f81d-4f7e-af3d-6ad8258b8dda tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:25.815647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdc2546c-f81d-4f7e-af3d-6ad8258b8dda tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:25.816178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdc2546c-f81d-4f7e-af3d-6ad8258b8dda tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:25.816954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdc2546c-f81d-4f7e-af3d-6ad8258b8dda tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:25.817393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdc2546c-f81d-4f7e-af3d-6ad8258b8dda tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:25.833388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:25.850907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bdc2546c-f81d-4f7e-af3d-6ad8258b8dda tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051584 Jun 02 19:06:25.851466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 351/686] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:26.334834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e809ea2e-02d4-4956-ba27-78c36043810c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:26.335761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e809ea2e-02d4-4956-ba27-78c36043810c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:26.342780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e809ea2e-02d4-4956-ba27-78c36043810c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:26.343218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e809ea2e-02d4-4956-ba27-78c36043810c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:26.343978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e809ea2e-02d4-4956-ba27-78c36043810c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:26.344406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e809ea2e-02d4-4956-ba27-78c36043810c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:26.370763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:26.378058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e809ea2e-02d4-4956-ba27-78c36043810c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047207 Jun 02 19:06:26.378665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 336/687] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:26.866289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e349f9f9-08a2-4a4a-8aed-faea88eaa527 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:26.867427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e349f9f9-08a2-4a4a-8aed-faea88eaa527 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:26.875730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e349f9f9-08a2-4a4a-8aed-faea88eaa527 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:26.876195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e349f9f9-08a2-4a4a-8aed-faea88eaa527 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:26.876979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e349f9f9-08a2-4a4a-8aed-faea88eaa527 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:26.877425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e349f9f9-08a2-4a4a-8aed-faea88eaa527 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:26.908501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e349f9f9-08a2-4a4a-8aed-faea88eaa527 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048277 Jun 02 19:06:26.912962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 352/688] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:27.390853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-76175f45-84b0-447f-b9a8-016077fd23b0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:27.391792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-76175f45-84b0-447f-b9a8-016077fd23b0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:27.399928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76175f45-84b0-447f-b9a8-016077fd23b0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:27.400399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76175f45-84b0-447f-b9a8-016077fd23b0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:27.401392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76175f45-84b0-447f-b9a8-016077fd23b0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:27.401851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76175f45-84b0-447f-b9a8-016077fd23b0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:27.435973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-76175f45-84b0-447f-b9a8-016077fd23b0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049501 Jun 02 19:06:27.436879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 337/689] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:27.923109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cfe02f48-24f5-46c2-b6fd-8454e8af4b94 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:27.923974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cfe02f48-24f5-46c2-b6fd-8454e8af4b94 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:27.932384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cfe02f48-24f5-46c2-b6fd-8454e8af4b94 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:27.932836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cfe02f48-24f5-46c2-b6fd-8454e8af4b94 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:27.933617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cfe02f48-24f5-46c2-b6fd-8454e8af4b94 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:27.934088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cfe02f48-24f5-46c2-b6fd-8454e8af4b94 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:27.966412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cfe02f48-24f5-46c2-b6fd-8454e8af4b94 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047377 Jun 02 19:06:27.966978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 353/690] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:28.447658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b9ff315-6c36-400b-83b4-e90c8f8bb513 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:28.448992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b9ff315-6c36-400b-83b4-e90c8f8bb513 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:28.456166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b9ff315-6c36-400b-83b4-e90c8f8bb513 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:28.456535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b9ff315-6c36-400b-83b4-e90c8f8bb513 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:28.457318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b9ff315-6c36-400b-83b4-e90c8f8bb513 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:28.457751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b9ff315-6c36-400b-83b4-e90c8f8bb513 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:28.491531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b9ff315-6c36-400b-83b4-e90c8f8bb513 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Jun 02 19:06:28.492855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 338/691] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:28.979556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-007cc10a-55ad-4e23-9424-d900405f1134 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:28.980497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-007cc10a-55ad-4e23-9424-d900405f1134 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:28.987796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-007cc10a-55ad-4e23-9424-d900405f1134 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:28.988255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-007cc10a-55ad-4e23-9424-d900405f1134 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:28.989062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-007cc10a-55ad-4e23-9424-d900405f1134 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:28.989499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-007cc10a-55ad-4e23-9424-d900405f1134 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:29.021836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-007cc10a-55ad-4e23-9424-d900405f1134 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046953 Jun 02 19:06:29.022618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 354/692] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:29.501178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6d6cd293-a31c-4608-9c9d-e461a1a300b3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:29.502126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6d6cd293-a31c-4608-9c9d-e461a1a300b3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:29.509543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6cd293-a31c-4608-9c9d-e461a1a300b3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:29.510111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6cd293-a31c-4608-9c9d-e461a1a300b3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:29.510885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6cd293-a31c-4608-9c9d-e461a1a300b3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:29.511283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6cd293-a31c-4608-9c9d-e461a1a300b3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:29.545390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6d6cd293-a31c-4608-9c9d-e461a1a300b3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048171 Jun 02 19:06:29.545991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 339/693] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:30.223983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-38382cf5-3433-458c-8031-af3007f3d6f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:30.225388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-38382cf5-3433-458c-8031-af3007f3d6f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:30.233682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38382cf5-3433-458c-8031-af3007f3d6f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:30.234124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38382cf5-3433-458c-8031-af3007f3d6f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:30.234913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38382cf5-3433-458c-8031-af3007f3d6f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:30.235361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38382cf5-3433-458c-8031-af3007f3d6f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:30.268875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-38382cf5-3433-458c-8031-af3007f3d6f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.238589 Jun 02 19:06:30.269636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 355/694] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:30.557724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ceb8891d-dcc2-44e8-8c6c-e19484a9b048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:30.558723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ceb8891d-dcc2-44e8-8c6c-e19484a9b048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:30.565577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceb8891d-dcc2-44e8-8c6c-e19484a9b048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:30.566081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceb8891d-dcc2-44e8-8c6c-e19484a9b048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:30.566855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceb8891d-dcc2-44e8-8c6c-e19484a9b048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:30.567282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceb8891d-dcc2-44e8-8c6c-e19484a9b048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:30.598811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ceb8891d-dcc2-44e8-8c6c-e19484a9b048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Jun 02 19:06:30.599388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 340/695] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:31.281578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d61abfb-ab67-4e81-abd5-1050e4f057f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:31.282457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d61abfb-ab67-4e81-abd5-1050e4f057f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:31.289931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d61abfb-ab67-4e81-abd5-1050e4f057f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:31.290533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d61abfb-ab67-4e81-abd5-1050e4f057f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:31.291464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d61abfb-ab67-4e81-abd5-1050e4f057f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:31.291904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d61abfb-ab67-4e81-abd5-1050e4f057f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:31.324294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d61abfb-ab67-4e81-abd5-1050e4f057f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046849 Jun 02 19:06:31.324892 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 356/696] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:31.613399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-84584e08-0616-47f2-9754-b4272a4b7d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:31.614403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84584e08-0616-47f2-9754-b4272a4b7d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:31.622198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84584e08-0616-47f2-9754-b4272a4b7d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:31.622643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84584e08-0616-47f2-9754-b4272a4b7d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:31.623412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84584e08-0616-47f2-9754-b4272a4b7d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:31.623841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84584e08-0616-47f2-9754-b4272a4b7d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:31.655798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-84584e08-0616-47f2-9754-b4272a4b7d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047299 Jun 02 19:06:31.656377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 341/697] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:32.337046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-da714726-735e-4194-85fb-37369dc68b3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:32.337962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-da714726-735e-4194-85fb-37369dc68b3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:32.345140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da714726-735e-4194-85fb-37369dc68b3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:32.345594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da714726-735e-4194-85fb-37369dc68b3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:32.346415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da714726-735e-4194-85fb-37369dc68b3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:32.346851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da714726-735e-4194-85fb-37369dc68b3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:32.379454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-da714726-735e-4194-85fb-37369dc68b3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046184 Jun 02 19:06:32.379870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 357/698] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:32.669583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16d7611c-63c1-48aa-9f1e-b01ee50514a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:32.670548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-16d7611c-63c1-48aa-9f1e-b01ee50514a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:32.678090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16d7611c-63c1-48aa-9f1e-b01ee50514a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:32.678719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16d7611c-63c1-48aa-9f1e-b01ee50514a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:32.679911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16d7611c-63c1-48aa-9f1e-b01ee50514a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:32.680502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16d7611c-63c1-48aa-9f1e-b01ee50514a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:32.718394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16d7611c-63c1-48aa-9f1e-b01ee50514a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053961 Jun 02 19:06:32.718975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 342/699] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:33.391449 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-87550096-bd40-4e20-8fcf-089ff027d4db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:33.392406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-87550096-bd40-4e20-8fcf-089ff027d4db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:33.399906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-87550096-bd40-4e20-8fcf-089ff027d4db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:33.400433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-87550096-bd40-4e20-8fcf-089ff027d4db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:33.401666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-87550096-bd40-4e20-8fcf-089ff027d4db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:33.402429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-87550096-bd40-4e20-8fcf-089ff027d4db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:33.437124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-87550096-bd40-4e20-8fcf-089ff027d4db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049900 Jun 02 19:06:33.437672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 358/700] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:33.733432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2e8a80fa-d1f9-4dac-9287-f9f1d87cc260 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:33.734958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2e8a80fa-d1f9-4dac-9287-f9f1d87cc260 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:33.742348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e8a80fa-d1f9-4dac-9287-f9f1d87cc260 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:33.742825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e8a80fa-d1f9-4dac-9287-f9f1d87cc260 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:33.743640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e8a80fa-d1f9-4dac-9287-f9f1d87cc260 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:33.744218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e8a80fa-d1f9-4dac-9287-f9f1d87cc260 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:33.777406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2e8a80fa-d1f9-4dac-9287-f9f1d87cc260 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050275 Jun 02 19:06:33.778021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 343/701] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:34.449925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f18b38fd-b79a-4f19-8c2c-cd79cc1db1da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:34.450897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f18b38fd-b79a-4f19-8c2c-cd79cc1db1da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:34.457979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f18b38fd-b79a-4f19-8c2c-cd79cc1db1da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:34.458436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f18b38fd-b79a-4f19-8c2c-cd79cc1db1da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:34.459240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f18b38fd-b79a-4f19-8c2c-cd79cc1db1da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:34.459673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f18b38fd-b79a-4f19-8c2c-cd79cc1db1da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:34.494311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f18b38fd-b79a-4f19-8c2c-cd79cc1db1da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049203 Jun 02 19:06:34.494883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 359/702] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:34.790338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6f255850-d1b4-4532-acd4-1b679d9c2863 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:34.791299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6f255850-d1b4-4532-acd4-1b679d9c2863 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:34.798862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f255850-d1b4-4532-acd4-1b679d9c2863 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:34.799315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f255850-d1b4-4532-acd4-1b679d9c2863 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:34.800073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f255850-d1b4-4532-acd4-1b679d9c2863 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:34.800519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f255850-d1b4-4532-acd4-1b679d9c2863 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:34.832951 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6f255850-d1b4-4532-acd4-1b679d9c2863 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Jun 02 19:06:34.833554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 344/703] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:35.510502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-09814c5f-33d5-47a5-85f9-773e458393f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:35.511862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-09814c5f-33d5-47a5-85f9-773e458393f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:35.520650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09814c5f-33d5-47a5-85f9-773e458393f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:35.521102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09814c5f-33d5-47a5-85f9-773e458393f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:35.521918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09814c5f-33d5-47a5-85f9-773e458393f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:35.522360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09814c5f-33d5-47a5-85f9-773e458393f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:35.554935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-09814c5f-33d5-47a5-85f9-773e458393f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051434 Jun 02 19:06:35.555588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 360/704] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:35.844966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a5949cd9-76d6-4664-9f5a-9fdf04665a12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:35.845788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a5949cd9-76d6-4664-9f5a-9fdf04665a12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:35.853142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5949cd9-76d6-4664-9f5a-9fdf04665a12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:35.853589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5949cd9-76d6-4664-9f5a-9fdf04665a12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:35.854387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5949cd9-76d6-4664-9f5a-9fdf04665a12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:35.854812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5949cd9-76d6-4664-9f5a-9fdf04665a12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:35.890383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a5949cd9-76d6-4664-9f5a-9fdf04665a12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049451 Jun 02 19:06:35.890949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 345/705] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:36.567569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f2d2a204-9832-49cb-87fb-2df26b71afe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:36.568504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f2d2a204-9832-49cb-87fb-2df26b71afe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:36.576457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2d2a204-9832-49cb-87fb-2df26b71afe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:36.576908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2d2a204-9832-49cb-87fb-2df26b71afe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:36.577693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2d2a204-9832-49cb-87fb-2df26b71afe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:36.578166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2d2a204-9832-49cb-87fb-2df26b71afe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:36.610217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f2d2a204-9832-49cb-87fb-2df26b71afe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046675 Jun 02 19:06:36.610812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 361/706] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:36.903280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-85294315-9401-419e-a69e-3e9a52cf7a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:36.904214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-85294315-9401-419e-a69e-3e9a52cf7a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:36.911279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85294315-9401-419e-a69e-3e9a52cf7a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:36.911734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85294315-9401-419e-a69e-3e9a52cf7a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:36.912507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85294315-9401-419e-a69e-3e9a52cf7a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:36.912939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85294315-9401-419e-a69e-3e9a52cf7a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:36.943786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-85294315-9401-419e-a69e-3e9a52cf7a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 Jun 02 19:06:36.944406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 346/707] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:37.622940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bfb780c1-bc7a-4e83-898b-d6285db16995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:37.623770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bfb780c1-bc7a-4e83-898b-d6285db16995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:37.630703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfb780c1-bc7a-4e83-898b-d6285db16995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:37.631152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfb780c1-bc7a-4e83-898b-d6285db16995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:37.631922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfb780c1-bc7a-4e83-898b-d6285db16995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:37.632358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfb780c1-bc7a-4e83-898b-d6285db16995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:37.665351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bfb780c1-bc7a-4e83-898b-d6285db16995 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046672 Jun 02 19:06:37.665951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 362/708] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:37.957151 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-166b22fc-c174-42cc-a411-8dbfdf848852 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:37.958109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-166b22fc-c174-42cc-a411-8dbfdf848852 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:37.966185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-166b22fc-c174-42cc-a411-8dbfdf848852 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:37.966633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-166b22fc-c174-42cc-a411-8dbfdf848852 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:37.967410 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-166b22fc-c174-42cc-a411-8dbfdf848852 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:37.967848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-166b22fc-c174-42cc-a411-8dbfdf848852 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:38.001282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-166b22fc-c174-42cc-a411-8dbfdf848852 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048119 Jun 02 19:06:38.002361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 347/709] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:38.678077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-00ec21af-90b9-4856-8d88-4237ff489a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:38.679040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-00ec21af-90b9-4856-8d88-4237ff489a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:38.686157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00ec21af-90b9-4856-8d88-4237ff489a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:38.686741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00ec21af-90b9-4856-8d88-4237ff489a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:38.687510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00ec21af-90b9-4856-8d88-4237ff489a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:38.687941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00ec21af-90b9-4856-8d88-4237ff489a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:38.719792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-00ec21af-90b9-4856-8d88-4237ff489a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045926 Jun 02 19:06:38.720326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 363/710] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:39.014149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-52bff630-f175-4456-85cf-ee59dfabff15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:39.015095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-52bff630-f175-4456-85cf-ee59dfabff15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:39.024006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52bff630-f175-4456-85cf-ee59dfabff15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:39.024459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52bff630-f175-4456-85cf-ee59dfabff15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:39.025269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52bff630-f175-4456-85cf-ee59dfabff15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:39.025729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52bff630-f175-4456-85cf-ee59dfabff15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:39.057520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-52bff630-f175-4456-85cf-ee59dfabff15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047519 Jun 02 19:06:39.058167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 348/711] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:39.731690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6dfdd9e2-d445-4270-b69a-2df629587495 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:39.732519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6dfdd9e2-d445-4270-b69a-2df629587495 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:39.739582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dfdd9e2-d445-4270-b69a-2df629587495 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:39.740033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dfdd9e2-d445-4270-b69a-2df629587495 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:39.740789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dfdd9e2-d445-4270-b69a-2df629587495 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:39.741226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dfdd9e2-d445-4270-b69a-2df629587495 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:39.771503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6dfdd9e2-d445-4270-b69a-2df629587495 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044044 Jun 02 19:06:39.772046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 364/712] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:40.073572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a296b4c1-263c-4a05-9f19-1100c52acd54 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:40.074999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a296b4c1-263c-4a05-9f19-1100c52acd54 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:40.077524 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=58 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:40.084418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a296b4c1-263c-4a05-9f19-1100c52acd54 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:40.085182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a296b4c1-263c-4a05-9f19-1100c52acd54 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:40.086214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a296b4c1-263c-4a05-9f19-1100c52acd54 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:40.086718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a296b4c1-263c-4a05-9f19-1100c52acd54 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:40.118970 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a296b4c1-263c-4a05-9f19-1100c52acd54 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052421 Jun 02 19:06:40.119550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 349/713] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:40.784301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-372c03ad-b46c-405f-8cbd-f31081a6cda6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:40.785148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-372c03ad-b46c-405f-8cbd-f31081a6cda6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:40.792668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-372c03ad-b46c-405f-8cbd-f31081a6cda6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:40.793104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-372c03ad-b46c-405f-8cbd-f31081a6cda6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:40.793911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-372c03ad-b46c-405f-8cbd-f31081a6cda6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:40.794350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-372c03ad-b46c-405f-8cbd-f31081a6cda6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:40.831384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-372c03ad-b46c-405f-8cbd-f31081a6cda6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051447 Jun 02 19:06:40.831945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 365/714] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:41.132683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-69e807ed-bf05-4657-9ac7-6dae3dc9bed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:41.133617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-69e807ed-bf05-4657-9ac7-6dae3dc9bed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:41.142606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69e807ed-bf05-4657-9ac7-6dae3dc9bed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:41.143264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69e807ed-bf05-4657-9ac7-6dae3dc9bed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:41.144415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69e807ed-bf05-4657-9ac7-6dae3dc9bed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:41.145054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69e807ed-bf05-4657-9ac7-6dae3dc9bed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:41.181655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-69e807ed-bf05-4657-9ac7-6dae3dc9bed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053960 Jun 02 19:06:41.182369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 350/715] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:41.846291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4cce05e0-ba71-4e78-bc70-650ae7933b0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:41.847622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4cce05e0-ba71-4e78-bc70-650ae7933b0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:41.850256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=58 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:41.855782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4cce05e0-ba71-4e78-bc70-650ae7933b0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:41.856278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4cce05e0-ba71-4e78-bc70-650ae7933b0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:41.857046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4cce05e0-ba71-4e78-bc70-650ae7933b0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:41.857498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4cce05e0-ba71-4e78-bc70-650ae7933b0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:41.891726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4cce05e0-ba71-4e78-bc70-650ae7933b0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050484 Jun 02 19:06:41.892304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 366/716] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:42.195660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6d76e3c4-fb72-458a-9753-9520868a82b9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:42.196575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6d76e3c4-fb72-458a-9753-9520868a82b9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:42.205125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d76e3c4-fb72-458a-9753-9520868a82b9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:42.205564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d76e3c4-fb72-458a-9753-9520868a82b9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:42.206369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d76e3c4-fb72-458a-9753-9520868a82b9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:42.206801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d76e3c4-fb72-458a-9753-9520868a82b9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:42.237770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6d76e3c4-fb72-458a-9753-9520868a82b9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Jun 02 19:06:42.239265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 351/717] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:42.904414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b74b9a03-e007-4357-9431-33dbb4a26f6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:42.905344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b74b9a03-e007-4357-9431-33dbb4a26f6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:42.912547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b74b9a03-e007-4357-9431-33dbb4a26f6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:42.912963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b74b9a03-e007-4357-9431-33dbb4a26f6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:42.913732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b74b9a03-e007-4357-9431-33dbb4a26f6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:42.914195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b74b9a03-e007-4357-9431-33dbb4a26f6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:42.949643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b74b9a03-e007-4357-9431-33dbb4a26f6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049610 Jun 02 19:06:42.950245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 367/718] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:43.249663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c24fb7df-d028-434f-b3b7-46d761fdbf99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:43.250523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c24fb7df-d028-434f-b3b7-46d761fdbf99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:43.258162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c24fb7df-d028-434f-b3b7-46d761fdbf99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:43.258628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c24fb7df-d028-434f-b3b7-46d761fdbf99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:43.259400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c24fb7df-d028-434f-b3b7-46d761fdbf99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:43.259921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c24fb7df-d028-434f-b3b7-46d761fdbf99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:43.291014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c24fb7df-d028-434f-b3b7-46d761fdbf99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Jun 02 19:06:43.291733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 352/719] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:43.960946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-27f27cf7-9f1e-4a90-8b87-4baa7a6d78c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:43.961912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-27f27cf7-9f1e-4a90-8b87-4baa7a6d78c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:43.970637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27f27cf7-9f1e-4a90-8b87-4baa7a6d78c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:43.971264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27f27cf7-9f1e-4a90-8b87-4baa7a6d78c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:43.972461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27f27cf7-9f1e-4a90-8b87-4baa7a6d78c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:43.973095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27f27cf7-9f1e-4a90-8b87-4baa7a6d78c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:43.975749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:44.005414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-27f27cf7-9f1e-4a90-8b87-4baa7a6d78c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048432 Jun 02 19:06:44.005998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 368/720] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:44.303320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8eb57d0b-289b-4a38-9476-9a3f6fee60b5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:44.304247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8eb57d0b-289b-4a38-9476-9a3f6fee60b5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:44.312752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8eb57d0b-289b-4a38-9476-9a3f6fee60b5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:44.313195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8eb57d0b-289b-4a38-9476-9a3f6fee60b5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:44.314058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8eb57d0b-289b-4a38-9476-9a3f6fee60b5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:44.314489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8eb57d0b-289b-4a38-9476-9a3f6fee60b5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:44.333888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:44.347884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8eb57d0b-289b-4a38-9476-9a3f6fee60b5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048582 Jun 02 19:06:44.348470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 353/721] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:45.018537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78441a02-d1d3-446c-95a1-ff201c18b314 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:45.020116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78441a02-d1d3-446c-95a1-ff201c18b314 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:45.027455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78441a02-d1d3-446c-95a1-ff201c18b314 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:45.027910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78441a02-d1d3-446c-95a1-ff201c18b314 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:45.028691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78441a02-d1d3-446c-95a1-ff201c18b314 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:45.029124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78441a02-d1d3-446c-95a1-ff201c18b314 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:45.064106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78441a02-d1d3-446c-95a1-ff201c18b314 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050390 Jun 02 19:06:45.064583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 369/722] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:45.364267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cd556994-8e86-40c7-9bde-dd8cf3d5f1aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:45.365228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cd556994-8e86-40c7-9bde-dd8cf3d5f1aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:45.372810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd556994-8e86-40c7-9bde-dd8cf3d5f1aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:45.373255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd556994-8e86-40c7-9bde-dd8cf3d5f1aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:45.374061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd556994-8e86-40c7-9bde-dd8cf3d5f1aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:45.374484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd556994-8e86-40c7-9bde-dd8cf3d5f1aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:45.406951 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cd556994-8e86-40c7-9bde-dd8cf3d5f1aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049623 Jun 02 19:06:45.407521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 354/723] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:46.076934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e153e149-cd8d-4c59-97f0-aaf87ebe5705 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:46.077912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e153e149-cd8d-4c59-97f0-aaf87ebe5705 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:46.085377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e153e149-cd8d-4c59-97f0-aaf87ebe5705 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:46.085843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e153e149-cd8d-4c59-97f0-aaf87ebe5705 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:46.086651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e153e149-cd8d-4c59-97f0-aaf87ebe5705 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:46.087094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e153e149-cd8d-4c59-97f0-aaf87ebe5705 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:46.118673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e153e149-cd8d-4c59-97f0-aaf87ebe5705 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046380 Jun 02 19:06:46.119139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 370/724] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:46.419075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d89e792-1a32-4507-b827-618836f637df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:46.420003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9d89e792-1a32-4507-b827-618836f637df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:46.426964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d89e792-1a32-4507-b827-618836f637df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:46.427412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d89e792-1a32-4507-b827-618836f637df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:46.428178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d89e792-1a32-4507-b827-618836f637df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:46.428609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d89e792-1a32-4507-b827-618836f637df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:46.458917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9d89e792-1a32-4507-b827-618836f637df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Jun 02 19:06:46.459488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 355/725] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:47.130775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3f5ebb2a-246c-4ed6-ae9e-daf28d17dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:47.131725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3f5ebb2a-246c-4ed6-ae9e-daf28d17dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:47.138944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f5ebb2a-246c-4ed6-ae9e-daf28d17dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:47.139387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f5ebb2a-246c-4ed6-ae9e-daf28d17dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:47.140178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f5ebb2a-246c-4ed6-ae9e-daf28d17dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:47.140616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f5ebb2a-246c-4ed6-ae9e-daf28d17dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:47.172784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3f5ebb2a-246c-4ed6-ae9e-daf28d17dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045988 Jun 02 19:06:47.173308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 371/726] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:47.471582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-31f5025c-08fb-42a1-9f8c-dd82d8ab291c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:47.472409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-31f5025c-08fb-42a1-9f8c-dd82d8ab291c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:47.479618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31f5025c-08fb-42a1-9f8c-dd82d8ab291c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:47.480061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31f5025c-08fb-42a1-9f8c-dd82d8ab291c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:47.481061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31f5025c-08fb-42a1-9f8c-dd82d8ab291c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:47.481862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31f5025c-08fb-42a1-9f8c-dd82d8ab291c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:47.517468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-31f5025c-08fb-42a1-9f8c-dd82d8ab291c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049955 Jun 02 19:06:47.518320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 356/727] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:48.185399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3ea51569-3bef-4fc4-959a-93cbf5e80f3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:48.186353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3ea51569-3bef-4fc4-959a-93cbf5e80f3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:48.193459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3ea51569-3bef-4fc4-959a-93cbf5e80f3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:48.193941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3ea51569-3bef-4fc4-959a-93cbf5e80f3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:48.194717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3ea51569-3bef-4fc4-959a-93cbf5e80f3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:48.195151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3ea51569-3bef-4fc4-959a-93cbf5e80f3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:48.228116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3ea51569-3bef-4fc4-959a-93cbf5e80f3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047069 Jun 02 19:06:48.228592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 372/728] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:48.529309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0184f085-92ea-42d1-a6eb-aa53fb198ffd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:48.530256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0184f085-92ea-42d1-a6eb-aa53fb198ffd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:48.537313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0184f085-92ea-42d1-a6eb-aa53fb198ffd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:48.537762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0184f085-92ea-42d1-a6eb-aa53fb198ffd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:48.538569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0184f085-92ea-42d1-a6eb-aa53fb198ffd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:48.539000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0184f085-92ea-42d1-a6eb-aa53fb198ffd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:48.570102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0184f085-92ea-42d1-a6eb-aa53fb198ffd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Jun 02 19:06:48.570676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 357/729] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:49.240750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-200538bb-2b43-4c75-9d44-e70f2a455c33 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:49.241681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-200538bb-2b43-4c75-9d44-e70f2a455c33 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:49.248854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-200538bb-2b43-4c75-9d44-e70f2a455c33 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:49.249297 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-200538bb-2b43-4c75-9d44-e70f2a455c33 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:49.250406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-200538bb-2b43-4c75-9d44-e70f2a455c33 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:49.250911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-200538bb-2b43-4c75-9d44-e70f2a455c33 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:49.284504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-200538bb-2b43-4c75-9d44-e70f2a455c33 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047907 Jun 02 19:06:49.284990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 373/730] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:49.583123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f60f4836-35b4-4d7b-ba0c-96305549b7bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:49.584162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f60f4836-35b4-4d7b-ba0c-96305549b7bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:49.591293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f60f4836-35b4-4d7b-ba0c-96305549b7bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:49.591743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f60f4836-35b4-4d7b-ba0c-96305549b7bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:49.592520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f60f4836-35b4-4d7b-ba0c-96305549b7bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:49.592956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f60f4836-35b4-4d7b-ba0c-96305549b7bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:49.624584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f60f4836-35b4-4d7b-ba0c-96305549b7bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045466 Jun 02 19:06:49.625340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 358/731] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:50.296930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b507defb-9425-4626-bdf0-611d3cb13ce9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:50.297900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b507defb-9425-4626-bdf0-611d3cb13ce9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:50.305058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b507defb-9425-4626-bdf0-611d3cb13ce9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:50.305510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b507defb-9425-4626-bdf0-611d3cb13ce9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:50.306311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b507defb-9425-4626-bdf0-611d3cb13ce9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:50.306745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b507defb-9425-4626-bdf0-611d3cb13ce9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:50.337463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b507defb-9425-4626-bdf0-611d3cb13ce9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044546 Jun 02 19:06:50.338141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 374/732] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:50.637565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-57c3d05c-8a10-452a-b1a5-3e764679e64e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:50.638741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-57c3d05c-8a10-452a-b1a5-3e764679e64e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:50.646037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57c3d05c-8a10-452a-b1a5-3e764679e64e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:50.646484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57c3d05c-8a10-452a-b1a5-3e764679e64e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:50.647262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57c3d05c-8a10-452a-b1a5-3e764679e64e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:50.647694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57c3d05c-8a10-452a-b1a5-3e764679e64e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:50.679815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-57c3d05c-8a10-452a-b1a5-3e764679e64e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Jun 02 19:06:50.680410 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 359/733] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:51.353542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5a4dc54f-0e32-4321-bc1e-e37a2a8cccbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:51.354727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5a4dc54f-0e32-4321-bc1e-e37a2a8cccbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:51.362539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a4dc54f-0e32-4321-bc1e-e37a2a8cccbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:51.363162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a4dc54f-0e32-4321-bc1e-e37a2a8cccbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:51.363940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a4dc54f-0e32-4321-bc1e-e37a2a8cccbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:51.364381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a4dc54f-0e32-4321-bc1e-e37a2a8cccbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:51.396509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5a4dc54f-0e32-4321-bc1e-e37a2a8cccbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050394 Jun 02 19:06:51.397062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 375/734] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:51.693391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a6ea8154-0878-4d27-aa3e-6eaf477251c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:51.694338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a6ea8154-0878-4d27-aa3e-6eaf477251c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:51.701830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6ea8154-0878-4d27-aa3e-6eaf477251c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:51.702286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6ea8154-0878-4d27-aa3e-6eaf477251c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:51.703043 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6ea8154-0878-4d27-aa3e-6eaf477251c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:51.703468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6ea8154-0878-4d27-aa3e-6eaf477251c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:51.736462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a6ea8154-0878-4d27-aa3e-6eaf477251c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047155 Jun 02 19:06:51.737042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 360/735] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:52.408803 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-901ce928-b42d-4a98-bf60-3b19f93756d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:52.409758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-901ce928-b42d-4a98-bf60-3b19f93756d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:52.418988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-901ce928-b42d-4a98-bf60-3b19f93756d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:52.419432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-901ce928-b42d-4a98-bf60-3b19f93756d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:52.420213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-901ce928-b42d-4a98-bf60-3b19f93756d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:52.420679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-901ce928-b42d-4a98-bf60-3b19f93756d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:52.451521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-901ce928-b42d-4a98-bf60-3b19f93756d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046736 Jun 02 19:06:52.451997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 376/736] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:52.750434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f05da053-d44c-4e43-aa59-c8dfbd9065d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:52.751331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f05da053-d44c-4e43-aa59-c8dfbd9065d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:52.758554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f05da053-d44c-4e43-aa59-c8dfbd9065d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:52.759008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f05da053-d44c-4e43-aa59-c8dfbd9065d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:52.759783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f05da053-d44c-4e43-aa59-c8dfbd9065d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:52.760221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f05da053-d44c-4e43-aa59-c8dfbd9065d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:52.794795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f05da053-d44c-4e43-aa59-c8dfbd9065d9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048855 Jun 02 19:06:52.795379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 361/737] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:53.465788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7cbef4f4-8308-4a5e-b703-4383456a8198 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:53.466763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7cbef4f4-8308-4a5e-b703-4383456a8198 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:53.473690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cbef4f4-8308-4a5e-b703-4383456a8198 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:53.474184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cbef4f4-8308-4a5e-b703-4383456a8198 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:53.474965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cbef4f4-8308-4a5e-b703-4383456a8198 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:53.475404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cbef4f4-8308-4a5e-b703-4383456a8198 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:53.508618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7cbef4f4-8308-4a5e-b703-4383456a8198 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048743 Jun 02 19:06:53.509086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 377/738] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:53.808073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e3cc99c8-f96e-4757-8b3f-0c6321caa2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:53.809113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e3cc99c8-f96e-4757-8b3f-0c6321caa2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:53.816223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3cc99c8-f96e-4757-8b3f-0c6321caa2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:53.816670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3cc99c8-f96e-4757-8b3f-0c6321caa2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:53.817429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3cc99c8-f96e-4757-8b3f-0c6321caa2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:53.817887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3cc99c8-f96e-4757-8b3f-0c6321caa2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:53.848357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e3cc99c8-f96e-4757-8b3f-0c6321caa2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Jun 02 19:06:53.848940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 362/739] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:54.523602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d62416b0-a148-4848-bf31-cf3df035e108 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:54.524518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d62416b0-a148-4848-bf31-cf3df035e108 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:54.531875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d62416b0-a148-4848-bf31-cf3df035e108 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:54.532333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d62416b0-a148-4848-bf31-cf3df035e108 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:54.536516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d62416b0-a148-4848-bf31-cf3df035e108 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:54.536516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d62416b0-a148-4848-bf31-cf3df035e108 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:54.565980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d62416b0-a148-4848-bf31-cf3df035e108 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046642 Jun 02 19:06:54.566546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 378/740] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:54.860687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-28f6a9a5-5947-41d1-99d9-1af287c32934 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:54.861529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-28f6a9a5-5947-41d1-99d9-1af287c32934 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:54.868541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28f6a9a5-5947-41d1-99d9-1af287c32934 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:54.869000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28f6a9a5-5947-41d1-99d9-1af287c32934 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:54.869741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28f6a9a5-5947-41d1-99d9-1af287c32934 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:54.870227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28f6a9a5-5947-41d1-99d9-1af287c32934 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:54.900584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-28f6a9a5-5947-41d1-99d9-1af287c32934 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Jun 02 19:06:54.901157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 363/741] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:55.578928 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7b205a18-2d4f-4c98-8a61-1944e524e480 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:55.579861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7b205a18-2d4f-4c98-8a61-1944e524e480 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:55.587869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b205a18-2d4f-4c98-8a61-1944e524e480 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:55.588604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b205a18-2d4f-4c98-8a61-1944e524e480 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:55.589881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b205a18-2d4f-4c98-8a61-1944e524e480 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:55.590585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b205a18-2d4f-4c98-8a61-1944e524e480 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:55.620281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7b205a18-2d4f-4c98-8a61-1944e524e480 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045591 Jun 02 19:06:55.620763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 379/742] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:55.912952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b3fc66b5-70c4-45a8-994f-4a2edcd53c67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:55.913913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b3fc66b5-70c4-45a8-994f-4a2edcd53c67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:55.921710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3fc66b5-70c4-45a8-994f-4a2edcd53c67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:55.922193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3fc66b5-70c4-45a8-994f-4a2edcd53c67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:55.922968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3fc66b5-70c4-45a8-994f-4a2edcd53c67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:55.923405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3fc66b5-70c4-45a8-994f-4a2edcd53c67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:55.955113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b3fc66b5-70c4-45a8-994f-4a2edcd53c67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046119 Jun 02 19:06:55.955685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 364/743] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:56.633214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f6c49d86-f203-4a4d-8dca-29a432aec1c9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:56.634205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f6c49d86-f203-4a4d-8dca-29a432aec1c9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:56.641390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6c49d86-f203-4a4d-8dca-29a432aec1c9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:56.641838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6c49d86-f203-4a4d-8dca-29a432aec1c9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:56.642631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6c49d86-f203-4a4d-8dca-29a432aec1c9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:56.643067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6c49d86-f203-4a4d-8dca-29a432aec1c9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:56.674171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f6c49d86-f203-4a4d-8dca-29a432aec1c9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045169 Jun 02 19:06:56.674745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 380/744] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:56.968381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2e33ea41-10a3-4864-bd58-12f835e6fd05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:56.969352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2e33ea41-10a3-4864-bd58-12f835e6fd05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:56.976361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e33ea41-10a3-4864-bd58-12f835e6fd05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:56.976812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e33ea41-10a3-4864-bd58-12f835e6fd05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:56.977589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e33ea41-10a3-4864-bd58-12f835e6fd05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:56.978140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e33ea41-10a3-4864-bd58-12f835e6fd05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:57.011864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2e33ea41-10a3-4864-bd58-12f835e6fd05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048210 Jun 02 19:06:57.012444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 365/745] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:57.686773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1414a866-0926-4513-ad9c-217b8fc547c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:57.687737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1414a866-0926-4513-ad9c-217b8fc547c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:57.694841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1414a866-0926-4513-ad9c-217b8fc547c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:57.695314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1414a866-0926-4513-ad9c-217b8fc547c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:57.696089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1414a866-0926-4513-ad9c-217b8fc547c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:57.696530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1414a866-0926-4513-ad9c-217b8fc547c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:57.727903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1414a866-0926-4513-ad9c-217b8fc547c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045306 Jun 02 19:06:57.728368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 381/746] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:58.024460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f6e821e0-7375-4125-91c5-589a70d36647 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:58.025293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f6e821e0-7375-4125-91c5-589a70d36647 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:58.032715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6e821e0-7375-4125-91c5-589a70d36647 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:58.033168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6e821e0-7375-4125-91c5-589a70d36647 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:58.033978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6e821e0-7375-4125-91c5-589a70d36647 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:58.034419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6e821e0-7375-4125-91c5-589a70d36647 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:58.066670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f6e821e0-7375-4125-91c5-589a70d36647 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Jun 02 19:06:58.067263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 366/747] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:06:58.742994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-63c98db9-8216-4f0c-a33b-d38909b05c23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:58.743941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-63c98db9-8216-4f0c-a33b-d38909b05c23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:58.751428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63c98db9-8216-4f0c-a33b-d38909b05c23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:58.751870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63c98db9-8216-4f0c-a33b-d38909b05c23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:58.752635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63c98db9-8216-4f0c-a33b-d38909b05c23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:58.753065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63c98db9-8216-4f0c-a33b-d38909b05c23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:58.789551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-63c98db9-8216-4f0c-a33b-d38909b05c23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052084 Jun 02 19:06:58.790413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 382/748] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:59.079386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4fae618d-b749-4ce1-80b5-48de5040d6a5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:59.080250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4fae618d-b749-4ce1-80b5-48de5040d6a5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:59.087010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fae618d-b749-4ce1-80b5-48de5040d6a5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:59.087463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fae618d-b749-4ce1-80b5-48de5040d6a5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:59.088222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fae618d-b749-4ce1-80b5-48de5040d6a5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:59.088655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fae618d-b749-4ce1-80b5-48de5040d6a5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:59.119312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4fae618d-b749-4ce1-80b5-48de5040d6a5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Jun 02 19:06:59.119956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 367/749] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:06:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:06:59.802423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f6cf1e91-49b9-43f1-af59-78eedcc2d44d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:06:59.803258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f6cf1e91-49b9-43f1-af59-78eedcc2d44d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:06:59.810711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6cf1e91-49b9-43f1-af59-78eedcc2d44d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:59.811267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6cf1e91-49b9-43f1-af59-78eedcc2d44d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:59.812049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6cf1e91-49b9-43f1-af59-78eedcc2d44d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:06:59.812483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6cf1e91-49b9-43f1-af59-78eedcc2d44d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:06:59.859733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f6cf1e91-49b9-43f1-af59-78eedcc2d44d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061520 Jun 02 19:06:59.860327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 383/750] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:06:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:00.131562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-715fe1bc-b85f-4fab-942b-cfd2e12ee3a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:00.132493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-715fe1bc-b85f-4fab-942b-cfd2e12ee3a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:00.139165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-715fe1bc-b85f-4fab-942b-cfd2e12ee3a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:00.139613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-715fe1bc-b85f-4fab-942b-cfd2e12ee3a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:00.140381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-715fe1bc-b85f-4fab-942b-cfd2e12ee3a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:00.140812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-715fe1bc-b85f-4fab-942b-cfd2e12ee3a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:00.171921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-715fe1bc-b85f-4fab-942b-cfd2e12ee3a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Jun 02 19:07:00.172506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 368/751] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:00.872253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6be7b417-2ad6-4d59-8d04-6b21729a6c4b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:00.873091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6be7b417-2ad6-4d59-8d04-6b21729a6c4b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:00.879826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6be7b417-2ad6-4d59-8d04-6b21729a6c4b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:00.880278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6be7b417-2ad6-4d59-8d04-6b21729a6c4b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:00.881046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6be7b417-2ad6-4d59-8d04-6b21729a6c4b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:00.881476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6be7b417-2ad6-4d59-8d04-6b21729a6c4b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:00.906778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:00.913429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6be7b417-2ad6-4d59-8d04-6b21729a6c4b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045380 Jun 02 19:07:00.914032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 384/752] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:01.183857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6aa594a3-63c1-4145-801f-d4b1bf8c356c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:01.184813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6aa594a3-63c1-4145-801f-d4b1bf8c356c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:01.191927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6aa594a3-63c1-4145-801f-d4b1bf8c356c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:01.192370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6aa594a3-63c1-4145-801f-d4b1bf8c356c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:01.193134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6aa594a3-63c1-4145-801f-d4b1bf8c356c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:01.193556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6aa594a3-63c1-4145-801f-d4b1bf8c356c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:01.234848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6aa594a3-63c1-4145-801f-d4b1bf8c356c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054791 Jun 02 19:07:01.235797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 369/753] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:01.925495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-88eb7566-c162-4bed-aee7-9393db3872cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:01.926468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-88eb7566-c162-4bed-aee7-9393db3872cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:01.939744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88eb7566-c162-4bed-aee7-9393db3872cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:01.940192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88eb7566-c162-4bed-aee7-9393db3872cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:01.940980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88eb7566-c162-4bed-aee7-9393db3872cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:01.941418 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88eb7566-c162-4bed-aee7-9393db3872cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:01.974593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-88eb7566-c162-4bed-aee7-9393db3872cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053353 Jun 02 19:07:01.975174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 385/754] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:02.248168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-478b913f-8f2d-4f30-af26-5fcd0443e1bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:02.249080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-478b913f-8f2d-4f30-af26-5fcd0443e1bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:02.256414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-478b913f-8f2d-4f30-af26-5fcd0443e1bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:02.256979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-478b913f-8f2d-4f30-af26-5fcd0443e1bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:02.257759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-478b913f-8f2d-4f30-af26-5fcd0443e1bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:02.258218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-478b913f-8f2d-4f30-af26-5fcd0443e1bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:02.260774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:02.289422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-478b913f-8f2d-4f30-af26-5fcd0443e1bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045577 Jun 02 19:07:02.290019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 370/755] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:02.989707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6bcdb7a5-ac23-495e-8bef-dd1c018bf301 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:02.990899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6bcdb7a5-ac23-495e-8bef-dd1c018bf301 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:02.999949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcdb7a5-ac23-495e-8bef-dd1c018bf301 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:03.000406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcdb7a5-ac23-495e-8bef-dd1c018bf301 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:03.001184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcdb7a5-ac23-495e-8bef-dd1c018bf301 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:03.001626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcdb7a5-ac23-495e-8bef-dd1c018bf301 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:03.034428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6bcdb7a5-ac23-495e-8bef-dd1c018bf301 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051762 Jun 02 19:07:03.035000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 386/756] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:03.303408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f3da4f62-19aa-43a1-9944-a46ee4926ca4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:03.304394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f3da4f62-19aa-43a1-9944-a46ee4926ca4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:03.312031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3da4f62-19aa-43a1-9944-a46ee4926ca4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:03.312474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3da4f62-19aa-43a1-9944-a46ee4926ca4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:03.313238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3da4f62-19aa-43a1-9944-a46ee4926ca4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:03.313666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3da4f62-19aa-43a1-9944-a46ee4926ca4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:03.346569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f3da4f62-19aa-43a1-9944-a46ee4926ca4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Jun 02 19:07:03.347127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 371/757] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:04.047614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e60762c0-03cb-46e8-92a8-220c2ab2469e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:04.048550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e60762c0-03cb-46e8-92a8-220c2ab2469e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:04.055738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e60762c0-03cb-46e8-92a8-220c2ab2469e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:04.056225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e60762c0-03cb-46e8-92a8-220c2ab2469e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:04.057131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e60762c0-03cb-46e8-92a8-220c2ab2469e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:04.057575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e60762c0-03cb-46e8-92a8-220c2ab2469e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:04.091903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e60762c0-03cb-46e8-92a8-220c2ab2469e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048736 Jun 02 19:07:04.092426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 387/758] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:04.358844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-667ae7d6-1296-4f69-b55a-ef9d5e5ae825 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:04.359677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-667ae7d6-1296-4f69-b55a-ef9d5e5ae825 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:04.366908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-667ae7d6-1296-4f69-b55a-ef9d5e5ae825 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:04.367332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-667ae7d6-1296-4f69-b55a-ef9d5e5ae825 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:04.368098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-667ae7d6-1296-4f69-b55a-ef9d5e5ae825 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:04.368529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-667ae7d6-1296-4f69-b55a-ef9d5e5ae825 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:04.398416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-667ae7d6-1296-4f69-b55a-ef9d5e5ae825 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Jun 02 19:07:04.398978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 372/759] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:05.105052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-670fd5f6-ad12-4096-884e-1789d9302bca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:05.106031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-670fd5f6-ad12-4096-884e-1789d9302bca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:05.113611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-670fd5f6-ad12-4096-884e-1789d9302bca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:05.114032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-670fd5f6-ad12-4096-884e-1789d9302bca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:05.114819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-670fd5f6-ad12-4096-884e-1789d9302bca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:05.115262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-670fd5f6-ad12-4096-884e-1789d9302bca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:05.148505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-670fd5f6-ad12-4096-884e-1789d9302bca tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046602 Jun 02 19:07:05.148505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 388/760] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:05.411473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3aaa2e46-9053-41a5-ab86-dd7d4b791db4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:05.412407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3aaa2e46-9053-41a5-ab86-dd7d4b791db4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:05.420216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3aaa2e46-9053-41a5-ab86-dd7d4b791db4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:05.420667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3aaa2e46-9053-41a5-ab86-dd7d4b791db4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:05.421647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3aaa2e46-9053-41a5-ab86-dd7d4b791db4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:05.422354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3aaa2e46-9053-41a5-ab86-dd7d4b791db4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:05.465487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3aaa2e46-9053-41a5-ab86-dd7d4b791db4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057976 Jun 02 19:07:05.466179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 373/761] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:06.159392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a4a4cdf-19fe-403f-9abf-5f854a816547 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:06.160326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a4a4cdf-19fe-403f-9abf-5f854a816547 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:06.167659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a4a4cdf-19fe-403f-9abf-5f854a816547 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:06.168035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a4a4cdf-19fe-403f-9abf-5f854a816547 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:06.168954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a4a4cdf-19fe-403f-9abf-5f854a816547 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:06.169377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a4a4cdf-19fe-403f-9abf-5f854a816547 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:06.201589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a4a4cdf-19fe-403f-9abf-5f854a816547 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046234 Jun 02 19:07:06.202191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 389/762] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:06.478069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a2ad06bc-5770-46b3-8b54-0352073f8fdc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:06.478900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a2ad06bc-5770-46b3-8b54-0352073f8fdc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:06.486173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2ad06bc-5770-46b3-8b54-0352073f8fdc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:06.486640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2ad06bc-5770-46b3-8b54-0352073f8fdc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:06.487453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2ad06bc-5770-46b3-8b54-0352073f8fdc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:06.487848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2ad06bc-5770-46b3-8b54-0352073f8fdc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:06.518969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a2ad06bc-5770-46b3-8b54-0352073f8fdc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Jun 02 19:07:06.519531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 374/763] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:07.215750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3e804ec4-fd67-4c41-959b-5fc32b34466f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:07.217413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3e804ec4-fd67-4c41-959b-5fc32b34466f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:07.224267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e804ec4-fd67-4c41-959b-5fc32b34466f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:07.224643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e804ec4-fd67-4c41-959b-5fc32b34466f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:07.225456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e804ec4-fd67-4c41-959b-5fc32b34466f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:07.225934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e804ec4-fd67-4c41-959b-5fc32b34466f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:07.256500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3e804ec4-fd67-4c41-959b-5fc32b34466f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047152 Jun 02 19:07:07.257072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 390/764] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:07.532419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-04fa7146-0f50-4398-8d3b-99566e4e1504 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:07.533283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-04fa7146-0f50-4398-8d3b-99566e4e1504 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:07.540334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04fa7146-0f50-4398-8d3b-99566e4e1504 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:07.540786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04fa7146-0f50-4398-8d3b-99566e4e1504 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:07.541554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04fa7146-0f50-4398-8d3b-99566e4e1504 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:07.542024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04fa7146-0f50-4398-8d3b-99566e4e1504 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:07.572814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-04fa7146-0f50-4398-8d3b-99566e4e1504 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Jun 02 19:07:07.573355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 375/765] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:08.269006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0ae33a01-165e-4523-af35-01aefeed96ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:08.269965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0ae33a01-165e-4523-af35-01aefeed96ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:08.278888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ae33a01-165e-4523-af35-01aefeed96ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:08.279255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ae33a01-165e-4523-af35-01aefeed96ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:08.280030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ae33a01-165e-4523-af35-01aefeed96ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:08.280467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ae33a01-165e-4523-af35-01aefeed96ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:08.313887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0ae33a01-165e-4523-af35-01aefeed96ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048779 Jun 02 19:07:08.314753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 391/766] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:08.585300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b59525aa-ff6c-4b1a-82dc-8a9b8de5d7ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:08.586258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b59525aa-ff6c-4b1a-82dc-8a9b8de5d7ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:08.593590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b59525aa-ff6c-4b1a-82dc-8a9b8de5d7ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:08.594072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b59525aa-ff6c-4b1a-82dc-8a9b8de5d7ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:08.594849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b59525aa-ff6c-4b1a-82dc-8a9b8de5d7ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:08.595277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b59525aa-ff6c-4b1a-82dc-8a9b8de5d7ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:08.626454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b59525aa-ff6c-4b1a-82dc-8a9b8de5d7ba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Jun 02 19:07:08.627023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 376/767] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:09.328202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e385ecad-d360-411f-bde7-bbde56c7e6a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:09.329141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e385ecad-d360-411f-bde7-bbde56c7e6a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:09.336383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e385ecad-d360-411f-bde7-bbde56c7e6a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:09.336766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e385ecad-d360-411f-bde7-bbde56c7e6a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:09.337552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e385ecad-d360-411f-bde7-bbde56c7e6a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:09.338024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e385ecad-d360-411f-bde7-bbde56c7e6a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:09.369277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e385ecad-d360-411f-bde7-bbde56c7e6a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045094 Jun 02 19:07:09.369887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 392/768] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:09.638460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b3b380d-6215-4ef4-a341-6182d703387c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:09.639398 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b3b380d-6215-4ef4-a341-6182d703387c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:09.647835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b3b380d-6215-4ef4-a341-6182d703387c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:09.648280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b3b380d-6215-4ef4-a341-6182d703387c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:09.649034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b3b380d-6215-4ef4-a341-6182d703387c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:09.649472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b3b380d-6215-4ef4-a341-6182d703387c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:09.681506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b3b380d-6215-4ef4-a341-6182d703387c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047150 Jun 02 19:07:09.682159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 377/769] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:10.384952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-29191944-4b7f-425c-8de7-be684963aeec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:10.386554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-29191944-4b7f-425c-8de7-be684963aeec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:10.394491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29191944-4b7f-425c-8de7-be684963aeec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:10.394951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29191944-4b7f-425c-8de7-be684963aeec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:10.395759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29191944-4b7f-425c-8de7-be684963aeec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:10.396197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29191944-4b7f-425c-8de7-be684963aeec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:10.426849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-29191944-4b7f-425c-8de7-be684963aeec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048554 Jun 02 19:07:10.427414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 393/770] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:10.694386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-770798ef-2eeb-4524-9257-dde95138fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:10.695226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-770798ef-2eeb-4524-9257-dde95138fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:10.697976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=58 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:10.703826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-770798ef-2eeb-4524-9257-dde95138fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:10.704263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-770798ef-2eeb-4524-9257-dde95138fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:10.705048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-770798ef-2eeb-4524-9257-dde95138fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:10.705478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-770798ef-2eeb-4524-9257-dde95138fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:10.738580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-770798ef-2eeb-4524-9257-dde95138fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048231 Jun 02 19:07:10.739154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 378/771] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:11.439902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aa40b6f6-f8c6-4f74-a6fd-8b028c5bf24c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:11.441000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-aa40b6f6-f8c6-4f74-a6fd-8b028c5bf24c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:11.448585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa40b6f6-f8c6-4f74-a6fd-8b028c5bf24c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:11.449041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa40b6f6-f8c6-4f74-a6fd-8b028c5bf24c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:11.450008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa40b6f6-f8c6-4f74-a6fd-8b028c5bf24c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:11.450454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa40b6f6-f8c6-4f74-a6fd-8b028c5bf24c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:11.487208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-aa40b6f6-f8c6-4f74-a6fd-8b028c5bf24c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051307 Jun 02 19:07:11.487785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 394/772] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:11.750479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5fcfdc3f-b1b8-4224-ae55-6e93d234b795 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:11.751308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5fcfdc3f-b1b8-4224-ae55-6e93d234b795 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:11.758544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc3f-b1b8-4224-ae55-6e93d234b795 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:11.758982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc3f-b1b8-4224-ae55-6e93d234b795 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:11.759743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc3f-b1b8-4224-ae55-6e93d234b795 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:11.760173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc3f-b1b8-4224-ae55-6e93d234b795 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:11.790563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5fcfdc3f-b1b8-4224-ae55-6e93d234b795 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Jun 02 19:07:11.791110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 379/773] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:12.500945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b2a0ab8c-651d-4d98-937b-1672733f4c6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:12.501816 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b2a0ab8c-651d-4d98-937b-1672733f4c6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:12.504162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=58 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:12.509938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2a0ab8c-651d-4d98-937b-1672733f4c6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:12.510398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2a0ab8c-651d-4d98-937b-1672733f4c6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:12.511170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2a0ab8c-651d-4d98-937b-1672733f4c6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:12.511608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2a0ab8c-651d-4d98-937b-1672733f4c6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:12.544289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b2a0ab8c-651d-4d98-937b-1672733f4c6a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047777 Jun 02 19:07:12.544890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 395/774] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:12.804155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3b1791e-3e7f-4cfc-8ec8-58745f36bf22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:12.805317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c3b1791e-3e7f-4cfc-8ec8-58745f36bf22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:12.814917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3b1791e-3e7f-4cfc-8ec8-58745f36bf22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:12.815369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3b1791e-3e7f-4cfc-8ec8-58745f36bf22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:12.816157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3b1791e-3e7f-4cfc-8ec8-58745f36bf22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:12.816603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3b1791e-3e7f-4cfc-8ec8-58745f36bf22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:12.850812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3b1791e-3e7f-4cfc-8ec8-58745f36bf22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051880 Jun 02 19:07:12.851428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 380/775] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:13.557188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e4226d90-095d-4625-ad14-d10a1cadc241 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:13.558105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e4226d90-095d-4625-ad14-d10a1cadc241 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:13.565536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4226d90-095d-4625-ad14-d10a1cadc241 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:13.566062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4226d90-095d-4625-ad14-d10a1cadc241 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:13.566851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4226d90-095d-4625-ad14-d10a1cadc241 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:13.567296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4226d90-095d-4625-ad14-d10a1cadc241 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:13.599912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e4226d90-095d-4625-ad14-d10a1cadc241 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047043 Jun 02 19:07:13.600623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 396/776] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:13.862996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7083b205-a4d6-4921-b233-023ff9de7878 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:13.863835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7083b205-a4d6-4921-b233-023ff9de7878 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:13.870989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7083b205-a4d6-4921-b233-023ff9de7878 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:13.871713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7083b205-a4d6-4921-b233-023ff9de7878 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:13.872978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7083b205-a4d6-4921-b233-023ff9de7878 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:13.873410 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7083b205-a4d6-4921-b233-023ff9de7878 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:13.904520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7083b205-a4d6-4921-b233-023ff9de7878 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Jun 02 19:07:13.905077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 381/777] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:14.613098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-41ff1e5e-b32f-4ece-8b41-ae51f04d8c70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:14.614042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-41ff1e5e-b32f-4ece-8b41-ae51f04d8c70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:14.620862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41ff1e5e-b32f-4ece-8b41-ae51f04d8c70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:14.621361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41ff1e5e-b32f-4ece-8b41-ae51f04d8c70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:14.622367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41ff1e5e-b32f-4ece-8b41-ae51f04d8c70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:14.622804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41ff1e5e-b32f-4ece-8b41-ae51f04d8c70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:14.652250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-41ff1e5e-b32f-4ece-8b41-ae51f04d8c70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043453 Jun 02 19:07:14.652982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 397/778] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:14.916953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7d4e01de-35e0-4171-870c-d463ecb06676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:14.917928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7d4e01de-35e0-4171-870c-d463ecb06676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:14.925163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d4e01de-35e0-4171-870c-d463ecb06676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:14.925608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d4e01de-35e0-4171-870c-d463ecb06676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:14.926406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d4e01de-35e0-4171-870c-d463ecb06676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:14.926835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d4e01de-35e0-4171-870c-d463ecb06676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:14.963138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7d4e01de-35e0-4171-870c-d463ecb06676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050361 Jun 02 19:07:14.963700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 382/779] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:15.668477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-08112591-a7ba-4708-86cf-dd960518c077 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:15.669456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-08112591-a7ba-4708-86cf-dd960518c077 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:15.677254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08112591-a7ba-4708-86cf-dd960518c077 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:15.677702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08112591-a7ba-4708-86cf-dd960518c077 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:15.678659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08112591-a7ba-4708-86cf-dd960518c077 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:15.679391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08112591-a7ba-4708-86cf-dd960518c077 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:15.710682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-08112591-a7ba-4708-86cf-dd960518c077 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048695 Jun 02 19:07:15.711244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 398/780] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:15.976362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ca0c4811-3263-4f0a-baf9-564987b2243f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:15.977634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ca0c4811-3263-4f0a-baf9-564987b2243f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:15.985572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ca0c4811-3263-4f0a-baf9-564987b2243f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:15.986094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ca0c4811-3263-4f0a-baf9-564987b2243f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:15.986919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ca0c4811-3263-4f0a-baf9-564987b2243f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:15.987511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ca0c4811-3263-4f0a-baf9-564987b2243f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:16.017057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ca0c4811-3263-4f0a-baf9-564987b2243f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Jun 02 19:07:16.017652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 383/781] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:16.726457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-08001ac0-ebc4-44e0-8fbe-ebcb44d48f28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:16.727684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-08001ac0-ebc4-44e0-8fbe-ebcb44d48f28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:16.736064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08001ac0-ebc4-44e0-8fbe-ebcb44d48f28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:16.736436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08001ac0-ebc4-44e0-8fbe-ebcb44d48f28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:16.737211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08001ac0-ebc4-44e0-8fbe-ebcb44d48f28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:16.737647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08001ac0-ebc4-44e0-8fbe-ebcb44d48f28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:16.768358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-08001ac0-ebc4-44e0-8fbe-ebcb44d48f28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048214 Jun 02 19:07:16.768917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 399/782] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:17.028984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e6e54a87-eec6-4493-95d7-26bcb0d811f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:17.030227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e6e54a87-eec6-4493-95d7-26bcb0d811f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:17.037361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e6e54a87-eec6-4493-95d7-26bcb0d811f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:17.037823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e6e54a87-eec6-4493-95d7-26bcb0d811f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:17.038558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e6e54a87-eec6-4493-95d7-26bcb0d811f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:17.038998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e6e54a87-eec6-4493-95d7-26bcb0d811f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:17.068159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e6e54a87-eec6-4493-95d7-26bcb0d811f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Jun 02 19:07:17.068721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 384/783] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:17.780618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a02e0775-8006-4f15-bf3d-aecd2b5757b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:17.781675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a02e0775-8006-4f15-bf3d-aecd2b5757b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:17.788870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a02e0775-8006-4f15-bf3d-aecd2b5757b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:17.789252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a02e0775-8006-4f15-bf3d-aecd2b5757b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:17.790070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a02e0775-8006-4f15-bf3d-aecd2b5757b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:17.790519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a02e0775-8006-4f15-bf3d-aecd2b5757b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:17.823653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a02e0775-8006-4f15-bf3d-aecd2b5757b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047022 Jun 02 19:07:17.824430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 400/784] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:18.080742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a8f3355f-412f-4f08-aab6-55205e8b11f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:18.081577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a8f3355f-412f-4f08-aab6-55205e8b11f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:18.088931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8f3355f-412f-4f08-aab6-55205e8b11f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:18.089402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8f3355f-412f-4f08-aab6-55205e8b11f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:18.090205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8f3355f-412f-4f08-aab6-55205e8b11f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:18.090633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8f3355f-412f-4f08-aab6-55205e8b11f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:18.121896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a8f3355f-412f-4f08-aab6-55205e8b11f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045331 Jun 02 19:07:18.122467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 385/785] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:18.836408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-83489457-c37b-4ce1-bee2-668148ff7672 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:18.837342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-83489457-c37b-4ce1-bee2-668148ff7672 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:18.845129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83489457-c37b-4ce1-bee2-668148ff7672 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:18.845642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83489457-c37b-4ce1-bee2-668148ff7672 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:18.846912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83489457-c37b-4ce1-bee2-668148ff7672 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:18.847541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83489457-c37b-4ce1-bee2-668148ff7672 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:18.863100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:18.880369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-83489457-c37b-4ce1-bee2-668148ff7672 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047975 Jun 02 19:07:18.880949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 401/786] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:19.133864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-519aec18-0364-493e-97ef-69264fa54269 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:19.135415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-519aec18-0364-493e-97ef-69264fa54269 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:19.146712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-519aec18-0364-493e-97ef-69264fa54269 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:19.147446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-519aec18-0364-493e-97ef-69264fa54269 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:19.148658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-519aec18-0364-493e-97ef-69264fa54269 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:19.149368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-519aec18-0364-493e-97ef-69264fa54269 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:19.180510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:19.189599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-519aec18-0364-493e-97ef-69264fa54269 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059776 Jun 02 19:07:19.190216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 386/787] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:19.892814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4aaafb2e-986e-4e6e-84c5-4b806ea33a13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:19.893761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4aaafb2e-986e-4e6e-84c5-4b806ea33a13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:19.900490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4aaafb2e-986e-4e6e-84c5-4b806ea33a13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:19.900950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4aaafb2e-986e-4e6e-84c5-4b806ea33a13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:19.901764 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4aaafb2e-986e-4e6e-84c5-4b806ea33a13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:19.902235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4aaafb2e-986e-4e6e-84c5-4b806ea33a13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:19.934203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4aaafb2e-986e-4e6e-84c5-4b806ea33a13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045607 Jun 02 19:07:19.934682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 402/788] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:20.205079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8029452f-79c0-4f07-b899-9ab5ffa062a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:20.205956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8029452f-79c0-4f07-b899-9ab5ffa062a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:20.213230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8029452f-79c0-4f07-b899-9ab5ffa062a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:20.213678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8029452f-79c0-4f07-b899-9ab5ffa062a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:20.214467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8029452f-79c0-4f07-b899-9ab5ffa062a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:20.214893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8029452f-79c0-4f07-b899-9ab5ffa062a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:20.246269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8029452f-79c0-4f07-b899-9ab5ffa062a7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047529 Jun 02 19:07:20.246829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 387/789] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:20.946459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a3479d85-4869-40d5-ac8b-13cd7ed0d775 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:20.947767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a3479d85-4869-40d5-ac8b-13cd7ed0d775 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:20.955144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3479d85-4869-40d5-ac8b-13cd7ed0d775 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:20.955581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3479d85-4869-40d5-ac8b-13cd7ed0d775 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:20.956405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3479d85-4869-40d5-ac8b-13cd7ed0d775 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:20.956851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3479d85-4869-40d5-ac8b-13cd7ed0d775 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:20.989027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a3479d85-4869-40d5-ac8b-13cd7ed0d775 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046705 Jun 02 19:07:20.989649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 403/790] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:21.258477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81106ed3-bc42-4907-b65b-0e11488d4a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:21.259426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81106ed3-bc42-4907-b65b-0e11488d4a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:21.266725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81106ed3-bc42-4907-b65b-0e11488d4a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:21.267157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81106ed3-bc42-4907-b65b-0e11488d4a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:21.267981 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81106ed3-bc42-4907-b65b-0e11488d4a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:21.268362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81106ed3-bc42-4907-b65b-0e11488d4a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:21.300219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81106ed3-bc42-4907-b65b-0e11488d4a6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045777 Jun 02 19:07:21.300808 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 388/791] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:22.005743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-56c00eb9-ff38-41cd-99c7-1812cd503e46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:22.006857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-56c00eb9-ff38-41cd-99c7-1812cd503e46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:22.014230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56c00eb9-ff38-41cd-99c7-1812cd503e46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:22.014680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56c00eb9-ff38-41cd-99c7-1812cd503e46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:22.015451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56c00eb9-ff38-41cd-99c7-1812cd503e46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:22.015885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56c00eb9-ff38-41cd-99c7-1812cd503e46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:22.048847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-56c00eb9-ff38-41cd-99c7-1812cd503e46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049636 Jun 02 19:07:22.049338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 404/792] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:22.315650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0e4933e9-53d3-44b8-afec-49e7dd95bd65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:22.316485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0e4933e9-53d3-44b8-afec-49e7dd95bd65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:22.324378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e4933e9-53d3-44b8-afec-49e7dd95bd65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:22.324854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e4933e9-53d3-44b8-afec-49e7dd95bd65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:22.325615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e4933e9-53d3-44b8-afec-49e7dd95bd65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:22.326082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e4933e9-53d3-44b8-afec-49e7dd95bd65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:22.357221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0e4933e9-53d3-44b8-afec-49e7dd95bd65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047781 Jun 02 19:07:22.358028 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 389/793] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:23.061369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-db468c5f-33bb-45b9-96f6-0ed76642d47d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:23.062316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-db468c5f-33bb-45b9-96f6-0ed76642d47d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:23.069571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db468c5f-33bb-45b9-96f6-0ed76642d47d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:23.070057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db468c5f-33bb-45b9-96f6-0ed76642d47d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:23.070832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db468c5f-33bb-45b9-96f6-0ed76642d47d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:23.071273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db468c5f-33bb-45b9-96f6-0ed76642d47d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:23.102387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-db468c5f-33bb-45b9-96f6-0ed76642d47d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Jun 02 19:07:23.102850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 405/794] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:23.374343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-58087d47-b377-4b30-b4ea-55f79b960e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:23.375689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-58087d47-b377-4b30-b4ea-55f79b960e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:23.386308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58087d47-b377-4b30-b4ea-55f79b960e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:23.386864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58087d47-b377-4b30-b4ea-55f79b960e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:23.388002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58087d47-b377-4b30-b4ea-55f79b960e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:23.388620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58087d47-b377-4b30-b4ea-55f79b960e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:23.420521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-58087d47-b377-4b30-b4ea-55f79b960e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051618 Jun 02 19:07:23.421082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 390/795] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:24.115735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e2895042-8571-41c5-a220-fffb3f35be8f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:24.116666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e2895042-8571-41c5-a220-fffb3f35be8f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:24.123312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2895042-8571-41c5-a220-fffb3f35be8f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:24.123937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2895042-8571-41c5-a220-fffb3f35be8f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:24.126440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2895042-8571-41c5-a220-fffb3f35be8f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:24.126440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2895042-8571-41c5-a220-fffb3f35be8f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:24.156140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e2895042-8571-41c5-a220-fffb3f35be8f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045046 Jun 02 19:07:24.156684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 406/796] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:24.433067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a24beda8-38f1-4c0b-accc-c293ef1ce5ff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:24.433935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a24beda8-38f1-4c0b-accc-c293ef1ce5ff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:24.441294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a24beda8-38f1-4c0b-accc-c293ef1ce5ff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:24.441740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a24beda8-38f1-4c0b-accc-c293ef1ce5ff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:24.442800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a24beda8-38f1-4c0b-accc-c293ef1ce5ff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:24.443632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a24beda8-38f1-4c0b-accc-c293ef1ce5ff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:24.477558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a24beda8-38f1-4c0b-accc-c293ef1ce5ff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048647 Jun 02 19:07:24.478208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 391/797] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:25.173309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78209ec9-2c30-4b8b-9ca9-f542243778cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:25.174786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78209ec9-2c30-4b8b-9ca9-f542243778cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:25.181490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78209ec9-2c30-4b8b-9ca9-f542243778cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:25.181970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78209ec9-2c30-4b8b-9ca9-f542243778cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:25.182743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78209ec9-2c30-4b8b-9ca9-f542243778cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:25.183180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78209ec9-2c30-4b8b-9ca9-f542243778cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:25.215177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78209ec9-2c30-4b8b-9ca9-f542243778cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049206 Jun 02 19:07:25.215642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 407/798] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:25.490363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-405b1ca8-e8e5-4527-8284-609dce96aa14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:25.491195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-405b1ca8-e8e5-4527-8284-609dce96aa14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:25.498680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-405b1ca8-e8e5-4527-8284-609dce96aa14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:25.499123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-405b1ca8-e8e5-4527-8284-609dce96aa14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:25.499876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-405b1ca8-e8e5-4527-8284-609dce96aa14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:25.500299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-405b1ca8-e8e5-4527-8284-609dce96aa14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:25.532780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-405b1ca8-e8e5-4527-8284-609dce96aa14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046552 Jun 02 19:07:25.533516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 392/799] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:26.227529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c8146339-85b5-44ca-96e8-205b8e386b90 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:26.228488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c8146339-85b5-44ca-96e8-205b8e386b90 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:26.235303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8146339-85b5-44ca-96e8-205b8e386b90 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:26.235779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8146339-85b5-44ca-96e8-205b8e386b90 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:26.236546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8146339-85b5-44ca-96e8-205b8e386b90 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:26.237002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8146339-85b5-44ca-96e8-205b8e386b90 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:26.270852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c8146339-85b5-44ca-96e8-205b8e386b90 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047422 Jun 02 19:07:26.271396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 408/800] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:26.544997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6ad21bf0-7e22-4b4e-bdf1-cdfbd5cf62ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:26.545984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6ad21bf0-7e22-4b4e-bdf1-cdfbd5cf62ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:26.553238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ad21bf0-7e22-4b4e-bdf1-cdfbd5cf62ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:26.553706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ad21bf0-7e22-4b4e-bdf1-cdfbd5cf62ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:26.554511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ad21bf0-7e22-4b4e-bdf1-cdfbd5cf62ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:26.554936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ad21bf0-7e22-4b4e-bdf1-cdfbd5cf62ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:26.584968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6ad21bf0-7e22-4b4e-bdf1-cdfbd5cf62ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Jun 02 19:07:26.585550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 393/801] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:27.286238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-10d1f9d0-7a05-4abf-b95b-fcfd7342e5f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:27.287458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-10d1f9d0-7a05-4abf-b95b-fcfd7342e5f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:27.294467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-10d1f9d0-7a05-4abf-b95b-fcfd7342e5f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:27.294924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-10d1f9d0-7a05-4abf-b95b-fcfd7342e5f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:27.295695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-10d1f9d0-7a05-4abf-b95b-fcfd7342e5f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:27.296135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-10d1f9d0-7a05-4abf-b95b-fcfd7342e5f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:27.326509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-10d1f9d0-7a05-4abf-b95b-fcfd7342e5f6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047115 Jun 02 19:07:27.327058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 409/802] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:27.600082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ebaa281e-eb34-4e2f-893e-e349387f6676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:27.601108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ebaa281e-eb34-4e2f-893e-e349387f6676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:27.608251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ebaa281e-eb34-4e2f-893e-e349387f6676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:27.608736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ebaa281e-eb34-4e2f-893e-e349387f6676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:27.609518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ebaa281e-eb34-4e2f-893e-e349387f6676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:27.610014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ebaa281e-eb34-4e2f-893e-e349387f6676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:27.640063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ebaa281e-eb34-4e2f-893e-e349387f6676 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046243 Jun 02 19:07:27.640660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 394/803] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:28.338360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f11e1424-9b77-4dcc-bb86-c3d68be0f36e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:28.339197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f11e1424-9b77-4dcc-bb86-c3d68be0f36e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:28.345838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f11e1424-9b77-4dcc-bb86-c3d68be0f36e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:28.346279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f11e1424-9b77-4dcc-bb86-c3d68be0f36e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:28.347097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f11e1424-9b77-4dcc-bb86-c3d68be0f36e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:28.347531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f11e1424-9b77-4dcc-bb86-c3d68be0f36e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:28.377051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f11e1424-9b77-4dcc-bb86-c3d68be0f36e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042823 Jun 02 19:07:28.377582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 410/804] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:28.654201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-15bd0ed8-505c-4fe5-b3d8-cf90fc8ed741 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:28.655135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-15bd0ed8-505c-4fe5-b3d8-cf90fc8ed741 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:28.662390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15bd0ed8-505c-4fe5-b3d8-cf90fc8ed741 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:28.662839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15bd0ed8-505c-4fe5-b3d8-cf90fc8ed741 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:28.663603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15bd0ed8-505c-4fe5-b3d8-cf90fc8ed741 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:28.664035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15bd0ed8-505c-4fe5-b3d8-cf90fc8ed741 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:28.694163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-15bd0ed8-505c-4fe5-b3d8-cf90fc8ed741 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Jun 02 19:07:28.694716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 395/805] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:29.393878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9af63443-3c5c-405e-a0e0-8fcffa0d867d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:29.396649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9af63443-3c5c-405e-a0e0-8fcffa0d867d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:29.404657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9af63443-3c5c-405e-a0e0-8fcffa0d867d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:29.405114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9af63443-3c5c-405e-a0e0-8fcffa0d867d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:29.406173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9af63443-3c5c-405e-a0e0-8fcffa0d867d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:29.406741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9af63443-3c5c-405e-a0e0-8fcffa0d867d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:29.456296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9af63443-3c5c-405e-a0e0-8fcffa0d867d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069254 Jun 02 19:07:29.457063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 411/806] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:29.710537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e4386902-13c4-4931-a1cf-cf7ce7b5f4a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:29.711958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e4386902-13c4-4931-a1cf-cf7ce7b5f4a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:29.722548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4386902-13c4-4931-a1cf-cf7ce7b5f4a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:29.723290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4386902-13c4-4931-a1cf-cf7ce7b5f4a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:29.724472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4386902-13c4-4931-a1cf-cf7ce7b5f4a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:29.724909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4386902-13c4-4931-a1cf-cf7ce7b5f4a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:29.755584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e4386902-13c4-4931-a1cf-cf7ce7b5f4a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051793 Jun 02 19:07:29.756554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 396/807] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:30.469117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e75c63dc-dc1e-4cf7-a1e4-248f9ab7a3e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:30.470616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e75c63dc-dc1e-4cf7-a1e4-248f9ab7a3e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:30.477529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e75c63dc-dc1e-4cf7-a1e4-248f9ab7a3e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:30.478049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e75c63dc-dc1e-4cf7-a1e4-248f9ab7a3e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:30.478802 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e75c63dc-dc1e-4cf7-a1e4-248f9ab7a3e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:30.479243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e75c63dc-dc1e-4cf7-a1e4-248f9ab7a3e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:30.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e75c63dc-dc1e-4cf7-a1e4-248f9ab7a3e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050784 Jun 02 19:07:30.516401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 412/808] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:30.767566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5bc4256b-681f-4ed7-9228-378b1ca716af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:30.768415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5bc4256b-681f-4ed7-9228-378b1ca716af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:30.775498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bc4256b-681f-4ed7-9228-378b1ca716af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:30.775938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bc4256b-681f-4ed7-9228-378b1ca716af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:30.776770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bc4256b-681f-4ed7-9228-378b1ca716af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:30.777220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bc4256b-681f-4ed7-9228-378b1ca716af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:30.805071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3a6c8c7b-e662-422c-b71b-490b3bb4dec5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:30.805584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a6c8c7b-e662-422c-b71b-490b3bb4dec5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:30.811045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5bc4256b-681f-4ed7-9228-378b1ca716af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047525 Jun 02 19:07:30.811654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 397/809] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:30.812659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6c8c7b-e662-422c-b71b-490b3bb4dec5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:30.813118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6c8c7b-e662-422c-b71b-490b3bb4dec5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:30.813952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6c8c7b-e662-422c-b71b-490b3bb4dec5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:30.814390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6c8c7b-e662-422c-b71b-490b3bb4dec5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:30.844609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a6c8c7b-e662-422c-b71b-490b3bb4dec5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:07:30.929058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3a6c8c7b-e662-422c-b71b-490b3bb4dec5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 204 len: 0 microversion: 2.1 time: 0.127776 Jun 02 19:07:30.930307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 413/810] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:07:30 2022] DELETE /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:07:30.939248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f5a78ea9-5515-4a28-8fb8-e64071dfd8ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:30.940057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f5a78ea9-5515-4a28-8fb8-e64071dfd8ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:30.948473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5a78ea9-5515-4a28-8fb8-e64071dfd8ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:30.948921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5a78ea9-5515-4a28-8fb8-e64071dfd8ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:30.949689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5a78ea9-5515-4a28-8fb8-e64071dfd8ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:30.950187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5a78ea9-5515-4a28-8fb8-e64071dfd8ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:31.141540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f5a78ea9-5515-4a28-8fb8-e64071dfd8ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:31.149943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f5a78ea9-5515-4a28-8fb8-e64071dfd8ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1578 microversion: 2.1 time: 0.215096 Jun 02 19:07:31.150507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 398/811] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:30 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:07:31.530713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9965948e-4866-485f-b1b1-d78046ef654e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:31.531964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9965948e-4866-485f-b1b1-d78046ef654e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:31.540944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9965948e-4866-485f-b1b1-d78046ef654e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:31.541401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9965948e-4866-485f-b1b1-d78046ef654e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:31.542211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9965948e-4866-485f-b1b1-d78046ef654e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:31.542666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9965948e-4866-485f-b1b1-d78046ef654e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:31.573563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9965948e-4866-485f-b1b1-d78046ef654e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048979 Jun 02 19:07:31.574131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 414/812] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:31.823623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a26183a2-20ff-4ee3-9208-301c22ed93ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:31.824563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a26183a2-20ff-4ee3-9208-301c22ed93ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:31.833939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a26183a2-20ff-4ee3-9208-301c22ed93ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:31.834644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a26183a2-20ff-4ee3-9208-301c22ed93ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:31.835826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a26183a2-20ff-4ee3-9208-301c22ed93ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:31.836253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a26183a2-20ff-4ee3-9208-301c22ed93ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:31.866256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a26183a2-20ff-4ee3-9208-301c22ed93ec tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047084 Jun 02 19:07:31.866884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 399/813] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:32.167116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6c7f769c-8386-4c21-b3c0-8ee41c2c9e97 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:32.167726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6c7f769c-8386-4c21-b3c0-8ee41c2c9e97 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:32.174259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c7f769c-8386-4c21-b3c0-8ee41c2c9e97 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:32.174703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c7f769c-8386-4c21-b3c0-8ee41c2c9e97 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:32.175463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c7f769c-8386-4c21-b3c0-8ee41c2c9e97 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:32.175906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c7f769c-8386-4c21-b3c0-8ee41c2c9e97 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:32.387464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c7f769c-8386-4c21-b3c0-8ee41c2c9e97 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:32.395182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6c7f769c-8386-4c21-b3c0-8ee41c2c9e97 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1578 microversion: 2.1 time: 0.232106 Jun 02 19:07:32.395731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 415/814] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:32 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1578 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:32.585179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bb6858ac-3851-497d-a54e-8442cbb50be7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:32.586227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bb6858ac-3851-497d-a54e-8442cbb50be7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:32.592752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb6858ac-3851-497d-a54e-8442cbb50be7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:32.593201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb6858ac-3851-497d-a54e-8442cbb50be7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:32.594001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb6858ac-3851-497d-a54e-8442cbb50be7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:32.594441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb6858ac-3851-497d-a54e-8442cbb50be7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:32.625463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bb6858ac-3851-497d-a54e-8442cbb50be7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044201 Jun 02 19:07:32.625966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 400/815] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:32.878752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-25621a48-3dea-426c-896f-5501f6f0839b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:32.879719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-25621a48-3dea-426c-896f-5501f6f0839b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:32.887266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25621a48-3dea-426c-896f-5501f6f0839b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:32.887722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25621a48-3dea-426c-896f-5501f6f0839b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:32.888516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25621a48-3dea-426c-896f-5501f6f0839b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:32.888961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25621a48-3dea-426c-896f-5501f6f0839b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:32.904248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:32.923565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-25621a48-3dea-426c-896f-5501f6f0839b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048816 Jun 02 19:07:32.924336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 416/816] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:33.413364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e834f487-28c6-4fd8-aebe-428bb6b2ddb4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:33.414136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e834f487-28c6-4fd8-aebe-428bb6b2ddb4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:33.424249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e834f487-28c6-4fd8-aebe-428bb6b2ddb4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:33.424696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e834f487-28c6-4fd8-aebe-428bb6b2ddb4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:33.425466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e834f487-28c6-4fd8-aebe-428bb6b2ddb4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:33.425913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e834f487-28c6-4fd8-aebe-428bb6b2ddb4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:33.489373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e834f487-28c6-4fd8-aebe-428bb6b2ddb4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:33.497400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e834f487-28c6-4fd8-aebe-428bb6b2ddb4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1510 microversion: 2.1 time: 0.088109 Jun 02 19:07:33.497990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 401/817] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:33 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:33.637086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-49766a58-5c51-4191-8259-f23ea4a33ede tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:33.638198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-49766a58-5c51-4191-8259-f23ea4a33ede tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:33.644807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-49766a58-5c51-4191-8259-f23ea4a33ede tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:33.645357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-49766a58-5c51-4191-8259-f23ea4a33ede tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:33.646291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-49766a58-5c51-4191-8259-f23ea4a33ede tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:33.646734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-49766a58-5c51-4191-8259-f23ea4a33ede tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:33.679345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-49766a58-5c51-4191-8259-f23ea4a33ede tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046645 Jun 02 19:07:33.680573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 417/818] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:33.796415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-02aa2629-6e22-4262-a0d0-f3d062d34a12 req-1ea2d48a-7937-4ea1-aa8c-001de177d750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0a9be2-f2c0-4fa4-919b-44afcbdbae67", "name": "network-vif-deleted", "tag": "93850d4b-abd8-487e-8508-5f0e1963d248"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:07:33.805426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-02aa2629-6e22-4262-a0d0-f3d062d34a12 req-1ea2d48a-7937-4ea1-aa8c-001de177d750 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:33.806021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-02aa2629-6e22-4262-a0d0-f3d062d34a12 req-1ea2d48a-7937-4ea1-aa8c-001de177d750 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:33.817591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-02aa2629-6e22-4262-a0d0-f3d062d34a12 req-1ea2d48a-7937-4ea1-aa8c-001de177d750 service nova] Creating event network-vif-deleted:93850d4b-abd8-487e-8508-5f0e1963d248 for instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 on hv-cinder-79760 Jun 02 19:07:33.823843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-02aa2629-6e22-4262-a0d0-f3d062d34a12 req-1ea2d48a-7937-4ea1-aa8c-001de177d750 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118587 Jun 02 19:07:33.824454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 402/819] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:33.936333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-44266575-6601-41c8-b8e2-0c5974e5fc8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:33.937309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-44266575-6601-41c8-b8e2-0c5974e5fc8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:33.944385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44266575-6601-41c8-b8e2-0c5974e5fc8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:33.944849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44266575-6601-41c8-b8e2-0c5974e5fc8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:33.945637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44266575-6601-41c8-b8e2-0c5974e5fc8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:33.946307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44266575-6601-41c8-b8e2-0c5974e5fc8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:33.978654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-44266575-6601-41c8-b8e2-0c5974e5fc8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Jun 02 19:07:33.979226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 418/820] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:34.519608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2d4be869-ad9d-4c3f-bcc0-cd6fe19d5ca0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:34.520962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2d4be869-ad9d-4c3f-bcc0-cd6fe19d5ca0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:34.530949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d4be869-ad9d-4c3f-bcc0-cd6fe19d5ca0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:34.531720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d4be869-ad9d-4c3f-bcc0-cd6fe19d5ca0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:34.533372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d4be869-ad9d-4c3f-bcc0-cd6fe19d5ca0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:34.534257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d4be869-ad9d-4c3f-bcc0-cd6fe19d5ca0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:34.605164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2d4be869-ad9d-4c3f-bcc0-cd6fe19d5ca0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:34.613043 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2d4be869-ad9d-4c3f-bcc0-cd6fe19d5ca0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.101377 Jun 02 19:07:34.613696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 403/821] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:34 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:34.697179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3aa8153-0fd6-47ec-bf8f-00f7ad3969e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:34.698334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f3aa8153-0fd6-47ec-bf8f-00f7ad3969e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:34.708380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3aa8153-0fd6-47ec-bf8f-00f7ad3969e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:34.708380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3aa8153-0fd6-47ec-bf8f-00f7ad3969e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:34.708380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3aa8153-0fd6-47ec-bf8f-00f7ad3969e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:34.709202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3aa8153-0fd6-47ec-bf8f-00f7ad3969e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:34.745271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f3aa8153-0fd6-47ec-bf8f-00f7ad3969e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053074 Jun 02 19:07:34.745838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 419/822] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:34.996008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-369d467d-02e2-489f-8641-bdf53ff212d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:34.996940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-369d467d-02e2-489f-8641-bdf53ff212d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:35.003608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-369d467d-02e2-489f-8641-bdf53ff212d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:35.004001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-369d467d-02e2-489f-8641-bdf53ff212d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:35.004749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-369d467d-02e2-489f-8641-bdf53ff212d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:35.005182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-369d467d-02e2-489f-8641-bdf53ff212d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:35.007764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:35.041017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-369d467d-02e2-489f-8641-bdf53ff212d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049659 Jun 02 19:07:35.041585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 404/823] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:35.635230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e6c3fa3-cd51-4cc6-8f29-5bc16a8e4f32 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:35.636206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e6c3fa3-cd51-4cc6-8f29-5bc16a8e4f32 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:35.647193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e6c3fa3-cd51-4cc6-8f29-5bc16a8e4f32 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:35.647928 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e6c3fa3-cd51-4cc6-8f29-5bc16a8e4f32 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:35.649254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e6c3fa3-cd51-4cc6-8f29-5bc16a8e4f32 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:35.649690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e6c3fa3-cd51-4cc6-8f29-5bc16a8e4f32 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:35.718698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5e6c3fa3-cd51-4cc6-8f29-5bc16a8e4f32 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:35.726646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e6c3fa3-cd51-4cc6-8f29-5bc16a8e4f32 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098300 Jun 02 19:07:35.727207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 420/824] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:35 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:35.758517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-82174cb3-92fc-4f15-9d63-6ddc92d9130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:35.759400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-82174cb3-92fc-4f15-9d63-6ddc92d9130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:35.769544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82174cb3-92fc-4f15-9d63-6ddc92d9130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:35.770284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82174cb3-92fc-4f15-9d63-6ddc92d9130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:35.771486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82174cb3-92fc-4f15-9d63-6ddc92d9130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:35.772250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82174cb3-92fc-4f15-9d63-6ddc92d9130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:35.806754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-82174cb3-92fc-4f15-9d63-6ddc92d9130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052483 Jun 02 19:07:35.807328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 405/825] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:36.053308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7aa6deae-44ea-4092-b4e1-9db51a17f4c0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:36.054177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7aa6deae-44ea-4092-b4e1-9db51a17f4c0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:36.060716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7aa6deae-44ea-4092-b4e1-9db51a17f4c0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:36.061169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7aa6deae-44ea-4092-b4e1-9db51a17f4c0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:36.061969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7aa6deae-44ea-4092-b4e1-9db51a17f4c0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:36.062407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7aa6deae-44ea-4092-b4e1-9db51a17f4c0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:36.106683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7aa6deae-44ea-4092-b4e1-9db51a17f4c0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057086 Jun 02 19:07:36.107405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 421/826] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:36.744745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0c344bbe-2415-4a74-8311-f1cbacd29cc2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:36.745348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0c344bbe-2415-4a74-8311-f1cbacd29cc2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:36.753876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c344bbe-2415-4a74-8311-f1cbacd29cc2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:36.754486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c344bbe-2415-4a74-8311-f1cbacd29cc2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:36.755620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c344bbe-2415-4a74-8311-f1cbacd29cc2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:36.756246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c344bbe-2415-4a74-8311-f1cbacd29cc2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:36.818956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1afe1b7c-2db2-4fba-bfca-3a7f42f22db6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:36.820077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1afe1b7c-2db2-4fba-bfca-3a7f42f22db6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:36.821999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0c344bbe-2415-4a74-8311-f1cbacd29cc2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:36.828092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1afe1b7c-2db2-4fba-bfca-3a7f42f22db6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:36.828628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1afe1b7c-2db2-4fba-bfca-3a7f42f22db6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:36.829498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1afe1b7c-2db2-4fba-bfca-3a7f42f22db6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:36.829753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0c344bbe-2415-4a74-8311-f1cbacd29cc2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088977 Jun 02 19:07:36.830091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1afe1b7c-2db2-4fba-bfca-3a7f42f22db6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:36.830337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 406/827] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:36 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:36.861777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1afe1b7c-2db2-4fba-bfca-3a7f42f22db6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046916 Jun 02 19:07:36.862382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 422/828] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:37.122383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0639a652-35e8-4040-a6a9-7ad88042d69f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:37.123228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0639a652-35e8-4040-a6a9-7ad88042d69f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:37.130118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0639a652-35e8-4040-a6a9-7ad88042d69f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:37.130574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0639a652-35e8-4040-a6a9-7ad88042d69f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:37.131372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0639a652-35e8-4040-a6a9-7ad88042d69f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:37.131806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0639a652-35e8-4040-a6a9-7ad88042d69f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:37.173852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0639a652-35e8-4040-a6a9-7ad88042d69f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057190 Jun 02 19:07:37.174791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 407/829] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:37.848681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-650b452b-81cb-4c61-ab6e-dfb24ff881fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:37.849266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-650b452b-81cb-4c61-ab6e-dfb24ff881fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:37.856713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-650b452b-81cb-4c61-ab6e-dfb24ff881fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:37.857174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-650b452b-81cb-4c61-ab6e-dfb24ff881fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:37.857980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-650b452b-81cb-4c61-ab6e-dfb24ff881fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:37.858416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-650b452b-81cb-4c61-ab6e-dfb24ff881fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:37.874683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-99096648-6214-4739-9e67-57720d0d6cab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:37.875583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-99096648-6214-4739-9e67-57720d0d6cab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:37.882562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99096648-6214-4739-9e67-57720d0d6cab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:37.883008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99096648-6214-4739-9e67-57720d0d6cab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:37.883837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99096648-6214-4739-9e67-57720d0d6cab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:37.884902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99096648-6214-4739-9e67-57720d0d6cab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:37.915628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-99096648-6214-4739-9e67-57720d0d6cab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044719 Jun 02 19:07:37.916311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 408/830] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:37.921650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-650b452b-81cb-4c61-ab6e-dfb24ff881fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:37.929459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-650b452b-81cb-4c61-ab6e-dfb24ff881fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084839 Jun 02 19:07:37.930041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 423/831] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:37 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:38.190335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fe05cae6-a1a4-455c-8791-4667afa3dc77 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:38.192041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fe05cae6-a1a4-455c-8791-4667afa3dc77 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:38.200686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe05cae6-a1a4-455c-8791-4667afa3dc77 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:38.201029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe05cae6-a1a4-455c-8791-4667afa3dc77 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:38.201782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe05cae6-a1a4-455c-8791-4667afa3dc77 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:38.202248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe05cae6-a1a4-455c-8791-4667afa3dc77 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:38.232580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fe05cae6-a1a4-455c-8791-4667afa3dc77 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048945 Jun 02 19:07:38.233140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 409/832] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:38.932968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bd8e50ab-3e2d-405d-b7d6-21f4d7d3f4af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:38.933910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bd8e50ab-3e2d-405d-b7d6-21f4d7d3f4af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:38.940686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bd8e50ab-3e2d-405d-b7d6-21f4d7d3f4af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:38.941148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bd8e50ab-3e2d-405d-b7d6-21f4d7d3f4af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:38.941946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bd8e50ab-3e2d-405d-b7d6-21f4d7d3f4af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:38.942390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bd8e50ab-3e2d-405d-b7d6-21f4d7d3f4af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:38.946941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-00e8cadb-dd3d-4197-9f98-741568a651c7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:38.947578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-00e8cadb-dd3d-4197-9f98-741568a651c7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:38.954427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00e8cadb-dd3d-4197-9f98-741568a651c7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:38.954867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00e8cadb-dd3d-4197-9f98-741568a651c7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:38.955625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00e8cadb-dd3d-4197-9f98-741568a651c7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:38.956050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00e8cadb-dd3d-4197-9f98-741568a651c7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:38.973590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bd8e50ab-3e2d-405d-b7d6-21f4d7d3f4af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048226 Jun 02 19:07:38.974189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 424/833] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:39.018162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-00e8cadb-dd3d-4197-9f98-741568a651c7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:39.026051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-00e8cadb-dd3d-4197-9f98-741568a651c7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.083172 Jun 02 19:07:39.026672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 410/834] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:38 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:39.246952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-943d8b4e-9492-4f1b-ba1d-7acf97bce699 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:39.247791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-943d8b4e-9492-4f1b-ba1d-7acf97bce699 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:39.254384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-943d8b4e-9492-4f1b-ba1d-7acf97bce699 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:39.254810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-943d8b4e-9492-4f1b-ba1d-7acf97bce699 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:39.255584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-943d8b4e-9492-4f1b-ba1d-7acf97bce699 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:39.256021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-943d8b4e-9492-4f1b-ba1d-7acf97bce699 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:39.286719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-943d8b4e-9492-4f1b-ba1d-7acf97bce699 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Jun 02 19:07:39.287272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 425/835] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:39.990448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-caa4fc15-d70b-4035-8f8d-5fbc78de529e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:39.991942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-caa4fc15-d70b-4035-8f8d-5fbc78de529e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:40.001322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-caa4fc15-d70b-4035-8f8d-5fbc78de529e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:40.001780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-caa4fc15-d70b-4035-8f8d-5fbc78de529e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:40.002774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-caa4fc15-d70b-4035-8f8d-5fbc78de529e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:40.003323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-caa4fc15-d70b-4035-8f8d-5fbc78de529e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:40.034508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-caa4fc15-d70b-4035-8f8d-5fbc78de529e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050748 Jun 02 19:07:40.035046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 411/836] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:40.043358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e248d700-be58-429e-ad21-86d2d3031b1d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:40.044008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e248d700-be58-429e-ad21-86d2d3031b1d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:40.051116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e248d700-be58-429e-ad21-86d2d3031b1d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:40.051567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e248d700-be58-429e-ad21-86d2d3031b1d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:40.052335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e248d700-be58-429e-ad21-86d2d3031b1d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:40.052770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e248d700-be58-429e-ad21-86d2d3031b1d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:40.118113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e248d700-be58-429e-ad21-86d2d3031b1d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:40.127513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e248d700-be58-429e-ad21-86d2d3031b1d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087997 Jun 02 19:07:40.128124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 426/837] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:40 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:40.299732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0403314c-c05a-46b1-985a-ff5b3af89735 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:40.300679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0403314c-c05a-46b1-985a-ff5b3af89735 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:40.307196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0403314c-c05a-46b1-985a-ff5b3af89735 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:40.307636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0403314c-c05a-46b1-985a-ff5b3af89735 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:40.308430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0403314c-c05a-46b1-985a-ff5b3af89735 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:40.308851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0403314c-c05a-46b1-985a-ff5b3af89735 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:40.342453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0403314c-c05a-46b1-985a-ff5b3af89735 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046662 Jun 02 19:07:40.343002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 412/838] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:41.047105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1b4d44e4-acd4-4f71-a6c6-8b08aa0c306e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:41.048041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1b4d44e4-acd4-4f71-a6c6-8b08aa0c306e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:41.055100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1b4d44e4-acd4-4f71-a6c6-8b08aa0c306e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:41.055559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1b4d44e4-acd4-4f71-a6c6-8b08aa0c306e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:41.056330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1b4d44e4-acd4-4f71-a6c6-8b08aa0c306e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:41.056765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1b4d44e4-acd4-4f71-a6c6-8b08aa0c306e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:41.088013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1b4d44e4-acd4-4f71-a6c6-8b08aa0c306e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045416 Jun 02 19:07:41.088595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 427/839] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:41.152618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fb9b6a22-6aa9-4b79-8c77-5655cf85f65b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:41.153213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fb9b6a22-6aa9-4b79-8c77-5655cf85f65b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:41.156695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=70 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:41.164245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a22-6aa9-4b79-8c77-5655cf85f65b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:41.164897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a22-6aa9-4b79-8c77-5655cf85f65b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:41.166152 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a22-6aa9-4b79-8c77-5655cf85f65b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:41.166796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a22-6aa9-4b79-8c77-5655cf85f65b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:41.249086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fb9b6a22-6aa9-4b79-8c77-5655cf85f65b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:41.257302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fb9b6a22-6aa9-4b79-8c77-5655cf85f65b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.110771 Jun 02 19:07:41.257858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 413/840] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:41 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:41.357239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5c6b6d85-b022-4cfc-b1f9-dd3851b0ba07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:41.358110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5c6b6d85-b022-4cfc-b1f9-dd3851b0ba07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:41.364690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c6b6d85-b022-4cfc-b1f9-dd3851b0ba07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:41.365141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c6b6d85-b022-4cfc-b1f9-dd3851b0ba07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:41.365934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c6b6d85-b022-4cfc-b1f9-dd3851b0ba07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:41.366373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c6b6d85-b022-4cfc-b1f9-dd3851b0ba07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:41.397440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5c6b6d85-b022-4cfc-b1f9-dd3851b0ba07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Jun 02 19:07:41.398015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 428/841] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:42.103989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-76d70b5f-0bff-4629-b745-45bd3374e8e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:42.105217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-76d70b5f-0bff-4629-b745-45bd3374e8e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:42.112299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76d70b5f-0bff-4629-b745-45bd3374e8e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:42.112750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76d70b5f-0bff-4629-b745-45bd3374e8e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:42.113531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76d70b5f-0bff-4629-b745-45bd3374e8e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:42.113999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76d70b5f-0bff-4629-b745-45bd3374e8e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:42.145545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-76d70b5f-0bff-4629-b745-45bd3374e8e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048093 Jun 02 19:07:42.146137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 414/842] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:42.274863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3989f0e4-73b9-438e-a4d6-37cd65de4c8d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:42.275478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3989f0e4-73b9-438e-a4d6-37cd65de4c8d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:42.282751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3989f0e4-73b9-438e-a4d6-37cd65de4c8d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:42.283209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3989f0e4-73b9-438e-a4d6-37cd65de4c8d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:42.283978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3989f0e4-73b9-438e-a4d6-37cd65de4c8d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:42.284510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3989f0e4-73b9-438e-a4d6-37cd65de4c8d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:42.352153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3989f0e4-73b9-438e-a4d6-37cd65de4c8d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:42.360314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3989f0e4-73b9-438e-a4d6-37cd65de4c8d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089314 Jun 02 19:07:42.360788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 429/843] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:42 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:42.410701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-44c9e2e9-f800-4511-8bd0-3c5d3954c0d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:42.411622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-44c9e2e9-f800-4511-8bd0-3c5d3954c0d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:42.418098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44c9e2e9-f800-4511-8bd0-3c5d3954c0d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:42.418582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44c9e2e9-f800-4511-8bd0-3c5d3954c0d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:42.419338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44c9e2e9-f800-4511-8bd0-3c5d3954c0d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:42.419766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44c9e2e9-f800-4511-8bd0-3c5d3954c0d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:42.449221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-44c9e2e9-f800-4511-8bd0-3c5d3954c0d6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Jun 02 19:07:42.450039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 415/844] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:07:43.159388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5304fcc5-a6ae-4770-b4d3-f50b03b77df8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:43.160393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5304fcc5-a6ae-4770-b4d3-f50b03b77df8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:43.162351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:43.168344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5304fcc5-a6ae-4770-b4d3-f50b03b77df8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:43.168867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5304fcc5-a6ae-4770-b4d3-f50b03b77df8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:43.169680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5304fcc5-a6ae-4770-b4d3-f50b03b77df8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:43.170140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5304fcc5-a6ae-4770-b4d3-f50b03b77df8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:43.202136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5304fcc5-a6ae-4770-b4d3-f50b03b77df8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046705 Jun 02 19:07:43.202708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 430/845] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:43.376836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-632cf022-d40e-4a30-8331-cedb18b813c2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:43.377444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-632cf022-d40e-4a30-8331-cedb18b813c2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:43.383812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-632cf022-d40e-4a30-8331-cedb18b813c2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:43.384281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-632cf022-d40e-4a30-8331-cedb18b813c2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:43.385035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-632cf022-d40e-4a30-8331-cedb18b813c2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:43.385454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-632cf022-d40e-4a30-8331-cedb18b813c2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:43.449375 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-632cf022-d40e-4a30-8331-cedb18b813c2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:43.457466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-632cf022-d40e-4a30-8331-cedb18b813c2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084461 Jun 02 19:07:43.458049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 416/846] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:43 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:43.460836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9e237dbe-8573-413b-bc96-9ace0167fb2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:43.461776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9e237dbe-8573-413b-bc96-9ace0167fb2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:43.468685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e237dbe-8573-413b-bc96-9ace0167fb2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:43.469144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e237dbe-8573-413b-bc96-9ace0167fb2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:43.469935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e237dbe-8573-413b-bc96-9ace0167fb2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:43.470370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e237dbe-8573-413b-bc96-9ace0167fb2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:43.505130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9e237dbe-8573-413b-bc96-9ace0167fb2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Jun 02 19:07:43.505747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 431/847] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:44.216391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ee18bf22-21a1-450d-b5f8-3e8c832112cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:44.217568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ee18bf22-21a1-450d-b5f8-3e8c832112cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:44.225257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee18bf22-21a1-450d-b5f8-3e8c832112cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:44.225858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee18bf22-21a1-450d-b5f8-3e8c832112cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:44.227087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee18bf22-21a1-450d-b5f8-3e8c832112cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:44.227720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee18bf22-21a1-450d-b5f8-3e8c832112cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:44.260026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ee18bf22-21a1-450d-b5f8-3e8c832112cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048285 Jun 02 19:07:44.260607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 417/848] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 19:07:44.479851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-823b69e3-3c17-4006-ac68-55f3ef8b4876 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:44.479851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-823b69e3-3c17-4006-ac68-55f3ef8b4876 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:44.485505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-823b69e3-3c17-4006-ac68-55f3ef8b4876 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:44.485976 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-823b69e3-3c17-4006-ac68-55f3ef8b4876 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:44.486878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-823b69e3-3c17-4006-ac68-55f3ef8b4876 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:44.487311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-823b69e3-3c17-4006-ac68-55f3ef8b4876 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:44.518260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6da0f23b-a73e-42dc-8435-a8bbb4de0e5b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:44.519376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6da0f23b-a73e-42dc-8435-a8bbb4de0e5b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:44.526998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6da0f23b-a73e-42dc-8435-a8bbb4de0e5b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:44.527449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6da0f23b-a73e-42dc-8435-a8bbb4de0e5b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:44.528985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6da0f23b-a73e-42dc-8435-a8bbb4de0e5b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:44.529283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6da0f23b-a73e-42dc-8435-a8bbb4de0e5b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:44.551710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-823b69e3-3c17-4006-ac68-55f3ef8b4876 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:44.560328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6da0f23b-a73e-42dc-8435-a8bbb4de0e5b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045689 Jun 02 19:07:44.560562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-823b69e3-3c17-4006-ac68-55f3ef8b4876 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087460 Jun 02 19:07:44.560919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 418/849] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:44.561270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 432/850] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:44 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:45.273064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c16219c4-cbb3-4068-9f6f-1f9d2a8af384 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:45.274111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c16219c4-cbb3-4068-9f6f-1f9d2a8af384 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:45.280931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c16219c4-cbb3-4068-9f6f-1f9d2a8af384 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:45.281412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c16219c4-cbb3-4068-9f6f-1f9d2a8af384 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:45.282236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c16219c4-cbb3-4068-9f6f-1f9d2a8af384 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:45.282666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c16219c4-cbb3-4068-9f6f-1f9d2a8af384 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:45.313482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c16219c4-cbb3-4068-9f6f-1f9d2a8af384 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044960 Jun 02 19:07:45.314098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 419/851] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:45.573683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2c7e799c-cd72-47b9-bb52-651c409e7c2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:45.574779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2c7e799c-cd72-47b9-bb52-651c409e7c2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:45.578541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-55535a3d-decf-45b3-b947-1f84c1693cd1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:45.579148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-55535a3d-decf-45b3-b947-1f84c1693cd1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:45.581990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c7e799c-cd72-47b9-bb52-651c409e7c2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:45.582448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c7e799c-cd72-47b9-bb52-651c409e7c2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:45.583233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c7e799c-cd72-47b9-bb52-651c409e7c2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:45.583680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c7e799c-cd72-47b9-bb52-651c409e7c2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:45.585739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-55535a3d-decf-45b3-b947-1f84c1693cd1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:45.590697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:45.590882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-55535a3d-decf-45b3-b947-1f84c1693cd1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:45.590882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-55535a3d-decf-45b3-b947-1f84c1693cd1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:45.590882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-55535a3d-decf-45b3-b947-1f84c1693cd1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:45.617112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2c7e799c-cd72-47b9-bb52-651c409e7c2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048030 Jun 02 19:07:45.617674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 433/852] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:45.654355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-55535a3d-decf-45b3-b947-1f84c1693cd1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:45.656647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:45.663407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-55535a3d-decf-45b3-b947-1f84c1693cd1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089062 Jun 02 19:07:45.663979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 420/853] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:45 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:46.328393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0271cbaf-7338-4935-a550-0957bc0e66fd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:46.329354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0271cbaf-7338-4935-a550-0957bc0e66fd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:46.335852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0271cbaf-7338-4935-a550-0957bc0e66fd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:46.336303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0271cbaf-7338-4935-a550-0957bc0e66fd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:46.337067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0271cbaf-7338-4935-a550-0957bc0e66fd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:46.337499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0271cbaf-7338-4935-a550-0957bc0e66fd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:46.368815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0271cbaf-7338-4935-a550-0957bc0e66fd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046379 Jun 02 19:07:46.369362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 434/854] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:46.629916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6368ec07-556c-4d81-895f-05fe7a5eaef1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:46.630853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6368ec07-556c-4d81-895f-05fe7a5eaef1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:46.638173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6368ec07-556c-4d81-895f-05fe7a5eaef1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:46.638624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6368ec07-556c-4d81-895f-05fe7a5eaef1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:46.639387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6368ec07-556c-4d81-895f-05fe7a5eaef1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:46.639824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6368ec07-556c-4d81-895f-05fe7a5eaef1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:46.669626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6368ec07-556c-4d81-895f-05fe7a5eaef1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Jun 02 19:07:46.670280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 421/855] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:46.680583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-88633d5f-c455-4a07-97cf-25e7a37ea497 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:46.681202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-88633d5f-c455-4a07-97cf-25e7a37ea497 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:46.688699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88633d5f-c455-4a07-97cf-25e7a37ea497 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:46.689154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88633d5f-c455-4a07-97cf-25e7a37ea497 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:46.689973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88633d5f-c455-4a07-97cf-25e7a37ea497 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:46.690396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88633d5f-c455-4a07-97cf-25e7a37ea497 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:46.751863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-88633d5f-c455-4a07-97cf-25e7a37ea497 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:46.760317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-88633d5f-c455-4a07-97cf-25e7a37ea497 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.083556 Jun 02 19:07:46.761004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 435/856] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:46 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:47.387260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3a991a24-4bb2-410e-8949-5782f6fbba50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:47.389039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3a991a24-4bb2-410e-8949-5782f6fbba50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:47.399683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a991a24-4bb2-410e-8949-5782f6fbba50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:47.400277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a991a24-4bb2-410e-8949-5782f6fbba50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:47.401466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a991a24-4bb2-410e-8949-5782f6fbba50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:47.402252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a991a24-4bb2-410e-8949-5782f6fbba50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:47.432852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3a991a24-4bb2-410e-8949-5782f6fbba50 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052462 Jun 02 19:07:47.433469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 422/857] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:47.685410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-09d9abb5-771c-4599-b5ae-8877ae83fc29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:47.686302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-09d9abb5-771c-4599-b5ae-8877ae83fc29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:47.693571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09d9abb5-771c-4599-b5ae-8877ae83fc29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:47.694071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09d9abb5-771c-4599-b5ae-8877ae83fc29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:47.694842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09d9abb5-771c-4599-b5ae-8877ae83fc29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:47.695296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09d9abb5-771c-4599-b5ae-8877ae83fc29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:47.725532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-09d9abb5-771c-4599-b5ae-8877ae83fc29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046572 Jun 02 19:07:47.726105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 436/858] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:47.784999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5f4f8f92-18ba-4d27-9e76-fa8e687abf7d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:47.785836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5f4f8f92-18ba-4d27-9e76-fa8e687abf7d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:47.795140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f4f8f92-18ba-4d27-9e76-fa8e687abf7d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:47.795613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f4f8f92-18ba-4d27-9e76-fa8e687abf7d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:47.796367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f4f8f92-18ba-4d27-9e76-fa8e687abf7d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:47.796758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f4f8f92-18ba-4d27-9e76-fa8e687abf7d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:47.870123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5f4f8f92-18ba-4d27-9e76-fa8e687abf7d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:47.881736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5f4f8f92-18ba-4d27-9e76-fa8e687abf7d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102239 Jun 02 19:07:47.882542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 423/859] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:47 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:48.451848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-210f9cd6-f0d8-416a-a288-9f22a34e176b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:48.453365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-210f9cd6-f0d8-416a-a288-9f22a34e176b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:48.465518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-210f9cd6-f0d8-416a-a288-9f22a34e176b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:48.466295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-210f9cd6-f0d8-416a-a288-9f22a34e176b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:48.467068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-210f9cd6-f0d8-416a-a288-9f22a34e176b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:48.467506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-210f9cd6-f0d8-416a-a288-9f22a34e176b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:48.497869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-210f9cd6-f0d8-416a-a288-9f22a34e176b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053245 Jun 02 19:07:48.498344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 437/860] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:48.741145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9ceded2b-498a-46c0-97b5-87f0caaa7cf0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:48.742706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9ceded2b-498a-46c0-97b5-87f0caaa7cf0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:48.753255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ceded2b-498a-46c0-97b5-87f0caaa7cf0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:48.753895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ceded2b-498a-46c0-97b5-87f0caaa7cf0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:48.755187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ceded2b-498a-46c0-97b5-87f0caaa7cf0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:48.755892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ceded2b-498a-46c0-97b5-87f0caaa7cf0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:48.787390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9ceded2b-498a-46c0-97b5-87f0caaa7cf0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052931 Jun 02 19:07:48.788040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 424/861] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:48.903492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f88958d4-b50a-4f42-978b-0b9385ea5858 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:48.904232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f88958d4-b50a-4f42-978b-0b9385ea5858 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:48.911833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f88958d4-b50a-4f42-978b-0b9385ea5858 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:48.912341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f88958d4-b50a-4f42-978b-0b9385ea5858 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:48.913204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f88958d4-b50a-4f42-978b-0b9385ea5858 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:48.913662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f88958d4-b50a-4f42-978b-0b9385ea5858 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:48.981066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f88958d4-b50a-4f42-978b-0b9385ea5858 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:48.989350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f88958d4-b50a-4f42-978b-0b9385ea5858 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092678 Jun 02 19:07:48.989966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 438/862] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:48 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:49.514045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a8abfcf6-c087-4664-9afa-6dbbb0d5f1b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:49.514913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a8abfcf6-c087-4664-9afa-6dbbb0d5f1b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:49.522166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8abfcf6-c087-4664-9afa-6dbbb0d5f1b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:49.522631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8abfcf6-c087-4664-9afa-6dbbb0d5f1b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:49.523436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8abfcf6-c087-4664-9afa-6dbbb0d5f1b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:49.523884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8abfcf6-c087-4664-9afa-6dbbb0d5f1b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:49.555572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a8abfcf6-c087-4664-9afa-6dbbb0d5f1b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048125 Jun 02 19:07:49.556121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 425/863] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:49.802693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-24995bb2-1d1b-4caf-a1ec-559026f2ebdb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:49.803715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-24995bb2-1d1b-4caf-a1ec-559026f2ebdb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:49.811705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24995bb2-1d1b-4caf-a1ec-559026f2ebdb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:49.812163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24995bb2-1d1b-4caf-a1ec-559026f2ebdb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:49.812924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24995bb2-1d1b-4caf-a1ec-559026f2ebdb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:49.813357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24995bb2-1d1b-4caf-a1ec-559026f2ebdb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:49.844606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-24995bb2-1d1b-4caf-a1ec-559026f2ebdb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048595 Jun 02 19:07:49.845136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 439/864] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:50.007586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-84be8fae-6974-47bd-b058-0b1cde2c441f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:50.008303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84be8fae-6974-47bd-b058-0b1cde2c441f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:50.015006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84be8fae-6974-47bd-b058-0b1cde2c441f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:50.015475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84be8fae-6974-47bd-b058-0b1cde2c441f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:50.016342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84be8fae-6974-47bd-b058-0b1cde2c441f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:50.016771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84be8fae-6974-47bd-b058-0b1cde2c441f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:50.098121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-84be8fae-6974-47bd-b058-0b1cde2c441f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:50.105933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-84be8fae-6974-47bd-b058-0b1cde2c441f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102374 Jun 02 19:07:50.106601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 426/865] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:50 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:50.567527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-660b898a-4467-437e-af5d-d52abc177f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:50.568454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-660b898a-4467-437e-af5d-d52abc177f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:50.576172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-660b898a-4467-437e-af5d-d52abc177f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:50.576622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-660b898a-4467-437e-af5d-d52abc177f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:50.577392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-660b898a-4467-437e-af5d-d52abc177f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:50.577825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-660b898a-4467-437e-af5d-d52abc177f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:50.607649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-660b898a-4467-437e-af5d-d52abc177f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044192 Jun 02 19:07:50.608191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 440/866] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:50.857935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7440b2ff-2dad-4b4a-b437-fa07c26986d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:50.858823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7440b2ff-2dad-4b4a-b437-fa07c26986d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:50.865765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7440b2ff-2dad-4b4a-b437-fa07c26986d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:50.866241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7440b2ff-2dad-4b4a-b437-fa07c26986d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:50.867002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7440b2ff-2dad-4b4a-b437-fa07c26986d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:50.867427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7440b2ff-2dad-4b4a-b437-fa07c26986d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:50.897214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7440b2ff-2dad-4b4a-b437-fa07c26986d8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Jun 02 19:07:50.897759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 427/867] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:51.124089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8c418a7a-a5ff-43c2-b0fe-7f035508f663 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:51.124620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8c418a7a-a5ff-43c2-b0fe-7f035508f663 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:51.131440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c418a7a-a5ff-43c2-b0fe-7f035508f663 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:51.131898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c418a7a-a5ff-43c2-b0fe-7f035508f663 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:51.132668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c418a7a-a5ff-43c2-b0fe-7f035508f663 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:51.133113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c418a7a-a5ff-43c2-b0fe-7f035508f663 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:51.204497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c418a7a-a5ff-43c2-b0fe-7f035508f663 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:51.212497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8c418a7a-a5ff-43c2-b0fe-7f035508f663 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093136 Jun 02 19:07:51.213059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 441/868] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:51 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:51.624772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d7f72e90-415e-404c-a3ca-a470dfb5a78d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:51.626320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d7f72e90-415e-404c-a3ca-a470dfb5a78d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:51.636630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d7f72e90-415e-404c-a3ca-a470dfb5a78d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:51.637551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d7f72e90-415e-404c-a3ca-a470dfb5a78d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:51.638903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d7f72e90-415e-404c-a3ca-a470dfb5a78d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:51.639341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d7f72e90-415e-404c-a3ca-a470dfb5a78d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:51.668775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d7f72e90-415e-404c-a3ca-a470dfb5a78d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051459 Jun 02 19:07:51.669458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 428/869] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:51.915660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8226ddd6-c56b-41a3-ae00-fc1cd1da0d47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:51.917179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8226ddd6-c56b-41a3-ae00-fc1cd1da0d47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:51.929422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8226ddd6-c56b-41a3-ae00-fc1cd1da0d47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:51.930231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8226ddd6-c56b-41a3-ae00-fc1cd1da0d47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:51.931514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8226ddd6-c56b-41a3-ae00-fc1cd1da0d47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:51.932238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8226ddd6-c56b-41a3-ae00-fc1cd1da0d47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:51.963973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8226ddd6-c56b-41a3-ae00-fc1cd1da0d47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055351 Jun 02 19:07:51.964514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 442/870] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:52.232921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b0eadbc-b71e-4ae0-97dc-9c92675b790f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:52.233880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b0eadbc-b71e-4ae0-97dc-9c92675b790f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:52.245868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b0eadbc-b71e-4ae0-97dc-9c92675b790f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:52.245868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b0eadbc-b71e-4ae0-97dc-9c92675b790f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:52.247101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b0eadbc-b71e-4ae0-97dc-9c92675b790f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:52.247534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b0eadbc-b71e-4ae0-97dc-9c92675b790f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:52.315002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3b0eadbc-b71e-4ae0-97dc-9c92675b790f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:52.323274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b0eadbc-b71e-4ae0-97dc-9c92675b790f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097034 Jun 02 19:07:52.323831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 429/871] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:52 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:52.685218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d6d5cfe3-5a8c-4552-aad7-dc8c1e30bc1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:52.686382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d6d5cfe3-5a8c-4552-aad7-dc8c1e30bc1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:52.693645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6d5cfe3-5a8c-4552-aad7-dc8c1e30bc1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:52.694182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6d5cfe3-5a8c-4552-aad7-dc8c1e30bc1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:52.695028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6d5cfe3-5a8c-4552-aad7-dc8c1e30bc1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:52.695518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6d5cfe3-5a8c-4552-aad7-dc8c1e30bc1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:52.727771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d6d5cfe3-5a8c-4552-aad7-dc8c1e30bc1c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049351 Jun 02 19:07:52.728320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 443/872] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:52.980269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7fd91887-490b-44f0-997e-878561bdd70f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:52.982185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7fd91887-490b-44f0-997e-878561bdd70f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:52.992732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7fd91887-490b-44f0-997e-878561bdd70f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:52.993479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7fd91887-490b-44f0-997e-878561bdd70f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:52.994745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7fd91887-490b-44f0-997e-878561bdd70f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:52.995516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7fd91887-490b-44f0-997e-878561bdd70f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:53.025576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7fd91887-490b-44f0-997e-878561bdd70f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052198 Jun 02 19:07:53.026152 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 430/873] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:53.341266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-951a22a8-4ad9-4be1-9771-901cfaaa5bd7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:53.341865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-951a22a8-4ad9-4be1-9771-901cfaaa5bd7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:53.349148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-951a22a8-4ad9-4be1-9771-901cfaaa5bd7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:53.349556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-951a22a8-4ad9-4be1-9771-901cfaaa5bd7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:53.350424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-951a22a8-4ad9-4be1-9771-901cfaaa5bd7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:53.350855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-951a22a8-4ad9-4be1-9771-901cfaaa5bd7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:53.423325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-951a22a8-4ad9-4be1-9771-901cfaaa5bd7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:53.431568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-951a22a8-4ad9-4be1-9771-901cfaaa5bd7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094810 Jun 02 19:07:53.432142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 444/874] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:53 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:53.742903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0d42b09c-c7e0-4cf8-a7fb-c4b07487b424 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:53.744191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0d42b09c-c7e0-4cf8-a7fb-c4b07487b424 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:53.752382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d42b09c-c7e0-4cf8-a7fb-c4b07487b424 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:53.752832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d42b09c-c7e0-4cf8-a7fb-c4b07487b424 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:53.753604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d42b09c-c7e0-4cf8-a7fb-c4b07487b424 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:53.754068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d42b09c-c7e0-4cf8-a7fb-c4b07487b424 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:53.783807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0d42b09c-c7e0-4cf8-a7fb-c4b07487b424 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047463 Jun 02 19:07:53.784348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 431/875] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:54.040737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0484102d-ea96-445c-9c3f-36ca7a6e8cb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:54.042328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0484102d-ea96-445c-9c3f-36ca7a6e8cb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:54.049704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0484102d-ea96-445c-9c3f-36ca7a6e8cb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:54.050204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0484102d-ea96-445c-9c3f-36ca7a6e8cb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:54.050978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0484102d-ea96-445c-9c3f-36ca7a6e8cb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:54.051408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0484102d-ea96-445c-9c3f-36ca7a6e8cb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:54.081897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0484102d-ea96-445c-9c3f-36ca7a6e8cb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047830 Jun 02 19:07:54.082473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 445/876] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:54.453182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-415a9072-75b9-4dcf-b87b-a1e072d2ffa0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:54.454205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-415a9072-75b9-4dcf-b87b-a1e072d2ffa0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:54.464555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-415a9072-75b9-4dcf-b87b-a1e072d2ffa0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:54.465294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-415a9072-75b9-4dcf-b87b-a1e072d2ffa0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:54.466468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-415a9072-75b9-4dcf-b87b-a1e072d2ffa0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:54.466903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-415a9072-75b9-4dcf-b87b-a1e072d2ffa0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:54.535024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-415a9072-75b9-4dcf-b87b-a1e072d2ffa0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:54.546445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-415a9072-75b9-4dcf-b87b-a1e072d2ffa0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.100196 Jun 02 19:07:54.547029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 432/877] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:54 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:54.799181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3a97cc14-3765-440e-a784-f1ced0c4641a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:54.800410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a97cc14-3765-440e-a784-f1ced0c4641a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:54.809624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a97cc14-3765-440e-a784-f1ced0c4641a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:54.810357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a97cc14-3765-440e-a784-f1ced0c4641a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:54.811246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a97cc14-3765-440e-a784-f1ced0c4641a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:54.811843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a97cc14-3765-440e-a784-f1ced0c4641a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:54.845359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3a97cc14-3765-440e-a784-f1ced0c4641a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052009 Jun 02 19:07:54.845938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 446/878] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:55.096874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d34a1e61-cb06-4aae-8b44-6647a553971b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:55.097727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d34a1e61-cb06-4aae-8b44-6647a553971b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:55.104670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d34a1e61-cb06-4aae-8b44-6647a553971b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:55.105118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d34a1e61-cb06-4aae-8b44-6647a553971b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:55.105921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d34a1e61-cb06-4aae-8b44-6647a553971b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:55.106346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d34a1e61-cb06-4aae-8b44-6647a553971b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:55.136338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d34a1e61-cb06-4aae-8b44-6647a553971b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043598 Jun 02 19:07:55.136885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 433/879] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:55.564230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-93b40fa4-5509-41fa-9cc3-53b33cd680aa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:55.564870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-93b40fa4-5509-41fa-9cc3-53b33cd680aa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:55.571819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93b40fa4-5509-41fa-9cc3-53b33cd680aa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:55.572279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93b40fa4-5509-41fa-9cc3-53b33cd680aa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:55.573057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93b40fa4-5509-41fa-9cc3-53b33cd680aa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:55.573500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93b40fa4-5509-41fa-9cc3-53b33cd680aa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:55.637539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-93b40fa4-5509-41fa-9cc3-53b33cd680aa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:55.648712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-93b40fa4-5509-41fa-9cc3-53b33cd680aa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088409 Jun 02 19:07:55.649478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 447/880] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:55 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:55.860886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-39d74af2-f7f6-4555-852a-b6846b8aaab7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:55.862329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-39d74af2-f7f6-4555-852a-b6846b8aaab7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:55.870939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-39d74af2-f7f6-4555-852a-b6846b8aaab7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:55.871613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-39d74af2-f7f6-4555-852a-b6846b8aaab7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:55.872643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-39d74af2-f7f6-4555-852a-b6846b8aaab7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:55.873079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-39d74af2-f7f6-4555-852a-b6846b8aaab7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:55.903673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-39d74af2-f7f6-4555-852a-b6846b8aaab7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049208 Jun 02 19:07:55.904251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 434/881] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:56.152932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0c4b8ef5-77c3-49f0-81b6-cc9afac5f30c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:56.154519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0c4b8ef5-77c3-49f0-81b6-cc9afac5f30c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:56.165425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c4b8ef5-77c3-49f0-81b6-cc9afac5f30c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:56.166238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c4b8ef5-77c3-49f0-81b6-cc9afac5f30c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:56.167529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c4b8ef5-77c3-49f0-81b6-cc9afac5f30c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:56.168262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c4b8ef5-77c3-49f0-81b6-cc9afac5f30c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:56.199648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0c4b8ef5-77c3-49f0-81b6-cc9afac5f30c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053344 Jun 02 19:07:56.200204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 448/882] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:56.667188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ae108650-7b04-4fed-8862-2eea85e4994a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:56.667813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ae108650-7b04-4fed-8862-2eea85e4994a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:56.675404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae108650-7b04-4fed-8862-2eea85e4994a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:56.675851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae108650-7b04-4fed-8862-2eea85e4994a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:56.676604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae108650-7b04-4fed-8862-2eea85e4994a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:56.677031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae108650-7b04-4fed-8862-2eea85e4994a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:56.740943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ae108650-7b04-4fed-8862-2eea85e4994a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:56.748691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ae108650-7b04-4fed-8862-2eea85e4994a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085391 Jun 02 19:07:56.749245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 435/883] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:56 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:56.919467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ab575c6d-d444-4873-b059-5f374ccb0d41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:56.920406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ab575c6d-d444-4873-b059-5f374ccb0d41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:56.927212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab575c6d-d444-4873-b059-5f374ccb0d41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:56.927765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab575c6d-d444-4873-b059-5f374ccb0d41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:56.928621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab575c6d-d444-4873-b059-5f374ccb0d41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:56.929057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab575c6d-d444-4873-b059-5f374ccb0d41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:56.957656 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:56.962561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ab575c6d-d444-4873-b059-5f374ccb0d41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048691 Jun 02 19:07:56.963110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 449/884] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:57.216557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6d6f636e-552c-4e81-8a2c-354777586d89 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:57.217140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6d6f636e-552c-4e81-8a2c-354777586d89 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:57.223459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6f636e-552c-4e81-8a2c-354777586d89 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:57.224060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6f636e-552c-4e81-8a2c-354777586d89 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:57.224654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6f636e-552c-4e81-8a2c-354777586d89 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:57.225077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6f636e-552c-4e81-8a2c-354777586d89 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:57.260435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6d6f636e-552c-4e81-8a2c-354777586d89 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051211 Jun 02 19:07:57.260996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 436/885] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:57.767589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92fce7a2-f4d2-424d-a3a7-ee929b31e05e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:57.768248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92fce7a2-f4d2-424d-a3a7-ee929b31e05e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:57.776631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92fce7a2-f4d2-424d-a3a7-ee929b31e05e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:57.777130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92fce7a2-f4d2-424d-a3a7-ee929b31e05e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:57.778008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92fce7a2-f4d2-424d-a3a7-ee929b31e05e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:57.778468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92fce7a2-f4d2-424d-a3a7-ee929b31e05e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:57.850598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92fce7a2-f4d2-424d-a3a7-ee929b31e05e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:57.860994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92fce7a2-f4d2-424d-a3a7-ee929b31e05e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098156 Jun 02 19:07:57.861527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 450/886] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:57 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:57.978701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60fa6069-9040-4cd5-9ae4-e89357df9e39 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:57.980242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-60fa6069-9040-4cd5-9ae4-e89357df9e39 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:57.991178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60fa6069-9040-4cd5-9ae4-e89357df9e39 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:57.991914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60fa6069-9040-4cd5-9ae4-e89357df9e39 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:57.993150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60fa6069-9040-4cd5-9ae4-e89357df9e39 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:57.993853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60fa6069-9040-4cd5-9ae4-e89357df9e39 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:58.008956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:58.027058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-60fa6069-9040-4cd5-9ae4-e89357df9e39 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055027 Jun 02 19:07:58.027713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 437/887] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:58.272178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-695b9051-a24b-435a-a89a-e3e1ffd9e3c2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:58.273120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-695b9051-a24b-435a-a89a-e3e1ffd9e3c2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:58.279799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695b9051-a24b-435a-a89a-e3e1ffd9e3c2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:58.280244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695b9051-a24b-435a-a89a-e3e1ffd9e3c2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:58.280994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695b9051-a24b-435a-a89a-e3e1ffd9e3c2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:58.281444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695b9051-a24b-435a-a89a-e3e1ffd9e3c2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:58.311661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-695b9051-a24b-435a-a89a-e3e1ffd9e3c2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Jun 02 19:07:58.312210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 451/888] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:58.878554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-03c01d1c-ab33-4685-8d76-a18780abf076 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:58.879121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-03c01d1c-ab33-4685-8d76-a18780abf076 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:58.885854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03c01d1c-ab33-4685-8d76-a18780abf076 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:58.886306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03c01d1c-ab33-4685-8d76-a18780abf076 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:58.887073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03c01d1c-ab33-4685-8d76-a18780abf076 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:58.887500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03c01d1c-ab33-4685-8d76-a18780abf076 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:58.957223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-03c01d1c-ab33-4685-8d76-a18780abf076 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:07:58.970530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-03c01d1c-ab33-4685-8d76-a18780abf076 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095703 Jun 02 19:07:58.971399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 438/889] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:58 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:07:59.041451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e60952b-318b-4b86-8195-f2f141b4ef3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:59.042425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e60952b-318b-4b86-8195-f2f141b4ef3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:59.049640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e60952b-318b-4b86-8195-f2f141b4ef3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:59.050157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e60952b-318b-4b86-8195-f2f141b4ef3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:59.050923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e60952b-318b-4b86-8195-f2f141b4ef3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:59.051358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e60952b-318b-4b86-8195-f2f141b4ef3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:59.082712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e60952b-318b-4b86-8195-f2f141b4ef3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045291 Jun 02 19:07:59.083454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 452/890] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:07:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:07:59.328093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c5903885-3b27-47f5-8120-f8407c9dbe99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:59.329641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c5903885-3b27-47f5-8120-f8407c9dbe99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:07:59.341124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5903885-3b27-47f5-8120-f8407c9dbe99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:59.341880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5903885-3b27-47f5-8120-f8407c9dbe99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:59.343149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5903885-3b27-47f5-8120-f8407c9dbe99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:07:59.344006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5903885-3b27-47f5-8120-f8407c9dbe99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:07:59.374443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c5903885-3b27-47f5-8120-f8407c9dbe99 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053332 Jun 02 19:07:59.375168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 439/891] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:07:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:07:59.997934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f9f77a5a-9791-429e-bbe4-76f7a20d47d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:07:59.999111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f9f77a5a-9791-429e-bbe4-76f7a20d47d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:00.011095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f9f77a5a-9791-429e-bbe4-76f7a20d47d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:00.012053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f9f77a5a-9791-429e-bbe4-76f7a20d47d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:00.013545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f9f77a5a-9791-429e-bbe4-76f7a20d47d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:00.014456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f9f77a5a-9791-429e-bbe4-76f7a20d47d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:00.090136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f9f77a5a-9791-429e-bbe4-76f7a20d47d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:00.097737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9e389a7-ab8c-4e2d-8089-fbbdb7c8c843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:00.098704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9e389a7-ab8c-4e2d-8089-fbbdb7c8c843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:00.099452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f9f77a5a-9791-429e-bbe4-76f7a20d47d9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.109140 Jun 02 19:08:00.100018 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 453/892] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:07:59 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:00.104991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9e389a7-ab8c-4e2d-8089-fbbdb7c8c843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:00.105438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9e389a7-ab8c-4e2d-8089-fbbdb7c8c843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:00.106209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9e389a7-ab8c-4e2d-8089-fbbdb7c8c843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:00.106659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9e389a7-ab8c-4e2d-8089-fbbdb7c8c843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:00.141390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9e389a7-ab8c-4e2d-8089-fbbdb7c8c843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048781 Jun 02 19:08:00.141973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 440/893] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:00.499899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3de7f6db-c5f5-42df-a598-659b507b6af1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:00.500867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3de7f6db-c5f5-42df-a598-659b507b6af1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:00.507302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3de7f6db-c5f5-42df-a598-659b507b6af1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:00.507751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3de7f6db-c5f5-42df-a598-659b507b6af1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:00.508511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3de7f6db-c5f5-42df-a598-659b507b6af1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:00.508947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3de7f6db-c5f5-42df-a598-659b507b6af1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:00.548238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3de7f6db-c5f5-42df-a598-659b507b6af1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163895 Jun 02 19:08:00.548829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 454/894] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:01.120452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-36576670-0268-48f3-afc4-6217bb60bc59 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:01.121399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-36576670-0268-48f3-afc4-6217bb60bc59 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:01.129855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36576670-0268-48f3-afc4-6217bb60bc59 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:01.130329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36576670-0268-48f3-afc4-6217bb60bc59 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:01.131086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36576670-0268-48f3-afc4-6217bb60bc59 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:01.131510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36576670-0268-48f3-afc4-6217bb60bc59 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:01.152977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d8c2946-08d7-4d70-9e08-8f89d589f9f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:01.153940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d8c2946-08d7-4d70-9e08-8f89d589f9f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:01.160883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d8c2946-08d7-4d70-9e08-8f89d589f9f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:01.161335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d8c2946-08d7-4d70-9e08-8f89d589f9f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:01.162130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d8c2946-08d7-4d70-9e08-8f89d589f9f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:01.162560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d8c2946-08d7-4d70-9e08-8f89d589f9f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:01.193440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d8c2946-08d7-4d70-9e08-8f89d589f9f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044477 Jun 02 19:08:01.194174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 455/895] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:01.196701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-36576670-0268-48f3-afc4-6217bb60bc59 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:01.205037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-36576670-0268-48f3-afc4-6217bb60bc59 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091076 Jun 02 19:08:01.205593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 441/896] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:01 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:01.560660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7d8b59ca-12b2-4715-bad7-0a6ec9c3f335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:01.561618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7d8b59ca-12b2-4715-bad7-0a6ec9c3f335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:01.568091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7d8b59ca-12b2-4715-bad7-0a6ec9c3f335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:01.568546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7d8b59ca-12b2-4715-bad7-0a6ec9c3f335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:01.569316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7d8b59ca-12b2-4715-bad7-0a6ec9c3f335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:01.569755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7d8b59ca-12b2-4715-bad7-0a6ec9c3f335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:01.600106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7d8b59ca-12b2-4715-bad7-0a6ec9c3f335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Jun 02 19:08:01.600704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 456/897] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:02.207081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2acdd38f-dd0e-44d8-9048-c5909f6869d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:02.208012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2acdd38f-dd0e-44d8-9048-c5909f6869d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:02.214841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2acdd38f-dd0e-44d8-9048-c5909f6869d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:02.215289 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2acdd38f-dd0e-44d8-9048-c5909f6869d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:02.216049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2acdd38f-dd0e-44d8-9048-c5909f6869d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:02.216569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2acdd38f-dd0e-44d8-9048-c5909f6869d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:02.221975 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bdd75879-081c-4d2c-89aa-1e83c8422fe0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:02.222802 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bdd75879-081c-4d2c-89aa-1e83c8422fe0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:02.229972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdd75879-081c-4d2c-89aa-1e83c8422fe0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:02.230436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdd75879-081c-4d2c-89aa-1e83c8422fe0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:02.231220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdd75879-081c-4d2c-89aa-1e83c8422fe0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:02.231664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdd75879-081c-4d2c-89aa-1e83c8422fe0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:02.254245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2acdd38f-dd0e-44d8-9048-c5909f6869d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052174 Jun 02 19:08:02.255253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 442/898] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:02.297084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bdd75879-081c-4d2c-89aa-1e83c8422fe0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:02.304801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bdd75879-081c-4d2c-89aa-1e83c8422fe0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086965 Jun 02 19:08:02.305360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 457/899] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:02 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:02.613101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-00e2b215-a6e9-4e33-8d11-a81daa2cb999 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:02.614061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-00e2b215-a6e9-4e33-8d11-a81daa2cb999 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:02.620653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00e2b215-a6e9-4e33-8d11-a81daa2cb999 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:02.621100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00e2b215-a6e9-4e33-8d11-a81daa2cb999 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:02.621883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00e2b215-a6e9-4e33-8d11-a81daa2cb999 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:02.622315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00e2b215-a6e9-4e33-8d11-a81daa2cb999 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:02.651187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-00e2b215-a6e9-4e33-8d11-a81daa2cb999 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042337 Jun 02 19:08:02.651768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 443/900] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:03.267338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3779520f-5a4c-41ae-97ae-b43742ea12a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:03.268283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3779520f-5a4c-41ae-97ae-b43742ea12a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:03.275353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3779520f-5a4c-41ae-97ae-b43742ea12a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:03.275808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3779520f-5a4c-41ae-97ae-b43742ea12a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:03.276639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3779520f-5a4c-41ae-97ae-b43742ea12a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:03.277077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3779520f-5a4c-41ae-97ae-b43742ea12a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:03.306476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3779520f-5a4c-41ae-97ae-b43742ea12a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043469 Jun 02 19:08:03.307019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 458/901] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:03.325454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-35f7fede-db2a-43c7-81a1-5301f1ea2fd0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:03.326117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-35f7fede-db2a-43c7-81a1-5301f1ea2fd0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:03.336651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35f7fede-db2a-43c7-81a1-5301f1ea2fd0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:03.337261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35f7fede-db2a-43c7-81a1-5301f1ea2fd0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:03.338316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35f7fede-db2a-43c7-81a1-5301f1ea2fd0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:03.338943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35f7fede-db2a-43c7-81a1-5301f1ea2fd0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:03.412058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-35f7fede-db2a-43c7-81a1-5301f1ea2fd0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:03.420123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-35f7fede-db2a-43c7-81a1-5301f1ea2fd0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.101174 Jun 02 19:08:03.420691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 444/902] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:03 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:03.667051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d58b2f79-f00a-4a8a-b3d4-20cb7e19e20f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:03.668552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d58b2f79-f00a-4a8a-b3d4-20cb7e19e20f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:03.676600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d58b2f79-f00a-4a8a-b3d4-20cb7e19e20f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:03.677052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d58b2f79-f00a-4a8a-b3d4-20cb7e19e20f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:03.677827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d58b2f79-f00a-4a8a-b3d4-20cb7e19e20f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:03.678293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d58b2f79-f00a-4a8a-b3d4-20cb7e19e20f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:03.709707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d58b2f79-f00a-4a8a-b3d4-20cb7e19e20f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048754 Jun 02 19:08:03.710311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 459/903] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:04.323008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3cb7445a-c098-4aa0-894e-3152503ae1d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:04.324306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3cb7445a-c098-4aa0-894e-3152503ae1d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:04.333109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cb7445a-c098-4aa0-894e-3152503ae1d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:04.333753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cb7445a-c098-4aa0-894e-3152503ae1d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:04.334309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cb7445a-c098-4aa0-894e-3152503ae1d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:04.335498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cb7445a-c098-4aa0-894e-3152503ae1d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:04.368531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3cb7445a-c098-4aa0-894e-3152503ae1d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052243 Jun 02 19:08:04.369098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 445/904] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:04.441045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78f2f978-1dd4-4e29-8169-ce87e1ec1422 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:04.441669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78f2f978-1dd4-4e29-8169-ce87e1ec1422 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:04.451864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78f2f978-1dd4-4e29-8169-ce87e1ec1422 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:04.452546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78f2f978-1dd4-4e29-8169-ce87e1ec1422 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:04.453635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78f2f978-1dd4-4e29-8169-ce87e1ec1422 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:04.454243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78f2f978-1dd4-4e29-8169-ce87e1ec1422 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:04.519697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-78f2f978-1dd4-4e29-8169-ce87e1ec1422 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:04.530216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78f2f978-1dd4-4e29-8169-ce87e1ec1422 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095203 Jun 02 19:08:04.530886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 460/905] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:04 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:04.724536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3e22c052-26d6-4caa-b02a-ddfb2eaaf105 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:04.725491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3e22c052-26d6-4caa-b02a-ddfb2eaaf105 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:04.732036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e22c052-26d6-4caa-b02a-ddfb2eaaf105 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:04.732487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e22c052-26d6-4caa-b02a-ddfb2eaaf105 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:04.733249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e22c052-26d6-4caa-b02a-ddfb2eaaf105 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:04.733671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e22c052-26d6-4caa-b02a-ddfb2eaaf105 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:04.765220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3e22c052-26d6-4caa-b02a-ddfb2eaaf105 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Jun 02 19:08:04.765753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 446/906] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:05.381585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-45f508cd-aaf3-457e-b934-e1976a780213 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:05.382561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-45f508cd-aaf3-457e-b934-e1976a780213 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:05.384797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:08:05.384950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments (ip 10.222.0.15) !!! Jun 02 19:08:05.389753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45f508cd-aaf3-457e-b934-e1976a780213 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:05.390218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45f508cd-aaf3-457e-b934-e1976a780213 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:05.390993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45f508cd-aaf3-457e-b934-e1976a780213 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:05.391434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45f508cd-aaf3-457e-b934-e1976a780213 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:05.423375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-45f508cd-aaf3-457e-b934-e1976a780213 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046083 Jun 02 19:08:05.423960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 461/907] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:05.548066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9f740395-d786-4260-86c2-7ebe77a917f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:05.548669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9f740395-d786-4260-86c2-7ebe77a917f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:05.556510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f740395-d786-4260-86c2-7ebe77a917f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:05.556958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f740395-d786-4260-86c2-7ebe77a917f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:05.557733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f740395-d786-4260-86c2-7ebe77a917f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:05.558190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f740395-d786-4260-86c2-7ebe77a917f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:05.624510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9f740395-d786-4260-86c2-7ebe77a917f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:05.635495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9f740395-d786-4260-86c2-7ebe77a917f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091017 Jun 02 19:08:05.636129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 447/908] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:05 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:05.780513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b2a2dcb5-f840-4843-bf4c-54b3c91d3ae9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:05.781483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b2a2dcb5-f840-4843-bf4c-54b3c91d3ae9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:05.788661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2a2dcb5-f840-4843-bf4c-54b3c91d3ae9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:05.789119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2a2dcb5-f840-4843-bf4c-54b3c91d3ae9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:05.789927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2a2dcb5-f840-4843-bf4c-54b3c91d3ae9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:05.790413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2a2dcb5-f840-4843-bf4c-54b3c91d3ae9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:05.820516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b2a2dcb5-f840-4843-bf4c-54b3c91d3ae9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Jun 02 19:08:05.821429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 462/909] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:06.438993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-87a2c674-08e7-4cdc-b0f2-fa28b7a4c822 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:06.440400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-87a2c674-08e7-4cdc-b0f2-fa28b7a4c822 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:06.450195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87a2c674-08e7-4cdc-b0f2-fa28b7a4c822 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:06.450841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87a2c674-08e7-4cdc-b0f2-fa28b7a4c822 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:06.452008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87a2c674-08e7-4cdc-b0f2-fa28b7a4c822 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:06.452571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87a2c674-08e7-4cdc-b0f2-fa28b7a4c822 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:06.495106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-87a2c674-08e7-4cdc-b0f2-fa28b7a4c822 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062111 Jun 02 19:08:06.495953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 448/910] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:06.657161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7feba16b-914c-482f-a7a7-ccc7b9971e61 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:06.658052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7feba16b-914c-482f-a7a7-ccc7b9971e61 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:06.668036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7feba16b-914c-482f-a7a7-ccc7b9971e61 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:06.668689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7feba16b-914c-482f-a7a7-ccc7b9971e61 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:06.669613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7feba16b-914c-482f-a7a7-ccc7b9971e61 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:06.670280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7feba16b-914c-482f-a7a7-ccc7b9971e61 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:06.735682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7feba16b-914c-482f-a7a7-ccc7b9971e61 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:06.744040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7feba16b-914c-482f-a7a7-ccc7b9971e61 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093151 Jun 02 19:08:06.744606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 463/911] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:06 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:06.833109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0fb93bd4-14d5-4c4f-8cd9-79e4062546a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:06.834091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0fb93bd4-14d5-4c4f-8cd9-79e4062546a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:06.841020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0fb93bd4-14d5-4c4f-8cd9-79e4062546a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:06.841472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0fb93bd4-14d5-4c4f-8cd9-79e4062546a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:06.842268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0fb93bd4-14d5-4c4f-8cd9-79e4062546a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:06.842679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0fb93bd4-14d5-4c4f-8cd9-79e4062546a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:06.872093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0fb93bd4-14d5-4c4f-8cd9-79e4062546a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Jun 02 19:08:06.872656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 449/912] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:07.507857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-36c15549-d024-46ca-9333-aacfaf8bdd80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:07.508801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-36c15549-d024-46ca-9333-aacfaf8bdd80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:07.515987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36c15549-d024-46ca-9333-aacfaf8bdd80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:07.516448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36c15549-d024-46ca-9333-aacfaf8bdd80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:07.517221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36c15549-d024-46ca-9333-aacfaf8bdd80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:07.517664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36c15549-d024-46ca-9333-aacfaf8bdd80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:07.549447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-36c15549-d024-46ca-9333-aacfaf8bdd80 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045527 Jun 02 19:08:07.550023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 464/913] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:07.761857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-df6a194a-c472-4d0a-a721-821eed400834 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:07.762361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-df6a194a-c472-4d0a-a721-821eed400834 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:07.769552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df6a194a-c472-4d0a-a721-821eed400834 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:07.770030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df6a194a-c472-4d0a-a721-821eed400834 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:07.770789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df6a194a-c472-4d0a-a721-821eed400834 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:07.771220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df6a194a-c472-4d0a-a721-821eed400834 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:07.840601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-df6a194a-c472-4d0a-a721-821eed400834 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:07.848165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-df6a194a-c472-4d0a-a721-821eed400834 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090628 Jun 02 19:08:07.849025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 450/914] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:07 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:07.885654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cab96baf-078e-4431-a416-e28810032e40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:07.886620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cab96baf-078e-4431-a416-e28810032e40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:07.893095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cab96baf-078e-4431-a416-e28810032e40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:07.893678 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cab96baf-078e-4431-a416-e28810032e40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:07.894543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cab96baf-078e-4431-a416-e28810032e40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:07.895022 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cab96baf-078e-4431-a416-e28810032e40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:07.924885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cab96baf-078e-4431-a416-e28810032e40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Jun 02 19:08:07.925700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 465/915] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:08:08.566501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0c42c7b4-7bb6-40fb-afcf-da747ef04a76 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:08.567497 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0c42c7b4-7bb6-40fb-afcf-da747ef04a76 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:08.574348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c42c7b4-7bb6-40fb-afcf-da747ef04a76 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:08.574771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c42c7b4-7bb6-40fb-afcf-da747ef04a76 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:08.575550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c42c7b4-7bb6-40fb-afcf-da747ef04a76 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:08.575985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c42c7b4-7bb6-40fb-afcf-da747ef04a76 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:08.606339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0c42c7b4-7bb6-40fb-afcf-da747ef04a76 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046378 Jun 02 19:08:08.606893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 451/916] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:08.865703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-baac3748-4766-4ae9-bee3-11a485fc0e1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:08.866310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-baac3748-4766-4ae9-bee3-11a485fc0e1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:08.873209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-baac3748-4766-4ae9-bee3-11a485fc0e1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:08.873683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-baac3748-4766-4ae9-bee3-11a485fc0e1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:08.874493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-baac3748-4766-4ae9-bee3-11a485fc0e1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:08.874864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-baac3748-4766-4ae9-bee3-11a485fc0e1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:08.890498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:08.936886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-73512c07-f89d-47fa-b965-d644367293a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:08.937863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-73512c07-f89d-47fa-b965-d644367293a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:08.943832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-baac3748-4766-4ae9-bee3-11a485fc0e1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:08.946020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73512c07-f89d-47fa-b965-d644367293a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:08.946622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73512c07-f89d-47fa-b965-d644367293a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:08.947394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73512c07-f89d-47fa-b965-d644367293a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:08.947849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73512c07-f89d-47fa-b965-d644367293a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:08.951874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-baac3748-4766-4ae9-bee3-11a485fc0e1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090671 Jun 02 19:08:08.961177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 466/917] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:08 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:08.978720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-73512c07-f89d-47fa-b965-d644367293a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045759 Jun 02 19:08:08.979251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 452/918] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:09.619573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-49d173bf-90c2-4712-9e24-4f4b892dd356 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:09.620539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-49d173bf-90c2-4712-9e24-4f4b892dd356 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:09.627073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-49d173bf-90c2-4712-9e24-4f4b892dd356 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:09.627528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-49d173bf-90c2-4712-9e24-4f4b892dd356 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:09.628296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-49d173bf-90c2-4712-9e24-4f4b892dd356 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:09.628739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-49d173bf-90c2-4712-9e24-4f4b892dd356 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:09.660247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-49d173bf-90c2-4712-9e24-4f4b892dd356 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044874 Jun 02 19:08:09.660903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 467/919] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:09.909058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:08:09.909284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:08:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:08:09.971052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-23210d5b-a955-437d-8444-776e2815feb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:09.971719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-23210d5b-a955-437d-8444-776e2815feb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:09.979345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23210d5b-a955-437d-8444-776e2815feb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:09.979791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23210d5b-a955-437d-8444-776e2815feb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:09.980540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23210d5b-a955-437d-8444-776e2815feb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:09.980962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23210d5b-a955-437d-8444-776e2815feb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:09.990723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dd5f94e4-0bb1-4f41-abda-cecd8d817fde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:09.991632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dd5f94e4-0bb1-4f41-abda-cecd8d817fde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:09.999046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd5f94e4-0bb1-4f41-abda-cecd8d817fde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:09.999979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd5f94e4-0bb1-4f41-abda-cecd8d817fde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:10.000291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd5f94e4-0bb1-4f41-abda-cecd8d817fde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:10.000720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd5f94e4-0bb1-4f41-abda-cecd8d817fde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:10.031279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dd5f94e4-0bb1-4f41-abda-cecd8d817fde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Jun 02 19:08:10.031924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 468/920] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:10.045109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-23210d5b-a955-437d-8444-776e2815feb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:10.055530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-23210d5b-a955-437d-8444-776e2815feb8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090347 Jun 02 19:08:10.056091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 453/921] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:09 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:10.672734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ac3e4d4b-b2e2-4604-aad2-18538786fdd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:10.673668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ac3e4d4b-b2e2-4604-aad2-18538786fdd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:10.680213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac3e4d4b-b2e2-4604-aad2-18538786fdd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:10.680658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac3e4d4b-b2e2-4604-aad2-18538786fdd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:10.681420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac3e4d4b-b2e2-4604-aad2-18538786fdd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:10.681882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac3e4d4b-b2e2-4604-aad2-18538786fdd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:10.713264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ac3e4d4b-b2e2-4604-aad2-18538786fdd4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044163 Jun 02 19:08:10.714037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 469/922] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:11.043806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-37afd42d-bf7b-4b8a-9c5d-c8e39889c1dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:11.044732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-37afd42d-bf7b-4b8a-9c5d-c8e39889c1dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:11.051539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37afd42d-bf7b-4b8a-9c5d-c8e39889c1dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:11.051992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37afd42d-bf7b-4b8a-9c5d-c8e39889c1dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:11.052761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37afd42d-bf7b-4b8a-9c5d-c8e39889c1dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:11.053247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37afd42d-bf7b-4b8a-9c5d-c8e39889c1dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:11.056181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:11.072680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-11f0b67e-606f-4e6e-9d3f-f3d74e752016 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:11.073300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-11f0b67e-606f-4e6e-9d3f-f3d74e752016 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:11.080063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11f0b67e-606f-4e6e-9d3f-f3d74e752016 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:11.080763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11f0b67e-606f-4e6e-9d3f-f3d74e752016 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:11.081554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11f0b67e-606f-4e6e-9d3f-f3d74e752016 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:11.082158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11f0b67e-606f-4e6e-9d3f-f3d74e752016 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:11.085001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-37afd42d-bf7b-4b8a-9c5d-c8e39889c1dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045541 Jun 02 19:08:11.085584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 454/923] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:11.147897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-11f0b67e-606f-4e6e-9d3f-f3d74e752016 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:11.159125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-11f0b67e-606f-4e6e-9d3f-f3d74e752016 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090364 Jun 02 19:08:11.159838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 470/924] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:11 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:11.727038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92999c13-3dc9-4924-83c7-3f8c6161956b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:11.728077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92999c13-3dc9-4924-83c7-3f8c6161956b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:11.730235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=84 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:11.736379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92999c13-3dc9-4924-83c7-3f8c6161956b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:11.736882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92999c13-3dc9-4924-83c7-3f8c6161956b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:11.737727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92999c13-3dc9-4924-83c7-3f8c6161956b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:11.738245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92999c13-3dc9-4924-83c7-3f8c6161956b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:11.771599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92999c13-3dc9-4924-83c7-3f8c6161956b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049057 Jun 02 19:08:11.772925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 455/925] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:12.096968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b4ac087b-65f4-4824-bd4c-ccfb3b8e255f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:12.097946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b4ac087b-65f4-4824-bd4c-ccfb3b8e255f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:12.105048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4ac087b-65f4-4824-bd4c-ccfb3b8e255f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:12.105504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4ac087b-65f4-4824-bd4c-ccfb3b8e255f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:12.106303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4ac087b-65f4-4824-bd4c-ccfb3b8e255f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:12.106746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4ac087b-65f4-4824-bd4c-ccfb3b8e255f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:12.136400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b4ac087b-65f4-4824-bd4c-ccfb3b8e255f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Jun 02 19:08:12.136957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 471/926] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:12.177240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5937ade1-0c88-4674-8953-afd9a35d7080 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:12.177858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5937ade1-0c88-4674-8953-afd9a35d7080 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:12.184849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5937ade1-0c88-4674-8953-afd9a35d7080 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:12.185295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5937ade1-0c88-4674-8953-afd9a35d7080 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:12.186072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5937ade1-0c88-4674-8953-afd9a35d7080 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:12.186500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5937ade1-0c88-4674-8953-afd9a35d7080 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:12.264104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5937ade1-0c88-4674-8953-afd9a35d7080 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:12.275537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5937ade1-0c88-4674-8953-afd9a35d7080 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102247 Jun 02 19:08:12.276090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 456/927] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:12 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:12.789175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b8d2e038-c9c7-4472-b57f-906cb2c78e01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:12.790794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b8d2e038-c9c7-4472-b57f-906cb2c78e01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:12.798705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b8d2e038-c9c7-4472-b57f-906cb2c78e01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:12.799162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b8d2e038-c9c7-4472-b57f-906cb2c78e01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:12.799970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b8d2e038-c9c7-4472-b57f-906cb2c78e01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:12.800388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b8d2e038-c9c7-4472-b57f-906cb2c78e01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:12.838075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b8d2e038-c9c7-4472-b57f-906cb2c78e01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055951 Jun 02 19:08:12.838652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 472/928] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:13.154920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-04bc89df-d3ec-4e2b-94f7-a875f3dc25e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:13.157025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-04bc89df-d3ec-4e2b-94f7-a875f3dc25e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:13.165386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04bc89df-d3ec-4e2b-94f7-a875f3dc25e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:13.166083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04bc89df-d3ec-4e2b-94f7-a875f3dc25e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:13.166862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04bc89df-d3ec-4e2b-94f7-a875f3dc25e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:13.167292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04bc89df-d3ec-4e2b-94f7-a875f3dc25e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:13.202259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-04bc89df-d3ec-4e2b-94f7-a875f3dc25e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054234 Jun 02 19:08:13.203077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 457/929] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:13.294900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e8805888-77b5-4c45-abae-c5a2d4be1b9c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:13.295542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e8805888-77b5-4c45-abae-c5a2d4be1b9c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:13.298137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=86 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:13.306222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8805888-77b5-4c45-abae-c5a2d4be1b9c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:13.306682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8805888-77b5-4c45-abae-c5a2d4be1b9c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:13.307686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8805888-77b5-4c45-abae-c5a2d4be1b9c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:13.307908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8805888-77b5-4c45-abae-c5a2d4be1b9c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:13.388418 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8805888-77b5-4c45-abae-c5a2d4be1b9c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:13.397721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e8805888-77b5-4c45-abae-c5a2d4be1b9c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.107689 Jun 02 19:08:13.398678 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 473/930] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:13 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:13.850873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f968ee74-d4dc-4be8-8217-8527320f7aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:13.851712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f968ee74-d4dc-4be8-8217-8527320f7aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:13.858945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f968ee74-d4dc-4be8-8217-8527320f7aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:13.859389 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f968ee74-d4dc-4be8-8217-8527320f7aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:13.860142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f968ee74-d4dc-4be8-8217-8527320f7aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:13.860571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f968ee74-d4dc-4be8-8217-8527320f7aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:13.890211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f968ee74-d4dc-4be8-8217-8527320f7aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043627 Jun 02 19:08:13.890787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 458/931] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:14.218324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-71ae7938-9d38-4eb5-9fa1-d69925e358a2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:14.219683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-71ae7938-9d38-4eb5-9fa1-d69925e358a2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:14.228467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71ae7938-9d38-4eb5-9fa1-d69925e358a2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:14.228921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71ae7938-9d38-4eb5-9fa1-d69925e358a2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:14.229691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71ae7938-9d38-4eb5-9fa1-d69925e358a2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:14.230176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71ae7938-9d38-4eb5-9fa1-d69925e358a2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:14.259060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-71ae7938-9d38-4eb5-9fa1-d69925e358a2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Jun 02 19:08:14.259600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 474/932] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:14.417067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2ee82d85-034c-457f-8d73-856d7e292d3a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:14.417677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2ee82d85-034c-457f-8d73-856d7e292d3a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:14.424575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2ee82d85-034c-457f-8d73-856d7e292d3a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:14.425024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2ee82d85-034c-457f-8d73-856d7e292d3a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:14.425779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2ee82d85-034c-457f-8d73-856d7e292d3a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:14.426239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2ee82d85-034c-457f-8d73-856d7e292d3a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:14.493446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2ee82d85-034c-457f-8d73-856d7e292d3a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:14.502048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2ee82d85-034c-457f-8d73-856d7e292d3a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089118 Jun 02 19:08:14.502590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 459/933] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:14 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:14.906487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0edb6c8c-7766-4b5b-865b-b34a384a5811 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:14.908179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0edb6c8c-7766-4b5b-865b-b34a384a5811 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:14.917965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0edb6c8c-7766-4b5b-865b-b34a384a5811 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:14.918429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0edb6c8c-7766-4b5b-865b-b34a384a5811 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:14.919195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0edb6c8c-7766-4b5b-865b-b34a384a5811 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:14.919635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0edb6c8c-7766-4b5b-865b-b34a384a5811 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:14.957236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0edb6c8c-7766-4b5b-865b-b34a384a5811 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057965 Jun 02 19:08:14.957827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 475/934] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:15.221631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:08:15.221966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:08:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:08:15.273830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-49478129-00c9-43de-9efe-a11e769fced5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:15.275095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-49478129-00c9-43de-9efe-a11e769fced5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:15.282102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49478129-00c9-43de-9efe-a11e769fced5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:15.282556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49478129-00c9-43de-9efe-a11e769fced5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:15.283312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49478129-00c9-43de-9efe-a11e769fced5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:15.283749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49478129-00c9-43de-9efe-a11e769fced5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:15.312902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-49478129-00c9-43de-9efe-a11e769fced5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Jun 02 19:08:15.313546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 460/935] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:15.523349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-16dd7b62-ed73-4e3c-a585-59a84e4f745b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:15.524112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-16dd7b62-ed73-4e3c-a585-59a84e4f745b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:15.531712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16dd7b62-ed73-4e3c-a585-59a84e4f745b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:15.532174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16dd7b62-ed73-4e3c-a585-59a84e4f745b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:15.532979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16dd7b62-ed73-4e3c-a585-59a84e4f745b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:15.533375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16dd7b62-ed73-4e3c-a585-59a84e4f745b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:15.608159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-16dd7b62-ed73-4e3c-a585-59a84e4f745b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:15.616302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-16dd7b62-ed73-4e3c-a585-59a84e4f745b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.099767 Jun 02 19:08:15.616902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 476/936] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:15 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:15.971446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-055da16f-85df-42f3-b384-f3158ce581d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:15.972595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-055da16f-85df-42f3-b384-f3158ce581d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:15.984684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-055da16f-85df-42f3-b384-f3158ce581d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:15.985347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-055da16f-85df-42f3-b384-f3158ce581d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:15.986365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-055da16f-85df-42f3-b384-f3158ce581d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:15.987224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-055da16f-85df-42f3-b384-f3158ce581d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:16.022331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-055da16f-85df-42f3-b384-f3158ce581d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056154 Jun 02 19:08:16.022884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 461/937] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:16.328181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c353e039-54e5-4225-ab7d-0437a7de8eea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:16.329603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c353e039-54e5-4225-ab7d-0437a7de8eea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:16.339348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c353e039-54e5-4225-ab7d-0437a7de8eea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:16.339795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c353e039-54e5-4225-ab7d-0437a7de8eea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:16.340608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c353e039-54e5-4225-ab7d-0437a7de8eea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:16.341072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c353e039-54e5-4225-ab7d-0437a7de8eea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:16.383588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c353e039-54e5-4225-ab7d-0437a7de8eea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061539 Jun 02 19:08:16.384274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 477/938] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:16.637250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e681edcc-6873-4855-98b8-4484d0c09d34 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:16.638283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e681edcc-6873-4855-98b8-4484d0c09d34 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:16.645027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e681edcc-6873-4855-98b8-4484d0c09d34 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:16.645481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e681edcc-6873-4855-98b8-4484d0c09d34 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:16.646282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e681edcc-6873-4855-98b8-4484d0c09d34 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:16.646713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e681edcc-6873-4855-98b8-4484d0c09d34 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:16.719177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e681edcc-6873-4855-98b8-4484d0c09d34 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:16.727269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e681edcc-6873-4855-98b8-4484d0c09d34 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.096990 Jun 02 19:08:16.727837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 462/939] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:16 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:17.038810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c3835a7a-de20-4503-9531-0c8d9e768a48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:17.040147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c3835a7a-de20-4503-9531-0c8d9e768a48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:17.048347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c3835a7a-de20-4503-9531-0c8d9e768a48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:17.048799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c3835a7a-de20-4503-9531-0c8d9e768a48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:17.049707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c3835a7a-de20-4503-9531-0c8d9e768a48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:17.050423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c3835a7a-de20-4503-9531-0c8d9e768a48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:17.080818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c3835a7a-de20-4503-9531-0c8d9e768a48 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049049 Jun 02 19:08:17.081383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 478/940] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:17.397496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e0c9a9c4-538c-4d4e-9161-5a4a9733571c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:17.402895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e0c9a9c4-538c-4d4e-9161-5a4a9733571c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:17.411134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0c9a9c4-538c-4d4e-9161-5a4a9733571c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:17.411826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0c9a9c4-538c-4d4e-9161-5a4a9733571c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:17.412904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0c9a9c4-538c-4d4e-9161-5a4a9733571c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:17.413471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0c9a9c4-538c-4d4e-9161-5a4a9733571c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:17.444383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e0c9a9c4-538c-4d4e-9161-5a4a9733571c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051232 Jun 02 19:08:17.444936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 463/941] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:17.746991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-657bddcc-5207-45da-be1f-25f91f815e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:17.747682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-657bddcc-5207-45da-be1f-25f91f815e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:17.757526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-657bddcc-5207-45da-be1f-25f91f815e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:17.758179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-657bddcc-5207-45da-be1f-25f91f815e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:17.759394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-657bddcc-5207-45da-be1f-25f91f815e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:17.760054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-657bddcc-5207-45da-be1f-25f91f815e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:17.827923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-657bddcc-5207-45da-be1f-25f91f815e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:17.840004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-657bddcc-5207-45da-be1f-25f91f815e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098739 Jun 02 19:08:17.840937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 479/942] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:17 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:18.093709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3ca8e037-ad1e-4122-a11a-182f05e38aa9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:18.094524 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ca8e037-ad1e-4122-a11a-182f05e38aa9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:18.101072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ca8e037-ad1e-4122-a11a-182f05e38aa9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:18.101515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ca8e037-ad1e-4122-a11a-182f05e38aa9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:18.102301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ca8e037-ad1e-4122-a11a-182f05e38aa9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:18.102727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ca8e037-ad1e-4122-a11a-182f05e38aa9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:18.132305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3ca8e037-ad1e-4122-a11a-182f05e38aa9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043020 Jun 02 19:08:18.132877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 464/943] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:18.456970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2e274ce1-59ce-4990-b2a7-c08d0393cefe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:18.457955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2e274ce1-59ce-4990-b2a7-c08d0393cefe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:18.464774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e274ce1-59ce-4990-b2a7-c08d0393cefe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:18.465286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e274ce1-59ce-4990-b2a7-c08d0393cefe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:18.466112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e274ce1-59ce-4990-b2a7-c08d0393cefe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:18.466545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e274ce1-59ce-4990-b2a7-c08d0393cefe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:18.497100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2e274ce1-59ce-4990-b2a7-c08d0393cefe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Jun 02 19:08:18.497622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 480/944] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:18.866595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4d060d66-86af-4247-941f-edb3f0e7ead4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:18.867437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4d060d66-86af-4247-941f-edb3f0e7ead4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:18.877838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d060d66-86af-4247-941f-edb3f0e7ead4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:18.878286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d060d66-86af-4247-941f-edb3f0e7ead4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:18.879063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d060d66-86af-4247-941f-edb3f0e7ead4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:18.879476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d060d66-86af-4247-941f-edb3f0e7ead4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:18.944432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4d060d66-86af-4247-941f-edb3f0e7ead4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:18.952470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4d060d66-86af-4247-941f-edb3f0e7ead4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092582 Jun 02 19:08:18.953036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 465/945] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:18 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:19.146131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6bcf22de-b64f-4dc1-9523-bebc456ebe3b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:19.147257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6bcf22de-b64f-4dc1-9523-bebc456ebe3b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:19.156726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcf22de-b64f-4dc1-9523-bebc456ebe3b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:19.157377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcf22de-b64f-4dc1-9523-bebc456ebe3b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:19.158354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcf22de-b64f-4dc1-9523-bebc456ebe3b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:19.159008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcf22de-b64f-4dc1-9523-bebc456ebe3b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:19.194358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6bcf22de-b64f-4dc1-9523-bebc456ebe3b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053448 Jun 02 19:08:19.194903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 481/946] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:19.512013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-77c8c4e0-af31-4ee8-837a-36f3509b1d11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:19.512827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-77c8c4e0-af31-4ee8-837a-36f3509b1d11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:19.519935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77c8c4e0-af31-4ee8-837a-36f3509b1d11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:19.520386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77c8c4e0-af31-4ee8-837a-36f3509b1d11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:19.521182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77c8c4e0-af31-4ee8-837a-36f3509b1d11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:19.521614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77c8c4e0-af31-4ee8-837a-36f3509b1d11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:19.552470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-77c8c4e0-af31-4ee8-837a-36f3509b1d11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046497 Jun 02 19:08:19.553030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 466/947] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:19.969020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d905e65a-c0ce-4243-bafe-5af98934b711 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:19.969642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d905e65a-c0ce-4243-bafe-5af98934b711 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:19.976290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d905e65a-c0ce-4243-bafe-5af98934b711 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:19.976745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d905e65a-c0ce-4243-bafe-5af98934b711 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:19.977516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d905e65a-c0ce-4243-bafe-5af98934b711 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:19.977982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d905e65a-c0ce-4243-bafe-5af98934b711 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:20.044846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d905e65a-c0ce-4243-bafe-5af98934b711 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:20.053576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d905e65a-c0ce-4243-bafe-5af98934b711 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088527 Jun 02 19:08:20.054220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 482/948] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:19 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:20.208410 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5e363a21-55cd-4109-87f7-b3bf510b2559 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:20.209327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5e363a21-55cd-4109-87f7-b3bf510b2559 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:20.216533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e363a21-55cd-4109-87f7-b3bf510b2559 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:20.216974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e363a21-55cd-4109-87f7-b3bf510b2559 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:20.217722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e363a21-55cd-4109-87f7-b3bf510b2559 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:20.218180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e363a21-55cd-4109-87f7-b3bf510b2559 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:20.249896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5e363a21-55cd-4109-87f7-b3bf510b2559 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045543 Jun 02 19:08:20.250452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 467/949] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:20.565768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-42512e49-6253-4ed4-a333-85ec7add754f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:20.566748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-42512e49-6253-4ed4-a333-85ec7add754f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:20.574151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42512e49-6253-4ed4-a333-85ec7add754f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:20.574605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42512e49-6253-4ed4-a333-85ec7add754f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:20.575369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42512e49-6253-4ed4-a333-85ec7add754f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:20.575803 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42512e49-6253-4ed4-a333-85ec7add754f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:20.578220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:20.605974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-42512e49-6253-4ed4-a333-85ec7add754f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 Jun 02 19:08:20.606536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 483/950] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:21.073687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-96b5f245-8f69-4a79-ad81-ada15ca812d0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:21.074438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-96b5f245-8f69-4a79-ad81-ada15ca812d0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:21.083374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96b5f245-8f69-4a79-ad81-ada15ca812d0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:21.083872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96b5f245-8f69-4a79-ad81-ada15ca812d0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:21.085218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96b5f245-8f69-4a79-ad81-ada15ca812d0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:21.086045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96b5f245-8f69-4a79-ad81-ada15ca812d0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:21.154778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-96b5f245-8f69-4a79-ad81-ada15ca812d0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:21.162809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-96b5f245-8f69-4a79-ad81-ada15ca812d0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094386 Jun 02 19:08:21.163517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 468/951] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:21 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:21.262829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fa2da922-3306-4784-8eba-7cd568f901b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:21.263833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fa2da922-3306-4784-8eba-7cd568f901b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:21.270393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa2da922-3306-4784-8eba-7cd568f901b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:21.270874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa2da922-3306-4784-8eba-7cd568f901b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:21.271859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa2da922-3306-4784-8eba-7cd568f901b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:21.273119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa2da922-3306-4784-8eba-7cd568f901b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:21.303141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fa2da922-3306-4784-8eba-7cd568f901b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044581 Jun 02 19:08:21.303714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 484/952] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 19:08:21.621746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7292fa18-93db-45e8-a731-e961bb383252 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:21.623110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7292fa18-93db-45e8-a731-e961bb383252 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:21.633371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7292fa18-93db-45e8-a731-e961bb383252 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:21.634109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7292fa18-93db-45e8-a731-e961bb383252 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:21.635209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7292fa18-93db-45e8-a731-e961bb383252 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:21.635849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7292fa18-93db-45e8-a731-e961bb383252 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:21.667924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7292fa18-93db-45e8-a731-e961bb383252 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051957 Jun 02 19:08:21.668396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 469/953] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:22.181738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9a52790c-5df3-43b1-b123-a7432f732a76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:22.182384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9a52790c-5df3-43b1-b123-a7432f732a76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:22.190132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a52790c-5df3-43b1-b123-a7432f732a76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:22.190643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a52790c-5df3-43b1-b123-a7432f732a76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:22.191463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a52790c-5df3-43b1-b123-a7432f732a76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:22.191911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a52790c-5df3-43b1-b123-a7432f732a76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:22.255299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9a52790c-5df3-43b1-b123-a7432f732a76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:22.263571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9a52790c-5df3-43b1-b123-a7432f732a76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086732 Jun 02 19:08:22.264614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 485/954] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:22 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:22.318519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6a3fbeb9-c16f-4ad6-bf19-63bd7d30bc1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:22.319649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6a3fbeb9-c16f-4ad6-bf19-63bd7d30bc1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:22.328893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a3fbeb9-c16f-4ad6-bf19-63bd7d30bc1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:22.329503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a3fbeb9-c16f-4ad6-bf19-63bd7d30bc1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:22.330634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a3fbeb9-c16f-4ad6-bf19-63bd7d30bc1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:22.331378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a3fbeb9-c16f-4ad6-bf19-63bd7d30bc1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:22.365263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:22.371686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6a3fbeb9-c16f-4ad6-bf19-63bd7d30bc1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059546 Jun 02 19:08:22.372261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 470/955] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:22.680977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-922ff4c2-b003-4b1f-9e4e-4553fb1fff29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:22.682122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-922ff4c2-b003-4b1f-9e4e-4553fb1fff29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:22.689189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-922ff4c2-b003-4b1f-9e4e-4553fb1fff29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:22.689661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-922ff4c2-b003-4b1f-9e4e-4553fb1fff29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:22.690498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-922ff4c2-b003-4b1f-9e4e-4553fb1fff29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:22.691157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-922ff4c2-b003-4b1f-9e4e-4553fb1fff29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:22.720803 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-922ff4c2-b003-4b1f-9e4e-4553fb1fff29 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Jun 02 19:08:22.721327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 486/956] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:23.282005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-341c9313-d340-45f9-891f-42b28bdb0a73 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:23.282583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-341c9313-d340-45f9-891f-42b28bdb0a73 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:23.290837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-341c9313-d340-45f9-891f-42b28bdb0a73 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:23.291286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-341c9313-d340-45f9-891f-42b28bdb0a73 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:23.292049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-341c9313-d340-45f9-891f-42b28bdb0a73 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:23.292481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-341c9313-d340-45f9-891f-42b28bdb0a73 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:23.357539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-341c9313-d340-45f9-891f-42b28bdb0a73 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:23.365272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-341c9313-d340-45f9-891f-42b28bdb0a73 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087195 Jun 02 19:08:23.365762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 471/957] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:23 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:23.382899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-58c2ab4f-1019-450d-b077-62f8df5e7eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:23.383861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-58c2ab4f-1019-450d-b077-62f8df5e7eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:23.390533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58c2ab4f-1019-450d-b077-62f8df5e7eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:23.390983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58c2ab4f-1019-450d-b077-62f8df5e7eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:23.391723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58c2ab4f-1019-450d-b077-62f8df5e7eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:23.392159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58c2ab4f-1019-450d-b077-62f8df5e7eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:23.421979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-58c2ab4f-1019-450d-b077-62f8df5e7eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043083 Jun 02 19:08:23.422514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 487/958] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:23.738752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a4cf59ad-472e-4ae0-ba31-9394472fb46f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:23.739973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a4cf59ad-472e-4ae0-ba31-9394472fb46f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:23.746502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4cf59ad-472e-4ae0-ba31-9394472fb46f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:23.746941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4cf59ad-472e-4ae0-ba31-9394472fb46f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:23.747696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4cf59ad-472e-4ae0-ba31-9394472fb46f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:23.748118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4cf59ad-472e-4ae0-ba31-9394472fb46f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:23.777805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a4cf59ad-472e-4ae0-ba31-9394472fb46f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 Jun 02 19:08:23.778381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 472/959] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:24.382513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-53946f6e-bd55-4e90-a9e4-27cf6b7b30c4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:24.383126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-53946f6e-bd55-4e90-a9e4-27cf6b7b30c4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:24.390205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53946f6e-bd55-4e90-a9e4-27cf6b7b30c4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:24.390795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53946f6e-bd55-4e90-a9e4-27cf6b7b30c4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:24.391592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53946f6e-bd55-4e90-a9e4-27cf6b7b30c4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:24.392312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53946f6e-bd55-4e90-a9e4-27cf6b7b30c4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:24.440153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b80dcd21-c818-421b-b417-8f6cf448d9ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:24.441508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b80dcd21-c818-421b-b417-8f6cf448d9ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:24.449393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b80dcd21-c818-421b-b417-8f6cf448d9ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:24.449814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b80dcd21-c818-421b-b417-8f6cf448d9ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:24.450630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b80dcd21-c818-421b-b417-8f6cf448d9ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:24.451046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b80dcd21-c818-421b-b417-8f6cf448d9ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:24.460962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-53946f6e-bd55-4e90-a9e4-27cf6b7b30c4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:24.471714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-53946f6e-bd55-4e90-a9e4-27cf6b7b30c4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093064 Jun 02 19:08:24.472677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 488/960] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:24 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:24.491324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b80dcd21-c818-421b-b417-8f6cf448d9ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058549 Jun 02 19:08:24.491879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 473/961] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:24.792176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7c74fde5-f336-4991-b43e-16fac3eaab30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:24.793444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7c74fde5-f336-4991-b43e-16fac3eaab30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:24.802181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c74fde5-f336-4991-b43e-16fac3eaab30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:24.802826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c74fde5-f336-4991-b43e-16fac3eaab30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:24.803863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c74fde5-f336-4991-b43e-16fac3eaab30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:24.804445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c74fde5-f336-4991-b43e-16fac3eaab30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:24.838679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7c74fde5-f336-4991-b43e-16fac3eaab30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052722 Jun 02 19:08:24.839241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 489/962] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:25.494314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6c791be7-1f9e-4967-b2b7-a0184939bb4f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:25.494896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6c791be7-1f9e-4967-b2b7-a0184939bb4f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:25.501628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c791be7-1f9e-4967-b2b7-a0184939bb4f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:25.502108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c791be7-1f9e-4967-b2b7-a0184939bb4f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:25.502865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c791be7-1f9e-4967-b2b7-a0184939bb4f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:25.503298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c791be7-1f9e-4967-b2b7-a0184939bb4f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:25.503624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e6bfe26e-af16-4e8d-b303-5c30a1be82a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:25.504544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e6bfe26e-af16-4e8d-b303-5c30a1be82a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:25.512001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6bfe26e-af16-4e8d-b303-5c30a1be82a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:25.512459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6bfe26e-af16-4e8d-b303-5c30a1be82a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:25.513227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6bfe26e-af16-4e8d-b303-5c30a1be82a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:25.513661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6bfe26e-af16-4e8d-b303-5c30a1be82a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:25.546709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e6bfe26e-af16-4e8d-b303-5c30a1be82a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047134 Jun 02 19:08:25.547283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 490/963] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:25.569451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6c791be7-1f9e-4967-b2b7-a0184939bb4f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:25.577553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6c791be7-1f9e-4967-b2b7-a0184939bb4f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087127 Jun 02 19:08:25.578143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 474/964] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:25 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:25.851223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d55c2ee1-e27c-4cc7-b955-d312def13aeb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:25.852092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d55c2ee1-e27c-4cc7-b955-d312def13aeb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:25.858706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d55c2ee1-e27c-4cc7-b955-d312def13aeb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:25.859158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d55c2ee1-e27c-4cc7-b955-d312def13aeb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:25.859917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d55c2ee1-e27c-4cc7-b955-d312def13aeb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:25.860373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d55c2ee1-e27c-4cc7-b955-d312def13aeb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:25.889963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d55c2ee1-e27c-4cc7-b955-d312def13aeb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042869 Jun 02 19:08:25.890501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 491/965] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:26.559270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6403afd9-7d07-4e5e-88e3-3670eef108b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:26.560201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6403afd9-7d07-4e5e-88e3-3670eef108b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:26.567248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6403afd9-7d07-4e5e-88e3-3670eef108b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:26.567695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6403afd9-7d07-4e5e-88e3-3670eef108b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:26.568706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6403afd9-7d07-4e5e-88e3-3670eef108b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:26.569556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6403afd9-7d07-4e5e-88e3-3670eef108b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:26.594487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8bac06e6-d158-472f-ad59-0597a32f3ce2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:26.595243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8bac06e6-d158-472f-ad59-0597a32f3ce2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:26.601860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6403afd9-7d07-4e5e-88e3-3670eef108b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046603 Jun 02 19:08:26.602510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 475/966] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:26.603162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8bac06e6-d158-472f-ad59-0597a32f3ce2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:26.603807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8bac06e6-d158-472f-ad59-0597a32f3ce2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:26.604654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8bac06e6-d158-472f-ad59-0597a32f3ce2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:26.605227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8bac06e6-d158-472f-ad59-0597a32f3ce2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:26.672989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8bac06e6-d158-472f-ad59-0597a32f3ce2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:26.681620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8bac06e6-d158-472f-ad59-0597a32f3ce2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090994 Jun 02 19:08:26.682214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 492/967] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:26 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:26.905348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-456cfcf9-587e-4fd8-ae0a-9575072bdab6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:26.906683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-456cfcf9-587e-4fd8-ae0a-9575072bdab6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:26.915666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-456cfcf9-587e-4fd8-ae0a-9575072bdab6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:26.916236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-456cfcf9-587e-4fd8-ae0a-9575072bdab6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:26.917004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-456cfcf9-587e-4fd8-ae0a-9575072bdab6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:26.917435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-456cfcf9-587e-4fd8-ae0a-9575072bdab6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:26.948285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-456cfcf9-587e-4fd8-ae0a-9575072bdab6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048889 Jun 02 19:08:26.948873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 476/968] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:27.617827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e2019c0b-09a9-4a2a-a708-006ffca25b60 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:27.619193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e2019c0b-09a9-4a2a-a708-006ffca25b60 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:27.629389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2019c0b-09a9-4a2a-a708-006ffca25b60 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:27.630021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2019c0b-09a9-4a2a-a708-006ffca25b60 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:27.631004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2019c0b-09a9-4a2a-a708-006ffca25b60 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:27.631397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2019c0b-09a9-4a2a-a708-006ffca25b60 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:27.667405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e2019c0b-09a9-4a2a-a708-006ffca25b60 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055823 Jun 02 19:08:27.667957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 493/969] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:27.699122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-85f1ca3b-5eef-4bfc-bcd7-1fe6ac53d595 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:27.699710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-85f1ca3b-5eef-4bfc-bcd7-1fe6ac53d595 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:27.706845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85f1ca3b-5eef-4bfc-bcd7-1fe6ac53d595 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:27.707299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85f1ca3b-5eef-4bfc-bcd7-1fe6ac53d595 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:27.708066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85f1ca3b-5eef-4bfc-bcd7-1fe6ac53d595 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:27.708496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85f1ca3b-5eef-4bfc-bcd7-1fe6ac53d595 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:27.784907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85f1ca3b-5eef-4bfc-bcd7-1fe6ac53d595 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:27.794004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-85f1ca3b-5eef-4bfc-bcd7-1fe6ac53d595 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.099042 Jun 02 19:08:27.794561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 477/970] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:27 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:27.962996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1708bcf8-dd6d-4065-bdf4-f749fb5d05bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:27.963937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1708bcf8-dd6d-4065-bdf4-f749fb5d05bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:27.970434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1708bcf8-dd6d-4065-bdf4-f749fb5d05bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:27.970888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1708bcf8-dd6d-4065-bdf4-f749fb5d05bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:27.971657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1708bcf8-dd6d-4065-bdf4-f749fb5d05bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:27.972098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1708bcf8-dd6d-4065-bdf4-f749fb5d05bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:28.014681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1708bcf8-dd6d-4065-bdf4-f749fb5d05bc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056823 Jun 02 19:08:28.015340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 494/971] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:28.683402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a562ac23-4584-48cb-99c1-7b00243a8741 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:28.684378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a562ac23-4584-48cb-99c1-7b00243a8741 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:28.691081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a562ac23-4584-48cb-99c1-7b00243a8741 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:28.691526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a562ac23-4584-48cb-99c1-7b00243a8741 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:28.692285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a562ac23-4584-48cb-99c1-7b00243a8741 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:28.692709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a562ac23-4584-48cb-99c1-7b00243a8741 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:28.722571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a562ac23-4584-48cb-99c1-7b00243a8741 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045605 Jun 02 19:08:28.723223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 478/972] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:28.811761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-21b7b5c3-07a7-4d1f-9b0f-6661235ba763 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:28.812319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-21b7b5c3-07a7-4d1f-9b0f-6661235ba763 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:28.819629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21b7b5c3-07a7-4d1f-9b0f-6661235ba763 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:28.820082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21b7b5c3-07a7-4d1f-9b0f-6661235ba763 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:28.821463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21b7b5c3-07a7-4d1f-9b0f-6661235ba763 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:28.821933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21b7b5c3-07a7-4d1f-9b0f-6661235ba763 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:28.887517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-21b7b5c3-07a7-4d1f-9b0f-6661235ba763 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:28.895576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-21b7b5c3-07a7-4d1f-9b0f-6661235ba763 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087885 Jun 02 19:08:28.896139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 495/973] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:28 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:29.028515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-673ee60b-951c-44a6-ac7a-22891b50288a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:29.029695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-673ee60b-951c-44a6-ac7a-22891b50288a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:29.036801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-673ee60b-951c-44a6-ac7a-22891b50288a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:29.037227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-673ee60b-951c-44a6-ac7a-22891b50288a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:29.038093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-673ee60b-951c-44a6-ac7a-22891b50288a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:29.038672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-673ee60b-951c-44a6-ac7a-22891b50288a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:29.071691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-673ee60b-951c-44a6-ac7a-22891b50288a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047451 Jun 02 19:08:29.072465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 479/974] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:29.739729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a9f9307d-a4d1-470b-a513-0c87121201a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:29.741232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a9f9307d-a4d1-470b-a513-0c87121201a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:29.749162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9f9307d-a4d1-470b-a513-0c87121201a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:29.749615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9f9307d-a4d1-470b-a513-0c87121201a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:29.750440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9f9307d-a4d1-470b-a513-0c87121201a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:29.752629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9f9307d-a4d1-470b-a513-0c87121201a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:29.781895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a9f9307d-a4d1-470b-a513-0c87121201a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048903 Jun 02 19:08:29.782456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 496/975] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:29.913334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-032527be-3004-4a2f-9e49-5093ff79cadd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:29.914035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-032527be-3004-4a2f-9e49-5093ff79cadd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:29.921267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-032527be-3004-4a2f-9e49-5093ff79cadd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:29.921713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-032527be-3004-4a2f-9e49-5093ff79cadd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:29.922673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-032527be-3004-4a2f-9e49-5093ff79cadd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:29.923193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-032527be-3004-4a2f-9e49-5093ff79cadd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:29.999444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-032527be-3004-4a2f-9e49-5093ff79cadd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:30.010383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-032527be-3004-4a2f-9e49-5093ff79cadd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.101647 Jun 02 19:08:30.010952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 480/976] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:29 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:30.085221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bbc5a69e-1700-49fd-8ad9-584318348078 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:30.086190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bbc5a69e-1700-49fd-8ad9-584318348078 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:30.093033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbc5a69e-1700-49fd-8ad9-584318348078 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:30.093485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbc5a69e-1700-49fd-8ad9-584318348078 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:30.094284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbc5a69e-1700-49fd-8ad9-584318348078 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:30.094737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbc5a69e-1700-49fd-8ad9-584318348078 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:30.138552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bbc5a69e-1700-49fd-8ad9-584318348078 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057104 Jun 02 19:08:30.139850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 497/977] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:30.794742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1eba4e2b-ad68-4269-b1eb-601f14e7a6d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:30.795575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1eba4e2b-ad68-4269-b1eb-601f14e7a6d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:30.801928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1eba4e2b-ad68-4269-b1eb-601f14e7a6d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:30.802369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1eba4e2b-ad68-4269-b1eb-601f14e7a6d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:30.803123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1eba4e2b-ad68-4269-b1eb-601f14e7a6d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:30.803548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1eba4e2b-ad68-4269-b1eb-601f14e7a6d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:30.834906 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1eba4e2b-ad68-4269-b1eb-601f14e7a6d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044411 Jun 02 19:08:30.835663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 481/978] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:30.915798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:08:30.916457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:08:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:08:31.031579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-662e3b20-a051-4c74-a2bb-b271eb3ea082 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:31.032535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-662e3b20-a051-4c74-a2bb-b271eb3ea082 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:31.043398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-662e3b20-a051-4c74-a2bb-b271eb3ea082 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:31.044110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-662e3b20-a051-4c74-a2bb-b271eb3ea082 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:31.045436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-662e3b20-a051-4c74-a2bb-b271eb3ea082 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:31.046113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-662e3b20-a051-4c74-a2bb-b271eb3ea082 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:31.113623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-662e3b20-a051-4c74-a2bb-b271eb3ea082 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:31.121912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-662e3b20-a051-4c74-a2bb-b271eb3ea082 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097574 Jun 02 19:08:31.122462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 498/979] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:31 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:31.153898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d56ce88d-6ec8-442f-9289-2dcb337bf0c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:31.155039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d56ce88d-6ec8-442f-9289-2dcb337bf0c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:31.162048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d56ce88d-6ec8-442f-9289-2dcb337bf0c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:31.162507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d56ce88d-6ec8-442f-9289-2dcb337bf0c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:31.163261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d56ce88d-6ec8-442f-9289-2dcb337bf0c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:31.163686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d56ce88d-6ec8-442f-9289-2dcb337bf0c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:31.356484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d56ce88d-6ec8-442f-9289-2dcb337bf0c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207976 Jun 02 19:08:31.356930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 482/980] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:31.851429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-71da4cc6-4441-448e-8483-c5fe27346485 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:31.852906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-71da4cc6-4441-448e-8483-c5fe27346485 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:31.864011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71da4cc6-4441-448e-8483-c5fe27346485 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:31.864750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71da4cc6-4441-448e-8483-c5fe27346485 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:31.866096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71da4cc6-4441-448e-8483-c5fe27346485 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:31.866853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71da4cc6-4441-448e-8483-c5fe27346485 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:31.893682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:31.899998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-71da4cc6-4441-448e-8483-c5fe27346485 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055471 Jun 02 19:08:31.900551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 499/981] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:32.140174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-44e84fe5-744d-48fd-948d-f58fba2a2741 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:32.140787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-44e84fe5-744d-48fd-948d-f58fba2a2741 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:32.149454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44e84fe5-744d-48fd-948d-f58fba2a2741 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:32.150136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44e84fe5-744d-48fd-948d-f58fba2a2741 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:32.151340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44e84fe5-744d-48fd-948d-f58fba2a2741 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:32.152873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44e84fe5-744d-48fd-948d-f58fba2a2741 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:32.221733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-44e84fe5-744d-48fd-948d-f58fba2a2741 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:32.230085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-44e84fe5-744d-48fd-948d-f58fba2a2741 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093822 Jun 02 19:08:32.230773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 483/982] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:32 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:32.369309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9c717633-df4d-4dc0-aeba-0dda9e0ecbed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:32.370591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9c717633-df4d-4dc0-aeba-0dda9e0ecbed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:32.377768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c717633-df4d-4dc0-aeba-0dda9e0ecbed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:32.378250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c717633-df4d-4dc0-aeba-0dda9e0ecbed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:32.379010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c717633-df4d-4dc0-aeba-0dda9e0ecbed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:32.379445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c717633-df4d-4dc0-aeba-0dda9e0ecbed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:32.410098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9c717633-df4d-4dc0-aeba-0dda9e0ecbed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Jun 02 19:08:32.410541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 500/983] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:32.917879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eb218487-bf8f-419d-933c-0ef05cfdb9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:32.919441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-eb218487-bf8f-419d-933c-0ef05cfdb9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:32.926372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb218487-bf8f-419d-933c-0ef05cfdb9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:32.926845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb218487-bf8f-419d-933c-0ef05cfdb9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:32.927603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb218487-bf8f-419d-933c-0ef05cfdb9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:32.928029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb218487-bf8f-419d-933c-0ef05cfdb9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:32.961485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-eb218487-bf8f-419d-933c-0ef05cfdb9b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050486 Jun 02 19:08:32.962081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 484/984] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:33.251427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-432518f2-1596-40f1-8b60-cdd30b86fa5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:33.252019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-432518f2-1596-40f1-8b60-cdd30b86fa5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:33.260702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-432518f2-1596-40f1-8b60-cdd30b86fa5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:33.261355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-432518f2-1596-40f1-8b60-cdd30b86fa5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:33.262581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-432518f2-1596-40f1-8b60-cdd30b86fa5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:33.263478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-432518f2-1596-40f1-8b60-cdd30b86fa5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:33.333196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-432518f2-1596-40f1-8b60-cdd30b86fa5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:33.344655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-432518f2-1596-40f1-8b60-cdd30b86fa5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097794 Jun 02 19:08:33.345209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 501/985] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:33 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:33.422959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f75b5e0e-e5dc-409a-9710-210311f09cfa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:33.423870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f75b5e0e-e5dc-409a-9710-210311f09cfa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:33.430705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f75b5e0e-e5dc-409a-9710-210311f09cfa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:33.431154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f75b5e0e-e5dc-409a-9710-210311f09cfa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:33.431898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f75b5e0e-e5dc-409a-9710-210311f09cfa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:33.432324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f75b5e0e-e5dc-409a-9710-210311f09cfa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:33.461167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f75b5e0e-e5dc-409a-9710-210311f09cfa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Jun 02 19:08:33.461720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 485/986] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:33.978208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-86ad9654-6de9-4e06-bfbb-075a57f73960 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:33.979697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-86ad9654-6de9-4e06-bfbb-075a57f73960 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:33.991949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86ad9654-6de9-4e06-bfbb-075a57f73960 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:33.992704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86ad9654-6de9-4e06-bfbb-075a57f73960 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:33.994013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86ad9654-6de9-4e06-bfbb-075a57f73960 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:33.994742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86ad9654-6de9-4e06-bfbb-075a57f73960 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:34.034722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-86ad9654-6de9-4e06-bfbb-075a57f73960 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063307 Jun 02 19:08:34.035291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 502/987] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:34.361529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ab0c380c-dccd-4c50-8da5-762573062048 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:34.362156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ab0c380c-dccd-4c50-8da5-762573062048 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:34.368547 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab0c380c-dccd-4c50-8da5-762573062048 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:34.368993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab0c380c-dccd-4c50-8da5-762573062048 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:34.369758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab0c380c-dccd-4c50-8da5-762573062048 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:34.370216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab0c380c-dccd-4c50-8da5-762573062048 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:34.452932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ab0c380c-dccd-4c50-8da5-762573062048 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:34.460974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ab0c380c-dccd-4c50-8da5-762573062048 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.103926 Jun 02 19:08:34.461527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 486/988] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:34 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:34.473232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e523dd3b-9b5e-42db-ae83-d072d8e9c8d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:34.474381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e523dd3b-9b5e-42db-ae83-d072d8e9c8d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:34.482777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e523dd3b-9b5e-42db-ae83-d072d8e9c8d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:34.483001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e523dd3b-9b5e-42db-ae83-d072d8e9c8d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:34.483673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e523dd3b-9b5e-42db-ae83-d072d8e9c8d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:34.484113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e523dd3b-9b5e-42db-ae83-d072d8e9c8d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:34.512743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e523dd3b-9b5e-42db-ae83-d072d8e9c8d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Jun 02 19:08:34.513357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 503/989] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:35.051086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef324d25-5723-4de6-a0b1-e9a63b46ca5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:35.052571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef324d25-5723-4de6-a0b1-e9a63b46ca5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:35.063510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef324d25-5723-4de6-a0b1-e9a63b46ca5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:35.064262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef324d25-5723-4de6-a0b1-e9a63b46ca5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:35.065493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef324d25-5723-4de6-a0b1-e9a63b46ca5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:35.066250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef324d25-5723-4de6-a0b1-e9a63b46ca5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:35.084715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:35.104400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef324d25-5723-4de6-a0b1-e9a63b46ca5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060132 Jun 02 19:08:35.104957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 487/990] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:35.479806 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-367b366b-f4e2-4383-9f0b-582dde6ed1cc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:35.480442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-367b366b-f4e2-4383-9f0b-582dde6ed1cc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:35.489069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-367b366b-f4e2-4383-9f0b-582dde6ed1cc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:35.489523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-367b366b-f4e2-4383-9f0b-582dde6ed1cc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:35.490495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-367b366b-f4e2-4383-9f0b-582dde6ed1cc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:35.491119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-367b366b-f4e2-4383-9f0b-582dde6ed1cc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:35.526149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c370a775-d49d-451b-8fea-c38e69808b15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:35.527089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c370a775-d49d-451b-8fea-c38e69808b15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:35.534091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c370a775-d49d-451b-8fea-c38e69808b15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:35.534549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c370a775-d49d-451b-8fea-c38e69808b15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:35.535543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c370a775-d49d-451b-8fea-c38e69808b15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:35.535746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c370a775-d49d-451b-8fea-c38e69808b15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:35.557185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-367b366b-f4e2-4383-9f0b-582dde6ed1cc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:35.565383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-367b366b-f4e2-4383-9f0b-582dde6ed1cc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089726 Jun 02 19:08:35.566007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 504/991] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:35 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:35.572350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c370a775-d49d-451b-8fea-c38e69808b15 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050223 Jun 02 19:08:35.572873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 488/992] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:36.125836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3f46548d-8538-4cb9-8f7e-a60c9c75362d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:36.126840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3f46548d-8538-4cb9-8f7e-a60c9c75362d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:36.133894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f46548d-8538-4cb9-8f7e-a60c9c75362d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:36.134346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f46548d-8538-4cb9-8f7e-a60c9c75362d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:36.135132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f46548d-8538-4cb9-8f7e-a60c9c75362d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:36.135568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f46548d-8538-4cb9-8f7e-a60c9c75362d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:36.173570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3f46548d-8538-4cb9-8f7e-a60c9c75362d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053134 Jun 02 19:08:36.174194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 505/993] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:36.586874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c9c8d67b-5df7-4e69-b86b-ffb030a29ac5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:36.587830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c9c8d67b-5df7-4e69-b86b-ffb030a29ac5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:36.588728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-df26f749-a87a-4fbd-89b3-9032576a91be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:36.590623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-df26f749-a87a-4fbd-89b3-9032576a91be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:36.599350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9c8d67b-5df7-4e69-b86b-ffb030a29ac5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:36.600123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9c8d67b-5df7-4e69-b86b-ffb030a29ac5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:36.601345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9c8d67b-5df7-4e69-b86b-ffb030a29ac5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:36.602097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9c8d67b-5df7-4e69-b86b-ffb030a29ac5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:36.602334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df26f749-a87a-4fbd-89b3-9032576a91be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:36.602916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df26f749-a87a-4fbd-89b3-9032576a91be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:36.604214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df26f749-a87a-4fbd-89b3-9032576a91be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:36.604980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df26f749-a87a-4fbd-89b3-9032576a91be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:36.639221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-df26f749-a87a-4fbd-89b3-9032576a91be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057075 Jun 02 19:08:36.640168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 506/994] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:36.669599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c9c8d67b-5df7-4e69-b86b-ffb030a29ac5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:36.677923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c9c8d67b-5df7-4e69-b86b-ffb030a29ac5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097596 Jun 02 19:08:36.678518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 489/995] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:36 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:37.190008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0f9bde7a-0b5f-43aa-aeb1-eb29c2551ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:37.191568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0f9bde7a-0b5f-43aa-aeb1-eb29c2551ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:37.202332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f9bde7a-0b5f-43aa-aeb1-eb29c2551ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:37.203039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f9bde7a-0b5f-43aa-aeb1-eb29c2551ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:37.203824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f9bde7a-0b5f-43aa-aeb1-eb29c2551ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:37.204294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f9bde7a-0b5f-43aa-aeb1-eb29c2551ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:37.236881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0f9bde7a-0b5f-43aa-aeb1-eb29c2551ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053658 Jun 02 19:08:37.237479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 507/996] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:37.651209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f8a74e8e-78d5-4a0d-94ee-36e5a172d3dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:37.652163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f8a74e8e-78d5-4a0d-94ee-36e5a172d3dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:37.659801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8a74e8e-78d5-4a0d-94ee-36e5a172d3dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:37.660245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8a74e8e-78d5-4a0d-94ee-36e5a172d3dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:37.661010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8a74e8e-78d5-4a0d-94ee-36e5a172d3dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:37.661438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8a74e8e-78d5-4a0d-94ee-36e5a172d3dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:37.692586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f8a74e8e-78d5-4a0d-94ee-36e5a172d3dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Jun 02 19:08:37.693133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 490/997] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:37.703124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-79dc7f5c-fdf5-4e83-bbfe-9021e7f7b94f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:37.704338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-79dc7f5c-fdf5-4e83-bbfe-9021e7f7b94f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:37.714746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79dc7f5c-fdf5-4e83-bbfe-9021e7f7b94f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:37.715354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79dc7f5c-fdf5-4e83-bbfe-9021e7f7b94f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:37.716719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79dc7f5c-fdf5-4e83-bbfe-9021e7f7b94f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:37.717457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79dc7f5c-fdf5-4e83-bbfe-9021e7f7b94f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:37.792863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-79dc7f5c-fdf5-4e83-bbfe-9021e7f7b94f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:37.803718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-79dc7f5c-fdf5-4e83-bbfe-9021e7f7b94f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.106641 Jun 02 19:08:37.804179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 508/998] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:37 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:38.249401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e70b3ac2-7cf7-4b53-b383-d70e87893bf5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:38.250436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e70b3ac2-7cf7-4b53-b383-d70e87893bf5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:38.257103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e70b3ac2-7cf7-4b53-b383-d70e87893bf5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:38.257549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e70b3ac2-7cf7-4b53-b383-d70e87893bf5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:38.258332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e70b3ac2-7cf7-4b53-b383-d70e87893bf5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:38.258768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e70b3ac2-7cf7-4b53-b383-d70e87893bf5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:38.288103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e70b3ac2-7cf7-4b53-b383-d70e87893bf5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042933 Jun 02 19:08:38.288658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 491/999] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:38.710635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3e0ea145-2648-4367-af0b-4f0d98febe19 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:38.712156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3e0ea145-2648-4367-af0b-4f0d98febe19 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:38.722576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e0ea145-2648-4367-af0b-4f0d98febe19 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:38.723076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e0ea145-2648-4367-af0b-4f0d98febe19 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:38.723878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e0ea145-2648-4367-af0b-4f0d98febe19 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:38.724319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e0ea145-2648-4367-af0b-4f0d98febe19 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:38.753714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3e0ea145-2648-4367-af0b-4f0d98febe19 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050592 Jun 02 19:08:38.754301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 509/1000] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:38.824067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ab75402-9e68-4c30-ad2d-0b4d75177bf7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:38.824617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ab75402-9e68-4c30-ad2d-0b4d75177bf7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:38.832353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ab75402-9e68-4c30-ad2d-0b4d75177bf7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:38.832800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ab75402-9e68-4c30-ad2d-0b4d75177bf7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:38.833556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ab75402-9e68-4c30-ad2d-0b4d75177bf7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:38.834048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ab75402-9e68-4c30-ad2d-0b4d75177bf7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:38.902898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0ab75402-9e68-4c30-ad2d-0b4d75177bf7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:38.912521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ab75402-9e68-4c30-ad2d-0b4d75177bf7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092807 Jun 02 19:08:38.913064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 492/1001] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:38 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:39.301835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-27bf1e01-e4ae-4845-a452-2259400bf91e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:39.302799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-27bf1e01-e4ae-4845-a452-2259400bf91e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:39.309632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27bf1e01-e4ae-4845-a452-2259400bf91e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:39.310120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27bf1e01-e4ae-4845-a452-2259400bf91e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:39.310893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27bf1e01-e4ae-4845-a452-2259400bf91e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:39.311331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27bf1e01-e4ae-4845-a452-2259400bf91e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:39.341123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-27bf1e01-e4ae-4845-a452-2259400bf91e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044157 Jun 02 19:08:39.341667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 510/1002] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:39.769645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3eb1740a-6064-4088-8fc1-5aefb4e14ca5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:39.770854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3eb1740a-6064-4088-8fc1-5aefb4e14ca5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:39.783146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3eb1740a-6064-4088-8fc1-5aefb4e14ca5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:39.784119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3eb1740a-6064-4088-8fc1-5aefb4e14ca5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:39.785010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3eb1740a-6064-4088-8fc1-5aefb4e14ca5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:39.785546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3eb1740a-6064-4088-8fc1-5aefb4e14ca5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:39.818488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3eb1740a-6064-4088-8fc1-5aefb4e14ca5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055099 Jun 02 19:08:39.819038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 493/1003] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:39.932589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-476893b9-b696-4920-9927-557e9450c271 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:39.933572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-476893b9-b696-4920-9927-557e9450c271 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:39.945752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-476893b9-b696-4920-9927-557e9450c271 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:39.946580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-476893b9-b696-4920-9927-557e9450c271 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:39.947840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-476893b9-b696-4920-9927-557e9450c271 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:39.948570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-476893b9-b696-4920-9927-557e9450c271 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:40.015234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-476893b9-b696-4920-9927-557e9450c271 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:40.024093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-476893b9-b696-4920-9927-557e9450c271 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098020 Jun 02 19:08:40.024593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 511/1004] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:39 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:40.353326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-69e5c759-7c8d-48fd-af6f-9cf0d20801d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:40.354286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-69e5c759-7c8d-48fd-af6f-9cf0d20801d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:40.361237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69e5c759-7c8d-48fd-af6f-9cf0d20801d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:40.361668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69e5c759-7c8d-48fd-af6f-9cf0d20801d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:40.362447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69e5c759-7c8d-48fd-af6f-9cf0d20801d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:40.362875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69e5c759-7c8d-48fd-af6f-9cf0d20801d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:40.395731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-69e5c759-7c8d-48fd-af6f-9cf0d20801d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046472 Jun 02 19:08:40.396282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 494/1005] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:40.832496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9236293a-e8c8-4f2e-bd9d-d628da64f56c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:40.833842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9236293a-e8c8-4f2e-bd9d-d628da64f56c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:40.843581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9236293a-e8c8-4f2e-bd9d-d628da64f56c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:40.844232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9236293a-e8c8-4f2e-bd9d-d628da64f56c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:40.845460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9236293a-e8c8-4f2e-bd9d-d628da64f56c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:40.846335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9236293a-e8c8-4f2e-bd9d-d628da64f56c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:40.882386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9236293a-e8c8-4f2e-bd9d-d628da64f56c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055127 Jun 02 19:08:40.882947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 512/1006] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:41.051362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-00a637c8-69cf-4fb3-ab92-6d0ee5f71d01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:41.052458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-00a637c8-69cf-4fb3-ab92-6d0ee5f71d01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:41.063309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00a637c8-69cf-4fb3-ab92-6d0ee5f71d01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:41.064048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00a637c8-69cf-4fb3-ab92-6d0ee5f71d01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:41.065290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00a637c8-69cf-4fb3-ab92-6d0ee5f71d01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:41.066088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00a637c8-69cf-4fb3-ab92-6d0ee5f71d01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:41.140658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-00a637c8-69cf-4fb3-ab92-6d0ee5f71d01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:41.153872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-00a637c8-69cf-4fb3-ab92-6d0ee5f71d01 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.109702 Jun 02 19:08:41.154966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 495/1007] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:41 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:41.413596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-19ea957c-c483-447e-9614-db1ccfa4e484 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:41.414898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-19ea957c-c483-447e-9614-db1ccfa4e484 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:41.425483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19ea957c-c483-447e-9614-db1ccfa4e484 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:41.425886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19ea957c-c483-447e-9614-db1ccfa4e484 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:41.426638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19ea957c-c483-447e-9614-db1ccfa4e484 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:41.427082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19ea957c-c483-447e-9614-db1ccfa4e484 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:41.458908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-19ea957c-c483-447e-9614-db1ccfa4e484 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052181 Jun 02 19:08:41.459461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 513/1008] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:41.893861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d8050f21-d3b3-495d-81d5-c9851a4d9d20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:41.895309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d8050f21-d3b3-495d-81d5-c9851a4d9d20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:41.897688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=82 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:41.903323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8050f21-d3b3-495d-81d5-c9851a4d9d20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:41.903768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8050f21-d3b3-495d-81d5-c9851a4d9d20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:41.904533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8050f21-d3b3-495d-81d5-c9851a4d9d20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:41.904963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8050f21-d3b3-495d-81d5-c9851a4d9d20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:41.934516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d8050f21-d3b3-495d-81d5-c9851a4d9d20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Jun 02 19:08:41.935056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 496/1009] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:42.176413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7abc8954-9939-4198-bf83-7e205a6cf851 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:42.176935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7abc8954-9939-4198-bf83-7e205a6cf851 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:42.183406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7abc8954-9939-4198-bf83-7e205a6cf851 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:42.183869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7abc8954-9939-4198-bf83-7e205a6cf851 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:42.184645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7abc8954-9939-4198-bf83-7e205a6cf851 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:42.185087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7abc8954-9939-4198-bf83-7e205a6cf851 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:42.256292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7abc8954-9939-4198-bf83-7e205a6cf851 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:42.268568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7abc8954-9939-4198-bf83-7e205a6cf851 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097569 Jun 02 19:08:42.269413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 514/1010] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:42 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:42.473141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bf7ee20f-72e2-4fff-8334-30b766fddbc3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:42.474017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bf7ee20f-72e2-4fff-8334-30b766fddbc3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:42.480798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf7ee20f-72e2-4fff-8334-30b766fddbc3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:42.481252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf7ee20f-72e2-4fff-8334-30b766fddbc3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:42.482038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf7ee20f-72e2-4fff-8334-30b766fddbc3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:42.482469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf7ee20f-72e2-4fff-8334-30b766fddbc3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:42.512947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bf7ee20f-72e2-4fff-8334-30b766fddbc3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045645 Jun 02 19:08:42.513507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 497/1011] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:42.948489 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-24f06693-bb67-4193-a059-d7fa07c490f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:42.949431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-24f06693-bb67-4193-a059-d7fa07c490f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:42.956472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24f06693-bb67-4193-a059-d7fa07c490f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:42.956825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24f06693-bb67-4193-a059-d7fa07c490f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:42.957583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24f06693-bb67-4193-a059-d7fa07c490f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:42.958061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24f06693-bb67-4193-a059-d7fa07c490f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:42.988433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-24f06693-bb67-4193-a059-d7fa07c490f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Jun 02 19:08:42.988992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 515/1012] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:43.290047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92bb3209-e731-4cd3-95be-12375a17e038 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:43.290974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92bb3209-e731-4cd3-95be-12375a17e038 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:43.301863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92bb3209-e731-4cd3-95be-12375a17e038 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:43.302800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92bb3209-e731-4cd3-95be-12375a17e038 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:43.303573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92bb3209-e731-4cd3-95be-12375a17e038 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:43.304009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92bb3209-e731-4cd3-95be-12375a17e038 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:43.376929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-92bb3209-e731-4cd3-95be-12375a17e038 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:43.385884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92bb3209-e731-4cd3-95be-12375a17e038 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102454 Jun 02 19:08:43.386477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 498/1013] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:43 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:43.526569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-62150ce6-c9bf-4978-9c41-f245864512a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:43.527715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-62150ce6-c9bf-4978-9c41-f245864512a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:43.529939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=86 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:43.536423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62150ce6-c9bf-4978-9c41-f245864512a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:43.536987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62150ce6-c9bf-4978-9c41-f245864512a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:43.537961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62150ce6-c9bf-4978-9c41-f245864512a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:43.538401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62150ce6-c9bf-4978-9c41-f245864512a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:43.552555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:43.568560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-62150ce6-c9bf-4978-9c41-f245864512a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046850 Jun 02 19:08:43.569112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 516/1014] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:44.002445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14982879-ba9b-4518-b4b6-5bba110c1a5d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:44.003472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14982879-ba9b-4518-b4b6-5bba110c1a5d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:44.012714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14982879-ba9b-4518-b4b6-5bba110c1a5d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:44.013513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14982879-ba9b-4518-b4b6-5bba110c1a5d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:44.014588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14982879-ba9b-4518-b4b6-5bba110c1a5d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:44.015245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14982879-ba9b-4518-b4b6-5bba110c1a5d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:44.047788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14982879-ba9b-4518-b4b6-5bba110c1a5d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051021 Jun 02 19:08:44.048346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 499/1015] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:44.406340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c87e4554-3b05-4a1f-b920-fa65afa0b9c5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:44.406970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c87e4554-3b05-4a1f-b920-fa65afa0b9c5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:44.415471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c87e4554-3b05-4a1f-b920-fa65afa0b9c5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:44.415934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c87e4554-3b05-4a1f-b920-fa65afa0b9c5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:44.416725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c87e4554-3b05-4a1f-b920-fa65afa0b9c5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:44.417164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c87e4554-3b05-4a1f-b920-fa65afa0b9c5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:44.478153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c87e4554-3b05-4a1f-b920-fa65afa0b9c5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:44.487713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c87e4554-3b05-4a1f-b920-fa65afa0b9c5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087226 Jun 02 19:08:44.488280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 517/1016] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:44 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:44.582673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-966c5164-76a9-4c3c-9d14-9ee79414567b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:44.583655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-966c5164-76a9-4c3c-9d14-9ee79414567b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:44.590779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-966c5164-76a9-4c3c-9d14-9ee79414567b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:44.591231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-966c5164-76a9-4c3c-9d14-9ee79414567b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:44.592001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-966c5164-76a9-4c3c-9d14-9ee79414567b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:44.592458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-966c5164-76a9-4c3c-9d14-9ee79414567b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:44.621785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-966c5164-76a9-4c3c-9d14-9ee79414567b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045378 Jun 02 19:08:44.622633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 500/1017] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:45.062195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ddd31df2-bb9c-48b0-96dd-18595f552cb1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:45.063206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ddd31df2-bb9c-48b0-96dd-18595f552cb1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:45.070879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ddd31df2-bb9c-48b0-96dd-18595f552cb1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:45.071327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ddd31df2-bb9c-48b0-96dd-18595f552cb1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:45.072096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ddd31df2-bb9c-48b0-96dd-18595f552cb1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:45.072518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ddd31df2-bb9c-48b0-96dd-18595f552cb1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:45.103652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ddd31df2-bb9c-48b0-96dd-18595f552cb1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045959 Jun 02 19:08:45.104236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 518/1018] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:45.504425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-70fdd46e-0f65-47c6-a867-953bb3c93726 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:45.505071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-70fdd46e-0f65-47c6-a867-953bb3c93726 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:45.511817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70fdd46e-0f65-47c6-a867-953bb3c93726 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:45.512281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70fdd46e-0f65-47c6-a867-953bb3c93726 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:45.513083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70fdd46e-0f65-47c6-a867-953bb3c93726 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:45.513515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70fdd46e-0f65-47c6-a867-953bb3c93726 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:45.577661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-70fdd46e-0f65-47c6-a867-953bb3c93726 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:45.586240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-70fdd46e-0f65-47c6-a867-953bb3c93726 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085887 Jun 02 19:08:45.586815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 501/1019] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:45 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:45.634295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f0432ae1-8a8f-4187-969c-2fa067793a1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:45.635233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f0432ae1-8a8f-4187-969c-2fa067793a1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:45.642107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0432ae1-8a8f-4187-969c-2fa067793a1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:45.642552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0432ae1-8a8f-4187-969c-2fa067793a1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:45.643325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0432ae1-8a8f-4187-969c-2fa067793a1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:45.643771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0432ae1-8a8f-4187-969c-2fa067793a1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:45.674697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f0432ae1-8a8f-4187-969c-2fa067793a1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044971 Jun 02 19:08:45.675341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 519/1020] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:46.120054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e8bd70f7-1006-4e58-a1df-0075039480f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:46.120995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e8bd70f7-1006-4e58-a1df-0075039480f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:46.128083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8bd70f7-1006-4e58-a1df-0075039480f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:46.128592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8bd70f7-1006-4e58-a1df-0075039480f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:46.129502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8bd70f7-1006-4e58-a1df-0075039480f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:46.130098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8bd70f7-1006-4e58-a1df-0075039480f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:46.160506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e8bd70f7-1006-4e58-a1df-0075039480f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Jun 02 19:08:46.161091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 502/1021] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:46.610244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5fad753a-0d42-4b6d-8975-98cd8d9fe691 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:46.611119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5fad753a-0d42-4b6d-8975-98cd8d9fe691 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:46.620874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5fad753a-0d42-4b6d-8975-98cd8d9fe691 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:46.621531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5fad753a-0d42-4b6d-8975-98cd8d9fe691 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:46.622687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5fad753a-0d42-4b6d-8975-98cd8d9fe691 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:46.623371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5fad753a-0d42-4b6d-8975-98cd8d9fe691 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:46.687264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-97700b3d-ac85-4a6f-bdfc-17da3ba6152a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:46.688191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-97700b3d-ac85-4a6f-bdfc-17da3ba6152a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:46.695971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97700b3d-ac85-4a6f-bdfc-17da3ba6152a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:46.695971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97700b3d-ac85-4a6f-bdfc-17da3ba6152a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:46.696765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97700b3d-ac85-4a6f-bdfc-17da3ba6152a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:46.697201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97700b3d-ac85-4a6f-bdfc-17da3ba6152a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:46.699419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5fad753a-0d42-4b6d-8975-98cd8d9fe691 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:46.707559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5fad753a-0d42-4b6d-8975-98cd8d9fe691 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102984 Jun 02 19:08:46.708128 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 520/1022] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:46 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:46.727815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-97700b3d-ac85-4a6f-bdfc-17da3ba6152a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044590 Jun 02 19:08:46.728366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 503/1023] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:47.176187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-119e01fb-ed6b-4ac3-9286-14591d65442e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:47.177555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-119e01fb-ed6b-4ac3-9286-14591d65442e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:47.187154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-119e01fb-ed6b-4ac3-9286-14591d65442e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:47.187821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-119e01fb-ed6b-4ac3-9286-14591d65442e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:47.188915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-119e01fb-ed6b-4ac3-9286-14591d65442e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:47.189549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-119e01fb-ed6b-4ac3-9286-14591d65442e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:47.221067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-119e01fb-ed6b-4ac3-9286-14591d65442e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050934 Jun 02 19:08:47.221524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 521/1024] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:47.726072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-87971b24-7265-40fa-9ca6-48aeff90bc44 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:47.726678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-87971b24-7265-40fa-9ca6-48aeff90bc44 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:47.734026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87971b24-7265-40fa-9ca6-48aeff90bc44 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:47.734494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87971b24-7265-40fa-9ca6-48aeff90bc44 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:47.735232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87971b24-7265-40fa-9ca6-48aeff90bc44 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:47.735659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87971b24-7265-40fa-9ca6-48aeff90bc44 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:47.738273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:47.740501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aa495dc0-e95f-4b72-b131-8ad45c10cd69 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:47.741942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-aa495dc0-e95f-4b72-b131-8ad45c10cd69 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:47.748282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa495dc0-e95f-4b72-b131-8ad45c10cd69 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:47.748730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa495dc0-e95f-4b72-b131-8ad45c10cd69 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:47.749508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa495dc0-e95f-4b72-b131-8ad45c10cd69 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:47.749976 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa495dc0-e95f-4b72-b131-8ad45c10cd69 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:47.781016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-aa495dc0-e95f-4b72-b131-8ad45c10cd69 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044734 Jun 02 19:08:47.781583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 522/1025] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:47.800789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-87971b24-7265-40fa-9ca6-48aeff90bc44 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:47.808902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-87971b24-7265-40fa-9ca6-48aeff90bc44 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087117 Jun 02 19:08:47.809446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 504/1026] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:47 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:48.237171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-02fdd54a-ddbb-4f23-a7b9-b257a07f2faf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:48.238724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-02fdd54a-ddbb-4f23-a7b9-b257a07f2faf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:48.249023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02fdd54a-ddbb-4f23-a7b9-b257a07f2faf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:48.249769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02fdd54a-ddbb-4f23-a7b9-b257a07f2faf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:48.251078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02fdd54a-ddbb-4f23-a7b9-b257a07f2faf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:48.252009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02fdd54a-ddbb-4f23-a7b9-b257a07f2faf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:48.283800 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-02fdd54a-ddbb-4f23-a7b9-b257a07f2faf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053313 Jun 02 19:08:48.284346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 523/1027] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:48.797910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-38bd7a3c-21f0-4ba8-921c-5c95ddec00b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:48.799228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-38bd7a3c-21f0-4ba8-921c-5c95ddec00b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:48.810932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38bd7a3c-21f0-4ba8-921c-5c95ddec00b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:48.811661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38bd7a3c-21f0-4ba8-921c-5c95ddec00b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:48.812898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38bd7a3c-21f0-4ba8-921c-5c95ddec00b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:48.813617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38bd7a3c-21f0-4ba8-921c-5c95ddec00b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:48.826736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8e484570-e327-426b-8a2b-5cdeebb01a67 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:48.827424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8e484570-e327-426b-8a2b-5cdeebb01a67 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:48.834546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e484570-e327-426b-8a2b-5cdeebb01a67 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:48.835010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e484570-e327-426b-8a2b-5cdeebb01a67 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:48.835773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e484570-e327-426b-8a2b-5cdeebb01a67 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:48.836220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e484570-e327-426b-8a2b-5cdeebb01a67 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:48.847900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-38bd7a3c-21f0-4ba8-921c-5c95ddec00b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056965 Jun 02 19:08:48.848499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 505/1028] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:49.105069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8e484570-e327-426b-8a2b-5cdeebb01a67 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:49.116638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8e484570-e327-426b-8a2b-5cdeebb01a67 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.293910 Jun 02 19:08:49.117240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 524/1029] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:48 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:49.296807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e2c7de4f-079b-4193-90d5-6abae7034ed5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:49.297907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e2c7de4f-079b-4193-90d5-6abae7034ed5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:49.305628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2c7de4f-079b-4193-90d5-6abae7034ed5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:49.306107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2c7de4f-079b-4193-90d5-6abae7034ed5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:49.306866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2c7de4f-079b-4193-90d5-6abae7034ed5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:49.307295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e2c7de4f-079b-4193-90d5-6abae7034ed5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:49.337018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e2c7de4f-079b-4193-90d5-6abae7034ed5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Jun 02 19:08:49.337560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 506/1030] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:49.861682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a6c53119-2caf-4efe-8039-b572ae9253f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:49.862617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a6c53119-2caf-4efe-8039-b572ae9253f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:49.870232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6c53119-2caf-4efe-8039-b572ae9253f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:49.870667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6c53119-2caf-4efe-8039-b572ae9253f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:49.871433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6c53119-2caf-4efe-8039-b572ae9253f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:49.871866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6c53119-2caf-4efe-8039-b572ae9253f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:49.903116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a6c53119-2caf-4efe-8039-b572ae9253f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045181 Jun 02 19:08:49.903829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 525/1031] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:50.134823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9c18ba0b-dc3d-4604-969b-7fbf05d09aea tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:50.135423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9c18ba0b-dc3d-4604-969b-7fbf05d09aea tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:50.142379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c18ba0b-dc3d-4604-969b-7fbf05d09aea tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:50.142822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c18ba0b-dc3d-4604-969b-7fbf05d09aea tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:50.143603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c18ba0b-dc3d-4604-969b-7fbf05d09aea tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:50.144041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c18ba0b-dc3d-4604-969b-7fbf05d09aea tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:50.207077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9c18ba0b-dc3d-4604-969b-7fbf05d09aea tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:50.215192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9c18ba0b-dc3d-4604-969b-7fbf05d09aea tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085222 Jun 02 19:08:50.215752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 507/1032] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:50 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:50.350901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b0ea5d6b-a18f-4515-b253-885fc4a973b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:50.351923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b0ea5d6b-a18f-4515-b253-885fc4a973b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:50.358492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0ea5d6b-a18f-4515-b253-885fc4a973b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:50.358942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0ea5d6b-a18f-4515-b253-885fc4a973b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:50.359705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0ea5d6b-a18f-4515-b253-885fc4a973b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:50.360138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0ea5d6b-a18f-4515-b253-885fc4a973b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:50.390931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b0ea5d6b-a18f-4515-b253-885fc4a973b4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Jun 02 19:08:50.391402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 526/1033] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:50.920887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e8ce4b87-119b-4dbe-afdb-057b55a95839 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:50.922424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e8ce4b87-119b-4dbe-afdb-057b55a95839 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:50.933047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8ce4b87-119b-4dbe-afdb-057b55a95839 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:50.933682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8ce4b87-119b-4dbe-afdb-057b55a95839 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:50.934946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8ce4b87-119b-4dbe-afdb-057b55a95839 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:50.935607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8ce4b87-119b-4dbe-afdb-057b55a95839 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:50.970169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e8ce4b87-119b-4dbe-afdb-057b55a95839 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055717 Jun 02 19:08:50.970722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 508/1034] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:51.237392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-16045d1c-22bd-483b-9e33-bb416e1e01ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:51.238334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-16045d1c-22bd-483b-9e33-bb416e1e01ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:51.247480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16045d1c-22bd-483b-9e33-bb416e1e01ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:51.247937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16045d1c-22bd-483b-9e33-bb416e1e01ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:51.248716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16045d1c-22bd-483b-9e33-bb416e1e01ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:51.249184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16045d1c-22bd-483b-9e33-bb416e1e01ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:51.313342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-16045d1c-22bd-483b-9e33-bb416e1e01ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:51.321685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-16045d1c-22bd-483b-9e33-bb416e1e01ca tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091027 Jun 02 19:08:51.322287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 527/1035] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:51 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:51.410224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-88aaa890-9a36-42e0-bb76-a0fd8f333bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:51.411741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-88aaa890-9a36-42e0-bb76-a0fd8f333bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:51.422835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88aaa890-9a36-42e0-bb76-a0fd8f333bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:51.423619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88aaa890-9a36-42e0-bb76-a0fd8f333bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:51.425167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88aaa890-9a36-42e0-bb76-a0fd8f333bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:51.426000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88aaa890-9a36-42e0-bb76-a0fd8f333bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:51.459626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-88aaa890-9a36-42e0-bb76-a0fd8f333bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057340 Jun 02 19:08:51.460168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 509/1036] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:51.986217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e0d6c7ea-530a-4e80-8828-9dcd74b3e380 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:51.987710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e0d6c7ea-530a-4e80-8828-9dcd74b3e380 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:51.995808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0d6c7ea-530a-4e80-8828-9dcd74b3e380 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:51.996257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0d6c7ea-530a-4e80-8828-9dcd74b3e380 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:51.997022 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0d6c7ea-530a-4e80-8828-9dcd74b3e380 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:51.997453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0d6c7ea-530a-4e80-8828-9dcd74b3e380 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:52.029776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e0d6c7ea-530a-4e80-8828-9dcd74b3e380 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050333 Jun 02 19:08:52.030375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 528/1037] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:52.340303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-49e41015-ede2-493e-982a-74f9ae55c1df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:52.340947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-49e41015-ede2-493e-982a-74f9ae55c1df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:52.347460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49e41015-ede2-493e-982a-74f9ae55c1df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:52.347914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49e41015-ede2-493e-982a-74f9ae55c1df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:52.348682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49e41015-ede2-493e-982a-74f9ae55c1df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:52.349149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49e41015-ede2-493e-982a-74f9ae55c1df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:52.413541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-49e41015-ede2-493e-982a-74f9ae55c1df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:52.423436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-49e41015-ede2-493e-982a-74f9ae55c1df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087536 Jun 02 19:08:52.424037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 510/1038] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:52 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:52.473660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7638070b-767c-4432-a846-c278ed973471 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:52.474665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7638070b-767c-4432-a846-c278ed973471 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:52.482175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7638070b-767c-4432-a846-c278ed973471 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:52.482630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7638070b-767c-4432-a846-c278ed973471 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:52.483389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7638070b-767c-4432-a846-c278ed973471 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:52.483869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7638070b-767c-4432-a846-c278ed973471 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:52.513778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7638070b-767c-4432-a846-c278ed973471 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Jun 02 19:08:52.514366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 529/1039] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:53.044493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cb72c978-1648-4a1e-b50b-2087384945b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:53.045822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cb72c978-1648-4a1e-b50b-2087384945b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:53.055379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb72c978-1648-4a1e-b50b-2087384945b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:53.055803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb72c978-1648-4a1e-b50b-2087384945b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:53.056581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb72c978-1648-4a1e-b50b-2087384945b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:53.057004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb72c978-1648-4a1e-b50b-2087384945b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:53.086519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cb72c978-1648-4a1e-b50b-2087384945b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048662 Jun 02 19:08:53.087228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 511/1040] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:53.442402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b24b87e6-f353-452f-a5fb-c56df86ea7bd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:53.443171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b24b87e6-f353-452f-a5fb-c56df86ea7bd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:53.450476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b24b87e6-f353-452f-a5fb-c56df86ea7bd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:53.450940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b24b87e6-f353-452f-a5fb-c56df86ea7bd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:53.451708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b24b87e6-f353-452f-a5fb-c56df86ea7bd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:53.452146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b24b87e6-f353-452f-a5fb-c56df86ea7bd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:53.525763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b24b87e6-f353-452f-a5fb-c56df86ea7bd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:53.526601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ae7f9d3c-2943-4125-b258-38e1c03436c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:53.527551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ae7f9d3c-2943-4125-b258-38e1c03436c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:53.534020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae7f9d3c-2943-4125-b258-38e1c03436c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:53.534325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b24b87e6-f353-452f-a5fb-c56df86ea7bd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.096549 Jun 02 19:08:53.534623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae7f9d3c-2943-4125-b258-38e1c03436c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:53.535350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 530/1041] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:53 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:53.539831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae7f9d3c-2943-4125-b258-38e1c03436c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:53.540342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae7f9d3c-2943-4125-b258-38e1c03436c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:53.570378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ae7f9d3c-2943-4125-b258-38e1c03436c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048190 Jun 02 19:08:53.571960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 512/1042] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:54.100499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7e7a6218-1327-4aca-bac2-5dde3a837e87 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:54.101659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7e7a6218-1327-4aca-bac2-5dde3a837e87 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:54.109768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e7a6218-1327-4aca-bac2-5dde3a837e87 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:54.110371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e7a6218-1327-4aca-bac2-5dde3a837e87 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:54.111392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e7a6218-1327-4aca-bac2-5dde3a837e87 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:54.111935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e7a6218-1327-4aca-bac2-5dde3a837e87 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:54.144322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7e7a6218-1327-4aca-bac2-5dde3a837e87 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048949 Jun 02 19:08:54.145252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 531/1043] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:54.551111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cc4f7b58-b7e3-4dd9-b8ca-d267510de5be tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:54.551670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cc4f7b58-b7e3-4dd9-b8ca-d267510de5be tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:54.559084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc4f7b58-b7e3-4dd9-b8ca-d267510de5be tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:54.559531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc4f7b58-b7e3-4dd9-b8ca-d267510de5be tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:54.560294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc4f7b58-b7e3-4dd9-b8ca-d267510de5be tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:54.560758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc4f7b58-b7e3-4dd9-b8ca-d267510de5be tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:54.583434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-53d0812d-8ee9-4bbb-a470-139f059c2c5c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:54.584405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-53d0812d-8ee9-4bbb-a470-139f059c2c5c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:54.591540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53d0812d-8ee9-4bbb-a470-139f059c2c5c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:54.592007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53d0812d-8ee9-4bbb-a470-139f059c2c5c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:54.592788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53d0812d-8ee9-4bbb-a470-139f059c2c5c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:54.593231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53d0812d-8ee9-4bbb-a470-139f059c2c5c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:54.624014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-53d0812d-8ee9-4bbb-a470-139f059c2c5c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Jun 02 19:08:54.624202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cc4f7b58-b7e3-4dd9-b8ca-d267510de5be tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:54.624890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 532/1044] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:54.631760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cc4f7b58-b7e3-4dd9-b8ca-d267510de5be tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084641 Jun 02 19:08:54.632306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 513/1045] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:54 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:55.159944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ecaba376-1c3e-4233-9c5c-31b4bf0bd110 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:55.161120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ecaba376-1c3e-4233-9c5c-31b4bf0bd110 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:55.168684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ecaba376-1c3e-4233-9c5c-31b4bf0bd110 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:55.169135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ecaba376-1c3e-4233-9c5c-31b4bf0bd110 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:55.169941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ecaba376-1c3e-4233-9c5c-31b4bf0bd110 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:55.170365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ecaba376-1c3e-4233-9c5c-31b4bf0bd110 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:55.172705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:55.208828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ecaba376-1c3e-4233-9c5c-31b4bf0bd110 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053877 Jun 02 19:08:55.209380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 533/1046] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:55.639909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-08a0018c-c8c8-4b6d-81e5-072c65217ed4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:55.641463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-08a0018c-c8c8-4b6d-81e5-072c65217ed4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:55.652054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a13eabd5-51dc-47bf-8e03-45edbcaef9e8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:55.652537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08a0018c-c8c8-4b6d-81e5-072c65217ed4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:55.652670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08a0018c-c8c8-4b6d-81e5-072c65217ed4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:55.652765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a13eabd5-51dc-47bf-8e03-45edbcaef9e8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:55.653477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08a0018c-c8c8-4b6d-81e5-072c65217ed4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:55.653945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08a0018c-c8c8-4b6d-81e5-072c65217ed4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:55.659469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a13eabd5-51dc-47bf-8e03-45edbcaef9e8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:55.659916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a13eabd5-51dc-47bf-8e03-45edbcaef9e8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:55.660684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a13eabd5-51dc-47bf-8e03-45edbcaef9e8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:55.661117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a13eabd5-51dc-47bf-8e03-45edbcaef9e8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:55.683534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-08a0018c-c8c8-4b6d-81e5-072c65217ed4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050525 Jun 02 19:08:55.684117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 514/1047] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:55.724597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a13eabd5-51dc-47bf-8e03-45edbcaef9e8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:55.733524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a13eabd5-51dc-47bf-8e03-45edbcaef9e8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087148 Jun 02 19:08:55.734327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 534/1048] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:55 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:56.225003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-43658831-1039-42d0-9f81-d75e3d52ac5b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:56.226548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-43658831-1039-42d0-9f81-d75e3d52ac5b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:56.237135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43658831-1039-42d0-9f81-d75e3d52ac5b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:56.237980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43658831-1039-42d0-9f81-d75e3d52ac5b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:56.239234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43658831-1039-42d0-9f81-d75e3d52ac5b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:56.239954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43658831-1039-42d0-9f81-d75e3d52ac5b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:56.272821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-43658831-1039-42d0-9f81-d75e3d52ac5b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054497 Jun 02 19:08:56.273332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 515/1049] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:56.700135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4ffddebf-e0ab-4dd2-a78a-8fe44b7702f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:56.701096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4ffddebf-e0ab-4dd2-a78a-8fe44b7702f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:56.708229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4ffddebf-e0ab-4dd2-a78a-8fe44b7702f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:56.708689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4ffddebf-e0ab-4dd2-a78a-8fe44b7702f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:56.709466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4ffddebf-e0ab-4dd2-a78a-8fe44b7702f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:56.709952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4ffddebf-e0ab-4dd2-a78a-8fe44b7702f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:56.740990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4ffddebf-e0ab-4dd2-a78a-8fe44b7702f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047862 Jun 02 19:08:56.741553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 535/1050] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:56.750653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b2324651-14b4-4855-bd15-c4180f2239a6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:56.751258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b2324651-14b4-4855-bd15-c4180f2239a6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:56.758163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2324651-14b4-4855-bd15-c4180f2239a6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:56.758607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2324651-14b4-4855-bd15-c4180f2239a6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:56.759352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2324651-14b4-4855-bd15-c4180f2239a6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:56.759959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2324651-14b4-4855-bd15-c4180f2239a6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:56.833591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b2324651-14b4-4855-bd15-c4180f2239a6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:56.843725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b2324651-14b4-4855-bd15-c4180f2239a6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.096947 Jun 02 19:08:56.844260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 516/1051] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:56 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:57.287567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d2341156-2e8e-49ea-bc7e-5b4b608b9bdd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:57.288778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d2341156-2e8e-49ea-bc7e-5b4b608b9bdd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:57.297138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d2341156-2e8e-49ea-bc7e-5b4b608b9bdd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:57.297597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d2341156-2e8e-49ea-bc7e-5b4b608b9bdd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:57.298403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d2341156-2e8e-49ea-bc7e-5b4b608b9bdd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:57.298874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d2341156-2e8e-49ea-bc7e-5b4b608b9bdd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:57.331266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d2341156-2e8e-49ea-bc7e-5b4b608b9bdd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049232 Jun 02 19:08:57.331820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 536/1052] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:57.753543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a106f8f3-7967-46ce-b889-8454d660aaa4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:57.754505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a106f8f3-7967-46ce-b889-8454d660aaa4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:57.761148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a106f8f3-7967-46ce-b889-8454d660aaa4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:57.761588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a106f8f3-7967-46ce-b889-8454d660aaa4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:57.762535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a106f8f3-7967-46ce-b889-8454d660aaa4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:57.763155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a106f8f3-7967-46ce-b889-8454d660aaa4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:57.791825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a106f8f3-7967-46ce-b889-8454d660aaa4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042323 Jun 02 19:08:57.792380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 517/1053] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:57.870837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-66baa7a2-2a26-46f2-b72d-a53544016454 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:57.871960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-66baa7a2-2a26-46f2-b72d-a53544016454 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:57.879666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66baa7a2-2a26-46f2-b72d-a53544016454 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:57.880144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66baa7a2-2a26-46f2-b72d-a53544016454 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:57.880922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66baa7a2-2a26-46f2-b72d-a53544016454 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:57.881390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66baa7a2-2a26-46f2-b72d-a53544016454 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:57.953434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-66baa7a2-2a26-46f2-b72d-a53544016454 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:57.961430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-66baa7a2-2a26-46f2-b72d-a53544016454 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098116 Jun 02 19:08:57.962108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 537/1054] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:57 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:58.344583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4e7dea6c-7f7a-4cde-a1e5-b06c90728e06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:58.345506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4e7dea6c-7f7a-4cde-a1e5-b06c90728e06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:58.351599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e7dea6c-7f7a-4cde-a1e5-b06c90728e06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:58.352045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e7dea6c-7f7a-4cde-a1e5-b06c90728e06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:58.352825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e7dea6c-7f7a-4cde-a1e5-b06c90728e06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:58.353253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e7dea6c-7f7a-4cde-a1e5-b06c90728e06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:58.383438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4e7dea6c-7f7a-4cde-a1e5-b06c90728e06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043503 Jun 02 19:08:58.383989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 518/1055] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:58.807773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4012717-17f9-428b-8415-35f75a699712 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:58.809104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c4012717-17f9-428b-8415-35f75a699712 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:58.819590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4012717-17f9-428b-8415-35f75a699712 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:58.820631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4012717-17f9-428b-8415-35f75a699712 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:58.821691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4012717-17f9-428b-8415-35f75a699712 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:58.822386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4012717-17f9-428b-8415-35f75a699712 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:58.853166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c4012717-17f9-428b-8415-35f75a699712 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052475 Jun 02 19:08:58.853709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 538/1056] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:08:58.978433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81e313e2-847e-48d8-8f09-07644985e6a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:58.979044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81e313e2-847e-48d8-8f09-07644985e6a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:58.986386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81e313e2-847e-48d8-8f09-07644985e6a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:58.986844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81e313e2-847e-48d8-8f09-07644985e6a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:58.987624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81e313e2-847e-48d8-8f09-07644985e6a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:58.988057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81e313e2-847e-48d8-8f09-07644985e6a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:59.058980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81e313e2-847e-48d8-8f09-07644985e6a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:08:59.067253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81e313e2-847e-48d8-8f09-07644985e6a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092839 Jun 02 19:08:59.067827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 519/1057] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:08:58 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:08:59.397724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b36fefec-de25-4b3c-8d0d-551c5af5c3a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:59.398842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b36fefec-de25-4b3c-8d0d-551c5af5c3a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:59.408412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b36fefec-de25-4b3c-8d0d-551c5af5c3a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:59.409008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b36fefec-de25-4b3c-8d0d-551c5af5c3a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:59.409977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b36fefec-de25-4b3c-8d0d-551c5af5c3a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:59.410445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b36fefec-de25-4b3c-8d0d-551c5af5c3a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:59.444078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b36fefec-de25-4b3c-8d0d-551c5af5c3a1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051169 Jun 02 19:08:59.444950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 539/1058] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:08:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:08:59.867322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-adcf4c70-65d5-4273-9c4c-803ac5c37f5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:08:59.868264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-adcf4c70-65d5-4273-9c4c-803ac5c37f5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:08:59.876093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-adcf4c70-65d5-4273-9c4c-803ac5c37f5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:59.876542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-adcf4c70-65d5-4273-9c4c-803ac5c37f5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:59.877367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-adcf4c70-65d5-4273-9c4c-803ac5c37f5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:08:59.877782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-adcf4c70-65d5-4273-9c4c-803ac5c37f5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:08:59.902757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:59.911120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-adcf4c70-65d5-4273-9c4c-803ac5c37f5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048595 Jun 02 19:08:59.911718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 520/1059] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:08:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:00.085738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8f2dc03b-570e-4d42-9462-13ecebb616b4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:00.086409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8f2dc03b-570e-4d42-9462-13ecebb616b4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:00.093287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f2dc03b-570e-4d42-9462-13ecebb616b4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:00.093717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f2dc03b-570e-4d42-9462-13ecebb616b4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:00.094547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f2dc03b-570e-4d42-9462-13ecebb616b4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:00.094997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f2dc03b-570e-4d42-9462-13ecebb616b4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:00.164131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8f2dc03b-570e-4d42-9462-13ecebb616b4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:00.172918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8f2dc03b-570e-4d42-9462-13ecebb616b4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091093 Jun 02 19:09:00.173503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 540/1060] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:00 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:00.459138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b479918b-b9c6-4b16-bfff-cd0571e97e7c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:00.460077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b479918b-b9c6-4b16-bfff-cd0571e97e7c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:00.468641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b479918b-b9c6-4b16-bfff-cd0571e97e7c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:00.469169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b479918b-b9c6-4b16-bfff-cd0571e97e7c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:00.470294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b479918b-b9c6-4b16-bfff-cd0571e97e7c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:00.470796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b479918b-b9c6-4b16-bfff-cd0571e97e7c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:00.501629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b479918b-b9c6-4b16-bfff-cd0571e97e7c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048587 Jun 02 19:09:00.502229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 521/1061] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:00.924891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6953f8fb-b0e3-49ed-9a27-9b31488953a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:00.925830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6953f8fb-b0e3-49ed-9a27-9b31488953a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:00.933072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6953f8fb-b0e3-49ed-9a27-9b31488953a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:00.933528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6953f8fb-b0e3-49ed-9a27-9b31488953a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:00.934341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6953f8fb-b0e3-49ed-9a27-9b31488953a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:00.934783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6953f8fb-b0e3-49ed-9a27-9b31488953a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:00.964773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6953f8fb-b0e3-49ed-9a27-9b31488953a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Jun 02 19:09:00.965330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 541/1062] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:01.191778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a2c00550-155a-4267-8353-aa193c68e483 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:01.192380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a2c00550-155a-4267-8353-aa193c68e483 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:01.200781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2c00550-155a-4267-8353-aa193c68e483 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:01.201309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2c00550-155a-4267-8353-aa193c68e483 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:01.202276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2c00550-155a-4267-8353-aa193c68e483 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:01.202784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2c00550-155a-4267-8353-aa193c68e483 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:01.284446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a2c00550-155a-4267-8353-aa193c68e483 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:01.293149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a2c00550-155a-4267-8353-aa193c68e483 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.106076 Jun 02 19:09:01.293714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 522/1063] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:01 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:01.519459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-48ca881e-6076-418a-be8a-e3815f722ff6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:01.520501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-48ca881e-6076-418a-be8a-e3815f722ff6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:01.529864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48ca881e-6076-418a-be8a-e3815f722ff6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:01.530468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48ca881e-6076-418a-be8a-e3815f722ff6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:01.531690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48ca881e-6076-418a-be8a-e3815f722ff6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:01.532258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48ca881e-6076-418a-be8a-e3815f722ff6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:01.562958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-48ca881e-6076-418a-be8a-e3815f722ff6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050047 Jun 02 19:09:01.563580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 542/1064] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:01.976805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bbd87313-9863-4d86-aa86-8fff8c2b1e6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:01.977749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bbd87313-9863-4d86-aa86-8fff8c2b1e6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:01.984536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbd87313-9863-4d86-aa86-8fff8c2b1e6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:01.984989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbd87313-9863-4d86-aa86-8fff8c2b1e6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:01.985753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbd87313-9863-4d86-aa86-8fff8c2b1e6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:01.986215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbd87313-9863-4d86-aa86-8fff8c2b1e6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:02.019985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bbd87313-9863-4d86-aa86-8fff8c2b1e6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047146 Jun 02 19:09:02.020541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 523/1065] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:02.315545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f3dbec5-94ff-4f26-aa01-8e602852187f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:02.316160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5f3dbec5-94ff-4f26-aa01-8e602852187f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:02.323771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f3dbec5-94ff-4f26-aa01-8e602852187f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:02.324201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f3dbec5-94ff-4f26-aa01-8e602852187f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:02.325002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f3dbec5-94ff-4f26-aa01-8e602852187f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:02.325439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f3dbec5-94ff-4f26-aa01-8e602852187f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:02.390141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f3dbec5-94ff-4f26-aa01-8e602852187f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:02.397828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5f3dbec5-94ff-4f26-aa01-8e602852187f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086228 Jun 02 19:09:02.398428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 543/1066] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:02 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:02.576511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54c27b6c-d1e1-492d-8929-b196603f4578 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:02.577355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-54c27b6c-d1e1-492d-8929-b196603f4578 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:02.584521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54c27b6c-d1e1-492d-8929-b196603f4578 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:02.584953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54c27b6c-d1e1-492d-8929-b196603f4578 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:02.585712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54c27b6c-d1e1-492d-8929-b196603f4578 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:02.586175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54c27b6c-d1e1-492d-8929-b196603f4578 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:02.617604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-54c27b6c-d1e1-492d-8929-b196603f4578 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045275 Jun 02 19:09:02.618202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 524/1067] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:03.033046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-df6246c7-1733-4095-9bde-a8ceb9d32176 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:03.034024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-df6246c7-1733-4095-9bde-a8ceb9d32176 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:03.040444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df6246c7-1733-4095-9bde-a8ceb9d32176 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:03.040896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df6246c7-1733-4095-9bde-a8ceb9d32176 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:03.041666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df6246c7-1733-4095-9bde-a8ceb9d32176 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:03.042136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df6246c7-1733-4095-9bde-a8ceb9d32176 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:03.084169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-df6246c7-1733-4095-9bde-a8ceb9d32176 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055689 Jun 02 19:09:03.084725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 544/1068] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:03.421263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-47b51370-fd2c-4df0-bf40-be8063132def tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:03.421843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-47b51370-fd2c-4df0-bf40-be8063132def tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:03.429167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47b51370-fd2c-4df0-bf40-be8063132def tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:03.429666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47b51370-fd2c-4df0-bf40-be8063132def tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:03.430460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47b51370-fd2c-4df0-bf40-be8063132def tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:03.430918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47b51370-fd2c-4df0-bf40-be8063132def tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:03.494698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-47b51370-fd2c-4df0-bf40-be8063132def tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:03.503421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-47b51370-fd2c-4df0-bf40-be8063132def tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086562 Jun 02 19:09:03.503940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 525/1069] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:03 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:03.630588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d7b8614f-7c1b-46dd-8cf1-50c6d09d4f14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:03.631517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d7b8614f-7c1b-46dd-8cf1-50c6d09d4f14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:03.651023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7b8614f-7c1b-46dd-8cf1-50c6d09d4f14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:03.651478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7b8614f-7c1b-46dd-8cf1-50c6d09d4f14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:03.652241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7b8614f-7c1b-46dd-8cf1-50c6d09d4f14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:03.652676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7b8614f-7c1b-46dd-8cf1-50c6d09d4f14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:03.683615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d7b8614f-7c1b-46dd-8cf1-50c6d09d4f14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057628 Jun 02 19:09:03.684087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 545/1070] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:04.098748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9128d258-1ff2-4a68-a5a5-0bedb0f7b578 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:04.100196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9128d258-1ff2-4a68-a5a5-0bedb0f7b578 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:04.110482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9128d258-1ff2-4a68-a5a5-0bedb0f7b578 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:04.110920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9128d258-1ff2-4a68-a5a5-0bedb0f7b578 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:04.111679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9128d258-1ff2-4a68-a5a5-0bedb0f7b578 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:04.112100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9128d258-1ff2-4a68-a5a5-0bedb0f7b578 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:04.142530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9128d258-1ff2-4a68-a5a5-0bedb0f7b578 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050298 Jun 02 19:09:04.143078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 526/1071] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:04.521985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d4d6e323-b9ee-41e0-afda-4964c93047a4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:04.522959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d4d6e323-b9ee-41e0-afda-4964c93047a4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:04.532272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4d6e323-b9ee-41e0-afda-4964c93047a4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:04.532784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4d6e323-b9ee-41e0-afda-4964c93047a4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:04.533572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4d6e323-b9ee-41e0-afda-4964c93047a4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:04.534053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4d6e323-b9ee-41e0-afda-4964c93047a4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:04.603078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4d6e323-b9ee-41e0-afda-4964c93047a4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:04.613454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d4d6e323-b9ee-41e0-afda-4964c93047a4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.096625 Jun 02 19:09:04.614188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 546/1072] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:04 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:04.700181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a22ee521-e994-46ab-be68-ef45caf74efb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:04.701727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a22ee521-e994-46ab-be68-ef45caf74efb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:04.708929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a22ee521-e994-46ab-be68-ef45caf74efb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:04.709380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a22ee521-e994-46ab-be68-ef45caf74efb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:04.710187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a22ee521-e994-46ab-be68-ef45caf74efb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:04.710619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a22ee521-e994-46ab-be68-ef45caf74efb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:04.740269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a22ee521-e994-46ab-be68-ef45caf74efb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047234 Jun 02 19:09:04.740830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 527/1073] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:05.154762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4f86c90a-185e-4994-9641-5d141b4f1950 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:05.155708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4f86c90a-185e-4994-9641-5d141b4f1950 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:05.163146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f86c90a-185e-4994-9641-5d141b4f1950 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:05.163600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f86c90a-185e-4994-9641-5d141b4f1950 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:05.164434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f86c90a-185e-4994-9641-5d141b4f1950 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:05.164791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f86c90a-185e-4994-9641-5d141b4f1950 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:05.196725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4f86c90a-185e-4994-9641-5d141b4f1950 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045936 Jun 02 19:09:05.197334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 547/1074] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:05.631643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e159781a-71b3-4b5e-87a7-9ee5aa5ec3e3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:05.632250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e159781a-71b3-4b5e-87a7-9ee5aa5ec3e3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:05.639503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e159781a-71b3-4b5e-87a7-9ee5aa5ec3e3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:05.639947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e159781a-71b3-4b5e-87a7-9ee5aa5ec3e3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:05.640708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e159781a-71b3-4b5e-87a7-9ee5aa5ec3e3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:05.641682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e159781a-71b3-4b5e-87a7-9ee5aa5ec3e3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:05.708607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e159781a-71b3-4b5e-87a7-9ee5aa5ec3e3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:05.719878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e159781a-71b3-4b5e-87a7-9ee5aa5ec3e3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092214 Jun 02 19:09:05.720434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 528/1075] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:05 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:05.753497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d39251a-0c5b-4e0e-9fb5-305f6808a184 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:05.754639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d39251a-0c5b-4e0e-9fb5-305f6808a184 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:05.761153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d39251a-0c5b-4e0e-9fb5-305f6808a184 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:05.761608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d39251a-0c5b-4e0e-9fb5-305f6808a184 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:05.762416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d39251a-0c5b-4e0e-9fb5-305f6808a184 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:05.762850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d39251a-0c5b-4e0e-9fb5-305f6808a184 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:05.798525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d39251a-0c5b-4e0e-9fb5-305f6808a184 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049870 Jun 02 19:09:05.798987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 548/1076] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:06.212020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8b892f2f-57bb-43bc-9f09-b5d3d203f8e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:06.213285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8b892f2f-57bb-43bc-9f09-b5d3d203f8e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:06.222604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b892f2f-57bb-43bc-9f09-b5d3d203f8e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:06.223235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b892f2f-57bb-43bc-9f09-b5d3d203f8e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:06.224135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b892f2f-57bb-43bc-9f09-b5d3d203f8e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:06.224715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b892f2f-57bb-43bc-9f09-b5d3d203f8e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:06.266602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8b892f2f-57bb-43bc-9f09-b5d3d203f8e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061170 Jun 02 19:09:06.267229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 529/1077] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:06.741312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dabd3e71-9ceb-4a76-91b9-6f99f9719f1f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:06.742325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dabd3e71-9ceb-4a76-91b9-6f99f9719f1f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:06.752039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dabd3e71-9ceb-4a76-91b9-6f99f9719f1f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:06.752490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dabd3e71-9ceb-4a76-91b9-6f99f9719f1f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:06.753253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dabd3e71-9ceb-4a76-91b9-6f99f9719f1f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:06.753689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dabd3e71-9ceb-4a76-91b9-6f99f9719f1f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:06.812204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e80de44e-ebc1-430f-87b4-22d3242a2978 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:06.813763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e80de44e-ebc1-430f-87b4-22d3242a2978 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:06.821092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e80de44e-ebc1-430f-87b4-22d3242a2978 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:06.821548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e80de44e-ebc1-430f-87b4-22d3242a2978 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:06.822353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e80de44e-ebc1-430f-87b4-22d3242a2978 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:06.822940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e80de44e-ebc1-430f-87b4-22d3242a2978 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:06.829346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dabd3e71-9ceb-4a76-91b9-6f99f9719f1f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:06.831658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:06.838518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dabd3e71-9ceb-4a76-91b9-6f99f9719f1f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.104282 Jun 02 19:09:06.839071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 549/1078] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:06 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:06.855588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e80de44e-ebc1-430f-87b4-22d3242a2978 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047525 Jun 02 19:09:06.856135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 530/1079] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:07.280247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-45f63353-5caa-48d7-a2ca-d409c2b168cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:07.281188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-45f63353-5caa-48d7-a2ca-d409c2b168cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:07.288027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45f63353-5caa-48d7-a2ca-d409c2b168cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:07.288484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45f63353-5caa-48d7-a2ca-d409c2b168cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:07.289251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45f63353-5caa-48d7-a2ca-d409c2b168cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:07.289693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45f63353-5caa-48d7-a2ca-d409c2b168cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:07.319153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-45f63353-5caa-48d7-a2ca-d409c2b168cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043177 Jun 02 19:09:07.320048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 550/1080] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:07.858844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6e9fdccb-9308-4a8c-8e33-b6bfd1b3429d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:07.859416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6e9fdccb-9308-4a8c-8e33-b6bfd1b3429d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:07.866701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e9fdccb-9308-4a8c-8e33-b6bfd1b3429d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:07.867149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e9fdccb-9308-4a8c-8e33-b6bfd1b3429d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:07.867504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b9417add-90c8-411b-94c9-130e3afef3f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:07.868017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e9fdccb-9308-4a8c-8e33-b6bfd1b3429d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:07.868350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e9fdccb-9308-4a8c-8e33-b6bfd1b3429d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:07.868502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b9417add-90c8-411b-94c9-130e3afef3f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:07.875409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9417add-90c8-411b-94c9-130e3afef3f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:07.875898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9417add-90c8-411b-94c9-130e3afef3f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:07.876673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9417add-90c8-411b-94c9-130e3afef3f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:07.877161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9417add-90c8-411b-94c9-130e3afef3f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:07.907981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b9417add-90c8-411b-94c9-130e3afef3f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Jun 02 19:09:07.908889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 551/1081] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:07.931561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6e9fdccb-9308-4a8c-8e33-b6bfd1b3429d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:07.939834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6e9fdccb-9308-4a8c-8e33-b6bfd1b3429d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084951 Jun 02 19:09:07.940395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 531/1082] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:07 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:08.332320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3727fc6f-35cf-440c-a583-c290579df1e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:08.333425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3727fc6f-35cf-440c-a583-c290579df1e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:08.339866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3727fc6f-35cf-440c-a583-c290579df1e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:08.340325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3727fc6f-35cf-440c-a583-c290579df1e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:08.341102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3727fc6f-35cf-440c-a583-c290579df1e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:08.341543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3727fc6f-35cf-440c-a583-c290579df1e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:08.372835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3727fc6f-35cf-440c-a583-c290579df1e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045478 Jun 02 19:09:08.373428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 552/1083] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:08.920298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-58e6203d-9fc7-468d-b1c5-41b48d496159 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:08.921219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-58e6203d-9fc7-468d-b1c5-41b48d496159 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:08.928236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58e6203d-9fc7-468d-b1c5-41b48d496159 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:08.928713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58e6203d-9fc7-468d-b1c5-41b48d496159 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:08.929478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58e6203d-9fc7-468d-b1c5-41b48d496159 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:08.930382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58e6203d-9fc7-468d-b1c5-41b48d496159 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:08.957604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4037fbf3-5fe9-46c7-beef-07da563fe8e0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:08.958236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4037fbf3-5fe9-46c7-beef-07da563fe8e0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:08.961683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-58e6203d-9fc7-468d-b1c5-41b48d496159 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045451 Jun 02 19:09:08.962303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 532/1084] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:08.965785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4037fbf3-5fe9-46c7-beef-07da563fe8e0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:08.966271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4037fbf3-5fe9-46c7-beef-07da563fe8e0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:08.967031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4037fbf3-5fe9-46c7-beef-07da563fe8e0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:08.967481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4037fbf3-5fe9-46c7-beef-07da563fe8e0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:09.029708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4037fbf3-5fe9-46c7-beef-07da563fe8e0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:09.037837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4037fbf3-5fe9-46c7-beef-07da563fe8e0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084526 Jun 02 19:09:09.038470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 553/1085] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:08 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:09:09.385306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2bff65f4-8a74-4cc9-a165-33c440e0abfd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:09.386324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2bff65f4-8a74-4cc9-a165-33c440e0abfd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:09.393364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bff65f4-8a74-4cc9-a165-33c440e0abfd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:09.393868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bff65f4-8a74-4cc9-a165-33c440e0abfd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:09.394766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bff65f4-8a74-4cc9-a165-33c440e0abfd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:09.395218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bff65f4-8a74-4cc9-a165-33c440e0abfd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:09.425252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2bff65f4-8a74-4cc9-a165-33c440e0abfd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Jun 02 19:09:09.425785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 533/1086] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:09.977273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-61075012-1815-4a45-8114-2a80785abdc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:09.978412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-61075012-1815-4a45-8114-2a80785abdc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:09.987324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61075012-1815-4a45-8114-2a80785abdc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:09.988023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61075012-1815-4a45-8114-2a80785abdc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:09.988931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61075012-1815-4a45-8114-2a80785abdc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:09.989382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61075012-1815-4a45-8114-2a80785abdc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:10.019352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-61075012-1815-4a45-8114-2a80785abdc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048010 Jun 02 19:09:10.019901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 554/1087] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:10.056434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d148cc67-a54f-4a19-86f1-f4b1baa45860 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:10.057000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d148cc67-a54f-4a19-86f1-f4b1baa45860 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:10.066195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d148cc67-a54f-4a19-86f1-f4b1baa45860 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:10.066706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d148cc67-a54f-4a19-86f1-f4b1baa45860 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:10.067478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d148cc67-a54f-4a19-86f1-f4b1baa45860 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:10.067922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d148cc67-a54f-4a19-86f1-f4b1baa45860 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:10.133197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d148cc67-a54f-4a19-86f1-f4b1baa45860 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:10.141954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d148cc67-a54f-4a19-86f1-f4b1baa45860 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090819 Jun 02 19:09:10.142517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 534/1088] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:10 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:10.437113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3c8dc8ef-40e2-49c0-922e-fd47239da322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:10.438063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3c8dc8ef-40e2-49c0-922e-fd47239da322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:10.444801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c8dc8ef-40e2-49c0-922e-fd47239da322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:10.445248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c8dc8ef-40e2-49c0-922e-fd47239da322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:10.446042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c8dc8ef-40e2-49c0-922e-fd47239da322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:10.446496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c8dc8ef-40e2-49c0-922e-fd47239da322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:10.476413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3c8dc8ef-40e2-49c0-922e-fd47239da322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043410 Jun 02 19:09:10.476961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 555/1089] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:11.031608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a8a4862b-84e9-46d0-bcb0-a9dbfd5ac5b9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:11.032541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a8a4862b-84e9-46d0-bcb0-a9dbfd5ac5b9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:11.039655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8a4862b-84e9-46d0-bcb0-a9dbfd5ac5b9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:11.040106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8a4862b-84e9-46d0-bcb0-a9dbfd5ac5b9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:11.040881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8a4862b-84e9-46d0-bcb0-a9dbfd5ac5b9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:11.041319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8a4862b-84e9-46d0-bcb0-a9dbfd5ac5b9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:11.073730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a8a4862b-84e9-46d0-bcb0-a9dbfd5ac5b9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046197 Jun 02 19:09:11.074439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 535/1090] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:11.164585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ef6e5ba2-88d4-4beb-a7d3-069dcc792701 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:11.165189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ef6e5ba2-88d4-4beb-a7d3-069dcc792701 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:11.172686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef6e5ba2-88d4-4beb-a7d3-069dcc792701 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:11.173201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef6e5ba2-88d4-4beb-a7d3-069dcc792701 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:11.174200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef6e5ba2-88d4-4beb-a7d3-069dcc792701 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:11.174648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef6e5ba2-88d4-4beb-a7d3-069dcc792701 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:11.249098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ef6e5ba2-88d4-4beb-a7d3-069dcc792701 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:11.257101 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ef6e5ba2-88d4-4beb-a7d3-069dcc792701 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.096863 Jun 02 19:09:11.258224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 556/1091] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:11 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:11.487906 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bf0828e7-dec2-4bf9-8cf1-bbd7f866dac7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:11.488862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bf0828e7-dec2-4bf9-8cf1-bbd7f866dac7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:11.495874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf0828e7-dec2-4bf9-8cf1-bbd7f866dac7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:11.496314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf0828e7-dec2-4bf9-8cf1-bbd7f866dac7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:11.497064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf0828e7-dec2-4bf9-8cf1-bbd7f866dac7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:11.497487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf0828e7-dec2-4bf9-8cf1-bbd7f866dac7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:11.530146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bf0828e7-dec2-4bf9-8cf1-bbd7f866dac7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046215 Jun 02 19:09:11.530709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 536/1092] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:12.088037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3976c0a7-c5d5-4ae0-9643-a2a422fc77e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:12.088956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3976c0a7-c5d5-4ae0-9643-a2a422fc77e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:12.095671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3976c0a7-c5d5-4ae0-9643-a2a422fc77e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:12.096122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3976c0a7-c5d5-4ae0-9643-a2a422fc77e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:12.096877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3976c0a7-c5d5-4ae0-9643-a2a422fc77e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:12.097313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3976c0a7-c5d5-4ae0-9643-a2a422fc77e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:12.128329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3976c0a7-c5d5-4ae0-9643-a2a422fc77e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046595 Jun 02 19:09:12.128926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 557/1093] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:12.275663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-880a5814-95be-43dc-9eeb-75a3288b574a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:12.276264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-880a5814-95be-43dc-9eeb-75a3288b574a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:12.278614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=82 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:12.284325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-880a5814-95be-43dc-9eeb-75a3288b574a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:12.284781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-880a5814-95be-43dc-9eeb-75a3288b574a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:12.285527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-880a5814-95be-43dc-9eeb-75a3288b574a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:12.285990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-880a5814-95be-43dc-9eeb-75a3288b574a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:12.301356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:12.354681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-880a5814-95be-43dc-9eeb-75a3288b574a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:12.362750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-880a5814-95be-43dc-9eeb-75a3288b574a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091160 Jun 02 19:09:12.363315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 537/1094] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:12 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:12.543211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e4a77a6-0cb3-4570-a876-d760406adff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:12.544146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e4a77a6-0cb3-4570-a876-d760406adff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:12.551092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e4a77a6-0cb3-4570-a876-d760406adff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:12.551545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e4a77a6-0cb3-4570-a876-d760406adff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:12.552314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e4a77a6-0cb3-4570-a876-d760406adff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:12.552747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e4a77a6-0cb3-4570-a876-d760406adff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:12.586680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e4a77a6-0cb3-4570-a876-d760406adff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048485 Jun 02 19:09:12.587421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 558/1095] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:13.143422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2762763b-7f2b-4fb2-b1dd-d5d4a01e0d62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:13.144369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2762763b-7f2b-4fb2-b1dd-d5d4a01e0d62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:13.151459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2762763b-7f2b-4fb2-b1dd-d5d4a01e0d62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:13.151883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2762763b-7f2b-4fb2-b1dd-d5d4a01e0d62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:13.152647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2762763b-7f2b-4fb2-b1dd-d5d4a01e0d62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:13.153136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2762763b-7f2b-4fb2-b1dd-d5d4a01e0d62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:13.190285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2762763b-7f2b-4fb2-b1dd-d5d4a01e0d62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050745 Jun 02 19:09:13.190903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 538/1096] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:13.385645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0f8ba2bc-8b49-4d24-a037-8b84096b555a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:13.386644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0f8ba2bc-8b49-4d24-a037-8b84096b555a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:13.393655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f8ba2bc-8b49-4d24-a037-8b84096b555a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:13.394254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f8ba2bc-8b49-4d24-a037-8b84096b555a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:13.395020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f8ba2bc-8b49-4d24-a037-8b84096b555a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:13.395452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f8ba2bc-8b49-4d24-a037-8b84096b555a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:13.474341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0f8ba2bc-8b49-4d24-a037-8b84096b555a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:13.483286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0f8ba2bc-8b49-4d24-a037-8b84096b555a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.105947 Jun 02 19:09:13.483854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 559/1097] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:13 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:13.601517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c434b93c-4f67-417f-9e58-f68e9fb6ff20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:13.602864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c434b93c-4f67-417f-9e58-f68e9fb6ff20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:13.612132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c434b93c-4f67-417f-9e58-f68e9fb6ff20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:13.612729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c434b93c-4f67-417f-9e58-f68e9fb6ff20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:13.613739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c434b93c-4f67-417f-9e58-f68e9fb6ff20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:13.614357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c434b93c-4f67-417f-9e58-f68e9fb6ff20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:13.646466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c434b93c-4f67-417f-9e58-f68e9fb6ff20 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050099 Jun 02 19:09:13.646933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 539/1098] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:14.206063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-41feaa08-f175-4e23-a3f2-b94edc1a90bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:14.207198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-41feaa08-f175-4e23-a3f2-b94edc1a90bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:14.210631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=88 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:14.217016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41feaa08-f175-4e23-a3f2-b94edc1a90bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:14.217464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41feaa08-f175-4e23-a3f2-b94edc1a90bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:14.218257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41feaa08-f175-4e23-a3f2-b94edc1a90bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:14.218690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41feaa08-f175-4e23-a3f2-b94edc1a90bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:14.249231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-41feaa08-f175-4e23-a3f2-b94edc1a90bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049433 Jun 02 19:09:14.249822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 560/1099] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:14.507006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3d597ba-cd84-44f1-ae55-a9577df4e37e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:14.507612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c3d597ba-cd84-44f1-ae55-a9577df4e37e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:14.515319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3d597ba-cd84-44f1-ae55-a9577df4e37e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:14.515788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3d597ba-cd84-44f1-ae55-a9577df4e37e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:14.516634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3d597ba-cd84-44f1-ae55-a9577df4e37e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:14.517062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3d597ba-cd84-44f1-ae55-a9577df4e37e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:14.588763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c3d597ba-cd84-44f1-ae55-a9577df4e37e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:14.600733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3d597ba-cd84-44f1-ae55-a9577df4e37e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098316 Jun 02 19:09:14.601656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 540/1100] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:14 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:14.661359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-05f483cc-c006-4222-a0a5-33543d68f068 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:14.662808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-05f483cc-c006-4222-a0a5-33543d68f068 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:14.670700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05f483cc-c006-4222-a0a5-33543d68f068 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:14.671180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05f483cc-c006-4222-a0a5-33543d68f068 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:14.672158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05f483cc-c006-4222-a0a5-33543d68f068 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:14.672637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05f483cc-c006-4222-a0a5-33543d68f068 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:14.702911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-05f483cc-c006-4222-a0a5-33543d68f068 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047523 Jun 02 19:09:14.703463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 561/1101] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:15.262829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4438265d-4e2b-4e16-b0f9-569c6018a4d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:15.263766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4438265d-4e2b-4e16-b0f9-569c6018a4d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:15.272384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4438265d-4e2b-4e16-b0f9-569c6018a4d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:15.272950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4438265d-4e2b-4e16-b0f9-569c6018a4d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:15.273956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4438265d-4e2b-4e16-b0f9-569c6018a4d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:15.275455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4438265d-4e2b-4e16-b0f9-569c6018a4d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:15.306632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4438265d-4e2b-4e16-b0f9-569c6018a4d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048425 Jun 02 19:09:15.307197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 541/1102] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:15.621455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-39824b76-6cc8-4fc1-bdef-d88c3e6cbd3f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:15.622138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-39824b76-6cc8-4fc1-bdef-d88c3e6cbd3f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:15.629398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39824b76-6cc8-4fc1-bdef-d88c3e6cbd3f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:15.630019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39824b76-6cc8-4fc1-bdef-d88c3e6cbd3f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:15.630905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39824b76-6cc8-4fc1-bdef-d88c3e6cbd3f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:15.631389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39824b76-6cc8-4fc1-bdef-d88c3e6cbd3f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:15.703729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-39824b76-6cc8-4fc1-bdef-d88c3e6cbd3f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:15.713486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-39824b76-6cc8-4fc1-bdef-d88c3e6cbd3f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097930 Jun 02 19:09:15.714699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 562/1103] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:15 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:15.716014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-615c0f14-cef2-4e57-bb97-f8983f13e1e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:15.717026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-615c0f14-cef2-4e57-bb97-f8983f13e1e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:15.724208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-615c0f14-cef2-4e57-bb97-f8983f13e1e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:15.724714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-615c0f14-cef2-4e57-bb97-f8983f13e1e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:15.725571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-615c0f14-cef2-4e57-bb97-f8983f13e1e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:15.726257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-615c0f14-cef2-4e57-bb97-f8983f13e1e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:15.761050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-615c0f14-cef2-4e57-bb97-f8983f13e1e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049650 Jun 02 19:09:15.761590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 542/1104] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:16.320123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-587c165c-200d-4b72-8881-e2c7024daad2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:16.321064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-587c165c-200d-4b72-8881-e2c7024daad2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:16.327537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-587c165c-200d-4b72-8881-e2c7024daad2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:16.327996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-587c165c-200d-4b72-8881-e2c7024daad2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:16.328799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-587c165c-200d-4b72-8881-e2c7024daad2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:16.329239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-587c165c-200d-4b72-8881-e2c7024daad2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:16.361976 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-587c165c-200d-4b72-8881-e2c7024daad2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046266 Jun 02 19:09:16.362891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 563/1105] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:16.732072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-400ada2e-0e76-4b3f-a54f-a9d18e573aa6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:16.732684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-400ada2e-0e76-4b3f-a54f-a9d18e573aa6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:16.739632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-400ada2e-0e76-4b3f-a54f-a9d18e573aa6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:16.740081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-400ada2e-0e76-4b3f-a54f-a9d18e573aa6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:16.740841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-400ada2e-0e76-4b3f-a54f-a9d18e573aa6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:16.741259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-400ada2e-0e76-4b3f-a54f-a9d18e573aa6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:16.775159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-747779f5-e363-488b-a8f6-bfbe54bbf871 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:16.776163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-747779f5-e363-488b-a8f6-bfbe54bbf871 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:16.783299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-747779f5-e363-488b-a8f6-bfbe54bbf871 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:16.783715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-747779f5-e363-488b-a8f6-bfbe54bbf871 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:16.784498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-747779f5-e363-488b-a8f6-bfbe54bbf871 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:16.784944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-747779f5-e363-488b-a8f6-bfbe54bbf871 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:16.804542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-400ada2e-0e76-4b3f-a54f-a9d18e573aa6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:16.812429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-400ada2e-0e76-4b3f-a54f-a9d18e573aa6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085225 Jun 02 19:09:16.812998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 543/1106] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:16 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:16.815738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-747779f5-e363-488b-a8f6-bfbe54bbf871 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Jun 02 19:09:16.816303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 564/1107] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:17.378068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-13b87031-3c2e-4b69-a044-e9727d45df53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:17.379119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-13b87031-3c2e-4b69-a044-e9727d45df53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:17.388239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-13b87031-3c2e-4b69-a044-e9727d45df53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:17.388691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-13b87031-3c2e-4b69-a044-e9727d45df53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:17.389452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-13b87031-3c2e-4b69-a044-e9727d45df53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:17.389922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-13b87031-3c2e-4b69-a044-e9727d45df53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:17.421580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-13b87031-3c2e-4b69-a044-e9727d45df53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049371 Jun 02 19:09:17.422169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 544/1108] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:17.829038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-223c912c-69c4-4bb6-8eb6-80ded3394c84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:17.829662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3c3e61b0-1d50-4c34-b9c8-6d84d0de9e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:17.830053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-223c912c-69c4-4bb6-8eb6-80ded3394c84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:17.830345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3c3e61b0-1d50-4c34-b9c8-6d84d0de9e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:17.836957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c3e61b0-1d50-4c34-b9c8-6d84d0de9e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:17.837142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-223c912c-69c4-4bb6-8eb6-80ded3394c84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:17.837429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c3e61b0-1d50-4c34-b9c8-6d84d0de9e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:17.837582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-223c912c-69c4-4bb6-8eb6-80ded3394c84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:17.838222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c3e61b0-1d50-4c34-b9c8-6d84d0de9e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:17.838368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-223c912c-69c4-4bb6-8eb6-80ded3394c84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:17.838649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c3e61b0-1d50-4c34-b9c8-6d84d0de9e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:17.838791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-223c912c-69c4-4bb6-8eb6-80ded3394c84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:17.868394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-223c912c-69c4-4bb6-8eb6-80ded3394c84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043371 Jun 02 19:09:17.868979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 565/1109] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:17.903230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3c3e61b0-1d50-4c34-b9c8-6d84d0de9e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:17.917215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3c3e61b0-1d50-4c34-b9c8-6d84d0de9e86 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091293 Jun 02 19:09:17.917826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 545/1110] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:17 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:18.438746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-104099e0-a768-426c-9417-274d455a6204 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:18.440440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-104099e0-a768-426c-9417-274d455a6204 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:18.450745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-104099e0-a768-426c-9417-274d455a6204 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:18.451196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-104099e0-a768-426c-9417-274d455a6204 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:18.451960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-104099e0-a768-426c-9417-274d455a6204 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:18.452399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-104099e0-a768-426c-9417-274d455a6204 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:18.466755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:18.482618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-104099e0-a768-426c-9417-274d455a6204 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051580 Jun 02 19:09:18.483162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 566/1111] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:18.884126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-be454f55-4c27-4da7-8f6e-8f3de9acb469 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:18.885640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-be454f55-4c27-4da7-8f6e-8f3de9acb469 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:18.893353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be454f55-4c27-4da7-8f6e-8f3de9acb469 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:18.893818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be454f55-4c27-4da7-8f6e-8f3de9acb469 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:18.894606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be454f55-4c27-4da7-8f6e-8f3de9acb469 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:18.895031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be454f55-4c27-4da7-8f6e-8f3de9acb469 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:18.923686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-be454f55-4c27-4da7-8f6e-8f3de9acb469 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046353 Jun 02 19:09:18.924656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 546/1112] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:18.940963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7bfc1db2-b748-4f51-b3d1-c5d9a06d9cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:18.942005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7bfc1db2-b748-4f51-b3d1-c5d9a06d9cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:18.949540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7bfc1db2-b748-4f51-b3d1-c5d9a06d9cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:18.950124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7bfc1db2-b748-4f51-b3d1-c5d9a06d9cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:18.950908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7bfc1db2-b748-4f51-b3d1-c5d9a06d9cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:18.951350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7bfc1db2-b748-4f51-b3d1-c5d9a06d9cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:19.021721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7bfc1db2-b748-4f51-b3d1-c5d9a06d9cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:19.030837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7bfc1db2-b748-4f51-b3d1-c5d9a06d9cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097450 Jun 02 19:09:19.031390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 567/1113] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:18 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:19.500083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-302b8672-04a5-475c-a8b1-ae11d84b9c59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:19.501131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-302b8672-04a5-475c-a8b1-ae11d84b9c59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:19.508488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-302b8672-04a5-475c-a8b1-ae11d84b9c59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:19.509013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-302b8672-04a5-475c-a8b1-ae11d84b9c59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:19.509875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-302b8672-04a5-475c-a8b1-ae11d84b9c59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:19.510375 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-302b8672-04a5-475c-a8b1-ae11d84b9c59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:19.543812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-302b8672-04a5-475c-a8b1-ae11d84b9c59 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050159 Jun 02 19:09:19.544380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 547/1114] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:19.938476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92dcbee8-9d01-4795-b281-2eaec27c5cb3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:19.939415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92dcbee8-9d01-4795-b281-2eaec27c5cb3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:19.946158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92dcbee8-9d01-4795-b281-2eaec27c5cb3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:19.946856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92dcbee8-9d01-4795-b281-2eaec27c5cb3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:19.947392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92dcbee8-9d01-4795-b281-2eaec27c5cb3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:19.947828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92dcbee8-9d01-4795-b281-2eaec27c5cb3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:19.978420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92dcbee8-9d01-4795-b281-2eaec27c5cb3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045249 Jun 02 19:09:19.978979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 568/1115] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:20.048550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92d77a1b-ddca-41a1-9302-a9d22718c4a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:20.049141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92d77a1b-ddca-41a1-9302-a9d22718c4a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:20.055789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92d77a1b-ddca-41a1-9302-a9d22718c4a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:20.056237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92d77a1b-ddca-41a1-9302-a9d22718c4a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:20.056989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92d77a1b-ddca-41a1-9302-a9d22718c4a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:20.057420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92d77a1b-ddca-41a1-9302-a9d22718c4a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:20.122258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-92d77a1b-ddca-41a1-9302-a9d22718c4a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:20.131156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92d77a1b-ddca-41a1-9302-a9d22718c4a0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086823 Jun 02 19:09:20.131717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 548/1116] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:20 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:20.560932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7e5bc950-bfd3-4158-b155-94276c8a831c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:20.562185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7e5bc950-bfd3-4158-b155-94276c8a831c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:20.571994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e5bc950-bfd3-4158-b155-94276c8a831c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:20.572575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e5bc950-bfd3-4158-b155-94276c8a831c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:20.573650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e5bc950-bfd3-4158-b155-94276c8a831c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:20.574140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e5bc950-bfd3-4158-b155-94276c8a831c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:20.605157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7e5bc950-bfd3-4158-b155-94276c8a831c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051739 Jun 02 19:09:20.605719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 569/1117] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:20.994989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2e751ef9-d4b5-4300-a934-dd3232d078f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:20.995969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2e751ef9-d4b5-4300-a934-dd3232d078f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:21.005176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e751ef9-d4b5-4300-a934-dd3232d078f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:21.005176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e751ef9-d4b5-4300-a934-dd3232d078f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:21.006309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e751ef9-d4b5-4300-a934-dd3232d078f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:21.007015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e751ef9-d4b5-4300-a934-dd3232d078f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:21.039135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2e751ef9-d4b5-4300-a934-dd3232d078f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048873 Jun 02 19:09:21.039689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 549/1118] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:21.148706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f979f39d-5cee-4d36-8dd6-9ef19c201bf0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:21.149300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f979f39d-5cee-4d36-8dd6-9ef19c201bf0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:21.156125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f979f39d-5cee-4d36-8dd6-9ef19c201bf0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:21.156787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f979f39d-5cee-4d36-8dd6-9ef19c201bf0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:21.157726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f979f39d-5cee-4d36-8dd6-9ef19c201bf0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:21.158200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f979f39d-5cee-4d36-8dd6-9ef19c201bf0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:21.242539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f979f39d-5cee-4d36-8dd6-9ef19c201bf0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:21.253442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f979f39d-5cee-4d36-8dd6-9ef19c201bf0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.108464 Jun 02 19:09:21.254174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 570/1119] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:21 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:21.620793 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1fd3899a-6831-452e-a814-cb67db95d0e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:21.621958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1fd3899a-6831-452e-a814-cb67db95d0e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:21.630418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fd3899a-6831-452e-a814-cb67db95d0e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:21.630868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fd3899a-6831-452e-a814-cb67db95d0e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:21.631613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fd3899a-6831-452e-a814-cb67db95d0e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:21.632053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fd3899a-6831-452e-a814-cb67db95d0e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:21.661126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1fd3899a-6831-452e-a814-cb67db95d0e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047107 Jun 02 19:09:21.661673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 550/1120] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:22.050933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8fc0eedf-96c1-4de3-baac-0a5842fd134c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:22.051915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8fc0eedf-96c1-4de3-baac-0a5842fd134c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:22.058599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc0eedf-96c1-4de3-baac-0a5842fd134c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:22.059056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc0eedf-96c1-4de3-baac-0a5842fd134c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:22.059835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc0eedf-96c1-4de3-baac-0a5842fd134c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:22.060275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc0eedf-96c1-4de3-baac-0a5842fd134c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:22.091057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8fc0eedf-96c1-4de3-baac-0a5842fd134c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Jun 02 19:09:22.091610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 571/1121] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:22.327658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-67fb62be-336a-457e-927c-65f623d8facf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:22.328268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-67fb62be-336a-457e-927c-65f623d8facf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:22.335457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67fb62be-336a-457e-927c-65f623d8facf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:22.335931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67fb62be-336a-457e-927c-65f623d8facf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:22.336698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67fb62be-336a-457e-927c-65f623d8facf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:22.337131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67fb62be-336a-457e-927c-65f623d8facf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:22.411090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67fb62be-336a-457e-927c-65f623d8facf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:22.419209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-67fb62be-336a-457e-927c-65f623d8facf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095460 Jun 02 19:09:22.420016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 551/1122] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:22 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:22.677760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-13b4d997-e039-4ce5-8e24-d9a154238f21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:22.678804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-13b4d997-e039-4ce5-8e24-d9a154238f21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:22.686485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13b4d997-e039-4ce5-8e24-d9a154238f21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:22.686984 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13b4d997-e039-4ce5-8e24-d9a154238f21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:22.687828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13b4d997-e039-4ce5-8e24-d9a154238f21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:22.688314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13b4d997-e039-4ce5-8e24-d9a154238f21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:22.722011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-13b4d997-e039-4ce5-8e24-d9a154238f21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049389 Jun 02 19:09:22.722555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 572/1123] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:23.106588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60b732eb-a7be-4b17-b120-26145fd04ffc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:23.107647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-60b732eb-a7be-4b17-b120-26145fd04ffc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:23.116716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60b732eb-a7be-4b17-b120-26145fd04ffc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:23.117350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60b732eb-a7be-4b17-b120-26145fd04ffc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:23.118584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60b732eb-a7be-4b17-b120-26145fd04ffc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:23.119272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60b732eb-a7be-4b17-b120-26145fd04ffc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:23.151552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-60b732eb-a7be-4b17-b120-26145fd04ffc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051163 Jun 02 19:09:23.152105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 552/1124] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:23.441141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c1d3f905-ab56-469c-89c3-86bfe6e30e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:23.442930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c1d3f905-ab56-469c-89c3-86bfe6e30e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:23.453658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d3f905-ab56-469c-89c3-86bfe6e30e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:23.454469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d3f905-ab56-469c-89c3-86bfe6e30e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:23.455922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d3f905-ab56-469c-89c3-86bfe6e30e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:23.457276 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d3f905-ab56-469c-89c3-86bfe6e30e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:23.531823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c1d3f905-ab56-469c-89c3-86bfe6e30e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:23.540767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c1d3f905-ab56-469c-89c3-86bfe6e30e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.106601 Jun 02 19:09:23.541369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 573/1125] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:23 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:23.736438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dbb89766-ba8f-4704-902b-faf7ef7bf7a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:23.737586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dbb89766-ba8f-4704-902b-faf7ef7bf7a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:23.746614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbb89766-ba8f-4704-902b-faf7ef7bf7a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:23.747265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbb89766-ba8f-4704-902b-faf7ef7bf7a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:23.748308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbb89766-ba8f-4704-902b-faf7ef7bf7a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:23.748902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbb89766-ba8f-4704-902b-faf7ef7bf7a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:23.779724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dbb89766-ba8f-4704-902b-faf7ef7bf7a2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048759 Jun 02 19:09:23.780256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 553/1126] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:24.165590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8910d0eb-eca8-417b-9c0a-b210b8ed41f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:24.166737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8910d0eb-eca8-417b-9c0a-b210b8ed41f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:24.176441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8910d0eb-eca8-417b-9c0a-b210b8ed41f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:24.176898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8910d0eb-eca8-417b-9c0a-b210b8ed41f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:24.177702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8910d0eb-eca8-417b-9c0a-b210b8ed41f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:24.178174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8910d0eb-eca8-417b-9c0a-b210b8ed41f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:24.207492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8910d0eb-eca8-417b-9c0a-b210b8ed41f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 Jun 02 19:09:24.208085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 574/1127] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:24.558303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad4426b2-704e-4570-84f0-789c53fd50f7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:24.558828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad4426b2-704e-4570-84f0-789c53fd50f7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:24.566718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad4426b2-704e-4570-84f0-789c53fd50f7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:24.567144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad4426b2-704e-4570-84f0-789c53fd50f7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:24.567920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad4426b2-704e-4570-84f0-789c53fd50f7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:24.568364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad4426b2-704e-4570-84f0-789c53fd50f7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:24.571372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:24.646156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad4426b2-704e-4570-84f0-789c53fd50f7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:24.654278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad4426b2-704e-4570-84f0-789c53fd50f7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.100032 Jun 02 19:09:24.654845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 554/1128] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:24 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:24.793196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a5ce4a7-b216-4424-9997-a6f39ebd0214 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:24.794161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a5ce4a7-b216-4424-9997-a6f39ebd0214 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:24.800831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a5ce4a7-b216-4424-9997-a6f39ebd0214 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:24.801302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a5ce4a7-b216-4424-9997-a6f39ebd0214 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:24.802104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a5ce4a7-b216-4424-9997-a6f39ebd0214 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:24.802544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a5ce4a7-b216-4424-9997-a6f39ebd0214 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:24.832626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a5ce4a7-b216-4424-9997-a6f39ebd0214 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043412 Jun 02 19:09:24.833173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 575/1129] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:25.222429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-beb16ff8-7e77-48c1-85e3-8ee27d500fa6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:25.223688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-beb16ff8-7e77-48c1-85e3-8ee27d500fa6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:25.230560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-beb16ff8-7e77-48c1-85e3-8ee27d500fa6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:25.231006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-beb16ff8-7e77-48c1-85e3-8ee27d500fa6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:25.231765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-beb16ff8-7e77-48c1-85e3-8ee27d500fa6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:25.232196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-beb16ff8-7e77-48c1-85e3-8ee27d500fa6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:25.262625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-beb16ff8-7e77-48c1-85e3-8ee27d500fa6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Jun 02 19:09:25.263190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 555/1130] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:25.671678 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1890cdd7-85cf-4acb-9a40-0e6a72bc8bf4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:25.672290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1890cdd7-85cf-4acb-9a40-0e6a72bc8bf4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:25.679475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1890cdd7-85cf-4acb-9a40-0e6a72bc8bf4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:25.679924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1890cdd7-85cf-4acb-9a40-0e6a72bc8bf4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:25.680685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1890cdd7-85cf-4acb-9a40-0e6a72bc8bf4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:25.681123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1890cdd7-85cf-4acb-9a40-0e6a72bc8bf4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:25.750693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1890cdd7-85cf-4acb-9a40-0e6a72bc8bf4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:25.760585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1890cdd7-85cf-4acb-9a40-0e6a72bc8bf4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092854 Jun 02 19:09:25.761176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 576/1131] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:25 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:25.848030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eae1a509-aa36-47e0-8c03-5c5e54fa1f41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:25.849064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-eae1a509-aa36-47e0-8c03-5c5e54fa1f41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:25.857206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eae1a509-aa36-47e0-8c03-5c5e54fa1f41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:25.857778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eae1a509-aa36-47e0-8c03-5c5e54fa1f41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:25.858934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eae1a509-aa36-47e0-8c03-5c5e54fa1f41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:25.859568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eae1a509-aa36-47e0-8c03-5c5e54fa1f41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:25.901905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-eae1a509-aa36-47e0-8c03-5c5e54fa1f41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060552 Jun 02 19:09:25.902504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 556/1132] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:26.276130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4f3fe7a1-6aca-4ab3-a3f9-93d343f90012 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:26.277066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4f3fe7a1-6aca-4ab3-a3f9-93d343f90012 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:26.283645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f3fe7a1-6aca-4ab3-a3f9-93d343f90012 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:26.284099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f3fe7a1-6aca-4ab3-a3f9-93d343f90012 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:26.284859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f3fe7a1-6aca-4ab3-a3f9-93d343f90012 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:26.285290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f3fe7a1-6aca-4ab3-a3f9-93d343f90012 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:26.317293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4f3fe7a1-6aca-4ab3-a3f9-93d343f90012 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Jun 02 19:09:26.318522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 577/1133] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:26.780602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ec32e90c-849e-4444-8761-1e3d6c233bbb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:26.781505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ec32e90c-849e-4444-8761-1e3d6c233bbb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:26.790219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec32e90c-849e-4444-8761-1e3d6c233bbb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:26.790602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec32e90c-849e-4444-8761-1e3d6c233bbb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:26.791357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec32e90c-849e-4444-8761-1e3d6c233bbb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:26.791783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec32e90c-849e-4444-8761-1e3d6c233bbb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:26.861619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ec32e90c-849e-4444-8761-1e3d6c233bbb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:26.869651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ec32e90c-849e-4444-8761-1e3d6c233bbb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095253 Jun 02 19:09:26.870278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 557/1134] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:26 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:26.917338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-84a9b8e7-4553-47d6-8864-e0a149752f40 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:26.917914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-84a9b8e7-4553-47d6-8864-e0a149752f40 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:26.927780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84a9b8e7-4553-47d6-8864-e0a149752f40 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:26.928222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84a9b8e7-4553-47d6-8864-e0a149752f40 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:26.929508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84a9b8e7-4553-47d6-8864-e0a149752f40 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:26.929982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84a9b8e7-4553-47d6-8864-e0a149752f40 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:26.961589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-84a9b8e7-4553-47d6-8864-e0a149752f40 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050445 Jun 02 19:09:26.962169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 578/1135] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:27.331704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a950b3b4-a695-4b70-8c80-3d8bdb6022bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:27.332634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a950b3b4-a695-4b70-8c80-3d8bdb6022bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:27.339449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a950b3b4-a695-4b70-8c80-3d8bdb6022bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:27.339867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a950b3b4-a695-4b70-8c80-3d8bdb6022bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:27.340650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a950b3b4-a695-4b70-8c80-3d8bdb6022bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:27.341072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a950b3b4-a695-4b70-8c80-3d8bdb6022bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:27.371907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a950b3b4-a695-4b70-8c80-3d8bdb6022bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Jun 02 19:09:27.372483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 558/1136] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:27.949363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1621c8c6-272b-4daa-8b65-1edad4f156d7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:27.950050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1621c8c6-272b-4daa-8b65-1edad4f156d7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:27.956382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1621c8c6-272b-4daa-8b65-1edad4f156d7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:27.956831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1621c8c6-272b-4daa-8b65-1edad4f156d7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:27.957586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1621c8c6-272b-4daa-8b65-1edad4f156d7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:27.958047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1621c8c6-272b-4daa-8b65-1edad4f156d7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:27.973206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-270aeee1-cc2a-4941-81ca-04d3eb5c98ac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:27.974181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-270aeee1-cc2a-4941-81ca-04d3eb5c98ac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:27.981885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-270aeee1-cc2a-4941-81ca-04d3eb5c98ac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:27.982311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-270aeee1-cc2a-4941-81ca-04d3eb5c98ac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:27.983085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-270aeee1-cc2a-4941-81ca-04d3eb5c98ac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:27.983515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-270aeee1-cc2a-4941-81ca-04d3eb5c98ac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:28.014361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-270aeee1-cc2a-4941-81ca-04d3eb5c98ac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045120 Jun 02 19:09:28.014922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 559/1137] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:28.024183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1621c8c6-272b-4daa-8b65-1edad4f156d7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:28.032563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1621c8c6-272b-4daa-8b65-1edad4f156d7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.147753 Jun 02 19:09:28.033133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 579/1138] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:27 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:28.383387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c2619024-5acd-41c1-8871-c67baf161e3d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:28.384481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c2619024-5acd-41c1-8871-c67baf161e3d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:28.391231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c2619024-5acd-41c1-8871-c67baf161e3d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:28.391681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c2619024-5acd-41c1-8871-c67baf161e3d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:28.392452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c2619024-5acd-41c1-8871-c67baf161e3d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:28.392888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c2619024-5acd-41c1-8871-c67baf161e3d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:28.422850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c2619024-5acd-41c1-8871-c67baf161e3d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Jun 02 19:09:28.423605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 560/1139] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:29.026810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-221b9901-3eee-43e5-bf2a-2113f6d88434 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:29.027752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-221b9901-3eee-43e5-bf2a-2113f6d88434 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:29.034643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-221b9901-3eee-43e5-bf2a-2113f6d88434 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:29.035102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-221b9901-3eee-43e5-bf2a-2113f6d88434 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:29.035870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-221b9901-3eee-43e5-bf2a-2113f6d88434 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:29.036314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-221b9901-3eee-43e5-bf2a-2113f6d88434 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:29.050038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6294b809-6171-48ea-ae77-9620bb27f33c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:29.050769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6294b809-6171-48ea-ae77-9620bb27f33c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:29.057583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6294b809-6171-48ea-ae77-9620bb27f33c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:29.058099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6294b809-6171-48ea-ae77-9620bb27f33c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:29.058840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6294b809-6171-48ea-ae77-9620bb27f33c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:29.059274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6294b809-6171-48ea-ae77-9620bb27f33c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:29.068740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-221b9901-3eee-43e5-bf2a-2113f6d88434 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046231 Jun 02 19:09:29.069739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 580/1140] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:29.126813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6294b809-6171-48ea-ae77-9620bb27f33c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:29.134492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6294b809-6171-48ea-ae77-9620bb27f33c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088506 Jun 02 19:09:29.135046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 561/1141] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:29 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:29.439836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-03b29d3d-8507-438c-be54-f8be8b585d35 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:29.441361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-03b29d3d-8507-438c-be54-f8be8b585d35 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:29.451427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03b29d3d-8507-438c-be54-f8be8b585d35 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:29.451882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03b29d3d-8507-438c-be54-f8be8b585d35 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:29.452656 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03b29d3d-8507-438c-be54-f8be8b585d35 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:29.453094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03b29d3d-8507-438c-be54-f8be8b585d35 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:29.483189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-03b29d3d-8507-438c-be54-f8be8b585d35 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050884 Jun 02 19:09:29.483752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 581/1142] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:30.081486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-da2b9a0a-4437-4d94-83de-e69acff913d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:30.082449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-da2b9a0a-4437-4d94-83de-e69acff913d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:30.091218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da2b9a0a-4437-4d94-83de-e69acff913d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:30.091677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da2b9a0a-4437-4d94-83de-e69acff913d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:30.092465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da2b9a0a-4437-4d94-83de-e69acff913d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:30.093000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da2b9a0a-4437-4d94-83de-e69acff913d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:30.125295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-da2b9a0a-4437-4d94-83de-e69acff913d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047823 Jun 02 19:09:30.125867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 562/1143] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:30.154002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c848010f-3a82-44ff-981b-20f126c3f5a3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:30.154978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c848010f-3a82-44ff-981b-20f126c3f5a3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:30.164633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c848010f-3a82-44ff-981b-20f126c3f5a3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:30.165361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c848010f-3a82-44ff-981b-20f126c3f5a3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:30.166636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c848010f-3a82-44ff-981b-20f126c3f5a3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:30.167300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c848010f-3a82-44ff-981b-20f126c3f5a3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:30.229644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c848010f-3a82-44ff-981b-20f126c3f5a3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:30.237697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c848010f-3a82-44ff-981b-20f126c3f5a3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089535 Jun 02 19:09:30.238318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 582/1144] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:30 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:30.499273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b2fc50dd-2d73-4a85-a273-ccf02b3cb3dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:30.500522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b2fc50dd-2d73-4a85-a273-ccf02b3cb3dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:30.507178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2fc50dd-2d73-4a85-a273-ccf02b3cb3dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:30.507596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2fc50dd-2d73-4a85-a273-ccf02b3cb3dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:30.508349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2fc50dd-2d73-4a85-a273-ccf02b3cb3dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:30.508777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2fc50dd-2d73-4a85-a273-ccf02b3cb3dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:30.540246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b2fc50dd-2d73-4a85-a273-ccf02b3cb3dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Jun 02 19:09:30.540910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 563/1145] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:31.137024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-81c97ced-f7f2-453b-8cd3-1726f543da83 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:31.138121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-81c97ced-f7f2-453b-8cd3-1726f543da83 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:31.144700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81c97ced-f7f2-453b-8cd3-1726f543da83 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:31.145150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81c97ced-f7f2-453b-8cd3-1726f543da83 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:31.145949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81c97ced-f7f2-453b-8cd3-1726f543da83 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:31.146383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81c97ced-f7f2-453b-8cd3-1726f543da83 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:31.148736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:31.178132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-81c97ced-f7f2-453b-8cd3-1726f543da83 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045097 Jun 02 19:09:31.178775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 583/1146] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 19:09:31.255664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-862bbbb5-1c5e-448c-86d4-fe212799db2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:31.256369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-862bbbb5-1c5e-448c-86d4-fe212799db2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:31.264140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-862bbbb5-1c5e-448c-86d4-fe212799db2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:31.264647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-862bbbb5-1c5e-448c-86d4-fe212799db2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:31.265430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-862bbbb5-1c5e-448c-86d4-fe212799db2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:31.265955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-862bbbb5-1c5e-448c-86d4-fe212799db2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:31.332484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-862bbbb5-1c5e-448c-86d4-fe212799db2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:31.340576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-862bbbb5-1c5e-448c-86d4-fe212799db2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089157 Jun 02 19:09:31.341147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 564/1147] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:31 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:31.553090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d0a13274-09d8-4c02-9371-02ceee9e2d10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:31.554084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d0a13274-09d8-4c02-9371-02ceee9e2d10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:31.561160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d0a13274-09d8-4c02-9371-02ceee9e2d10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:31.561619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d0a13274-09d8-4c02-9371-02ceee9e2d10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:31.562445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d0a13274-09d8-4c02-9371-02ceee9e2d10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:31.562860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d0a13274-09d8-4c02-9371-02ceee9e2d10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:31.591897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d0a13274-09d8-4c02-9371-02ceee9e2d10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042827 Jun 02 19:09:31.592432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 584/1148] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:32.190920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1a3a03ca-6efb-480c-b0aa-3c3e8a918f05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:32.191855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1a3a03ca-6efb-480c-b0aa-3c3e8a918f05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:32.198787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a3a03ca-6efb-480c-b0aa-3c3e8a918f05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:32.199241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a3a03ca-6efb-480c-b0aa-3c3e8a918f05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:32.200006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a3a03ca-6efb-480c-b0aa-3c3e8a918f05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:32.200472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a3a03ca-6efb-480c-b0aa-3c3e8a918f05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:32.233397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1a3a03ca-6efb-480c-b0aa-3c3e8a918f05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046527 Jun 02 19:09:32.233977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 565/1149] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:32.359138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6c38ba8b-39ea-4ee3-814b-140200cf9d15 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:32.359747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6c38ba8b-39ea-4ee3-814b-140200cf9d15 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:32.366833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c38ba8b-39ea-4ee3-814b-140200cf9d15 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:32.367290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c38ba8b-39ea-4ee3-814b-140200cf9d15 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:32.368073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c38ba8b-39ea-4ee3-814b-140200cf9d15 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:32.368513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c38ba8b-39ea-4ee3-814b-140200cf9d15 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:32.432714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c38ba8b-39ea-4ee3-814b-140200cf9d15 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:32.441247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6c38ba8b-39ea-4ee3-814b-140200cf9d15 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086599 Jun 02 19:09:32.441771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 585/1150] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:32 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:32.604041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2e5d854a-7944-4ec4-8a3c-93f34d7ea794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:32.604968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2e5d854a-7944-4ec4-8a3c-93f34d7ea794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:32.612498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e5d854a-7944-4ec4-8a3c-93f34d7ea794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:32.612849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e5d854a-7944-4ec4-8a3c-93f34d7ea794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:32.613607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e5d854a-7944-4ec4-8a3c-93f34d7ea794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:32.614071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2e5d854a-7944-4ec4-8a3c-93f34d7ea794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:32.643309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2e5d854a-7944-4ec4-8a3c-93f34d7ea794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Jun 02 19:09:32.643868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 566/1151] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:33.245633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a3cc0123-e251-481e-b1b6-77a6741cd8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:33.246624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a3cc0123-e251-481e-b1b6-77a6741cd8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:33.253824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3cc0123-e251-481e-b1b6-77a6741cd8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:33.254323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3cc0123-e251-481e-b1b6-77a6741cd8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:33.255105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3cc0123-e251-481e-b1b6-77a6741cd8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:33.255545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3cc0123-e251-481e-b1b6-77a6741cd8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:33.286792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a3cc0123-e251-481e-b1b6-77a6741cd8f9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045131 Jun 02 19:09:33.287353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 586/1152] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:33.458492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-78430757-eb3d-434b-9e1c-27b8214b79ff tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:33.459092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-78430757-eb3d-434b-9e1c-27b8214b79ff tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:33.465841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78430757-eb3d-434b-9e1c-27b8214b79ff tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:33.466306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78430757-eb3d-434b-9e1c-27b8214b79ff tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:33.467413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78430757-eb3d-434b-9e1c-27b8214b79ff tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:33.467859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78430757-eb3d-434b-9e1c-27b8214b79ff tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:33.537782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-78430757-eb3d-434b-9e1c-27b8214b79ff tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:33.546139 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-78430757-eb3d-434b-9e1c-27b8214b79ff tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091455 Jun 02 19:09:33.546719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 567/1153] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:33 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:33.655735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3456aafd-76ef-4fa4-8478-2f35aec535a6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:33.656667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3456aafd-76ef-4fa4-8478-2f35aec535a6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:33.663556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3456aafd-76ef-4fa4-8478-2f35aec535a6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:33.664021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3456aafd-76ef-4fa4-8478-2f35aec535a6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:33.664776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3456aafd-76ef-4fa4-8478-2f35aec535a6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:33.665216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3456aafd-76ef-4fa4-8478-2f35aec535a6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:33.695128 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3456aafd-76ef-4fa4-8478-2f35aec535a6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Jun 02 19:09:33.695645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 587/1154] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:34.299625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6cf2f00b-bc04-4ff0-98f3-fa02d41dc7e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:34.300476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6cf2f00b-bc04-4ff0-98f3-fa02d41dc7e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:34.307522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cf2f00b-bc04-4ff0-98f3-fa02d41dc7e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:34.307989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cf2f00b-bc04-4ff0-98f3-fa02d41dc7e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:34.308755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cf2f00b-bc04-4ff0-98f3-fa02d41dc7e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:34.309193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cf2f00b-bc04-4ff0-98f3-fa02d41dc7e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:34.349483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6cf2f00b-bc04-4ff0-98f3-fa02d41dc7e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053859 Jun 02 19:09:34.350361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 568/1155] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 19:09:34.563464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-776845eb-df98-402f-b906-a659a13b9070 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:34.564007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-776845eb-df98-402f-b906-a659a13b9070 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:34.570852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-776845eb-df98-402f-b906-a659a13b9070 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:34.571306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-776845eb-df98-402f-b906-a659a13b9070 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:34.572066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-776845eb-df98-402f-b906-a659a13b9070 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:34.572503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-776845eb-df98-402f-b906-a659a13b9070 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:34.635721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-776845eb-df98-402f-b906-a659a13b9070 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:34.644189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-776845eb-df98-402f-b906-a659a13b9070 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084848 Jun 02 19:09:34.644754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 588/1156] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:34 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:34.707379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd7fee89-f2f6-4bde-b8bc-3ed06d1676c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:34.708324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bd7fee89-f2f6-4bde-b8bc-3ed06d1676c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:34.715128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd7fee89-f2f6-4bde-b8bc-3ed06d1676c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:34.715702 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd7fee89-f2f6-4bde-b8bc-3ed06d1676c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:34.716580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd7fee89-f2f6-4bde-b8bc-3ed06d1676c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:34.717102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd7fee89-f2f6-4bde-b8bc-3ed06d1676c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:34.749521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bd7fee89-f2f6-4bde-b8bc-3ed06d1676c6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Jun 02 19:09:34.750308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 569/1157] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:35.362000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a0574d74-028e-489d-ae68-8195db1d6d27 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:35.362963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a0574d74-028e-489d-ae68-8195db1d6d27 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:35.369731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0574d74-028e-489d-ae68-8195db1d6d27 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:35.370227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0574d74-028e-489d-ae68-8195db1d6d27 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:35.370992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0574d74-028e-489d-ae68-8195db1d6d27 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:35.371431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0574d74-028e-489d-ae68-8195db1d6d27 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:35.405411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a0574d74-028e-489d-ae68-8195db1d6d27 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047415 Jun 02 19:09:35.406003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 589/1158] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:35.661400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4b84a275-cf26-4a11-8645-47c560fa1ecd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:35.662118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4b84a275-cf26-4a11-8645-47c560fa1ecd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:35.669140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b84a275-cf26-4a11-8645-47c560fa1ecd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:35.669587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b84a275-cf26-4a11-8645-47c560fa1ecd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:35.670479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b84a275-cf26-4a11-8645-47c560fa1ecd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:35.670941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b84a275-cf26-4a11-8645-47c560fa1ecd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:35.737507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4b84a275-cf26-4a11-8645-47c560fa1ecd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:35.740037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:35.748442 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4b84a275-cf26-4a11-8645-47c560fa1ecd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090722 Jun 02 19:09:35.749116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 570/1159] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:35 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:35.762096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cee5e873-91dc-4be0-8592-241c4a1dbc34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:35.763046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cee5e873-91dc-4be0-8592-241c4a1dbc34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:35.769496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cee5e873-91dc-4be0-8592-241c4a1dbc34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:35.770040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cee5e873-91dc-4be0-8592-241c4a1dbc34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:35.770826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cee5e873-91dc-4be0-8592-241c4a1dbc34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:35.771272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cee5e873-91dc-4be0-8592-241c4a1dbc34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:35.801429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cee5e873-91dc-4be0-8592-241c4a1dbc34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Jun 02 19:09:35.801913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 590/1160] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:36.417787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5e2e18f2-90cd-4c39-aa46-b43e45feddd6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:36.418760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5e2e18f2-90cd-4c39-aa46-b43e45feddd6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:36.425662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e2e18f2-90cd-4c39-aa46-b43e45feddd6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:36.426158 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e2e18f2-90cd-4c39-aa46-b43e45feddd6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:36.426924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e2e18f2-90cd-4c39-aa46-b43e45feddd6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:36.427351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e2e18f2-90cd-4c39-aa46-b43e45feddd6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:36.458621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5e2e18f2-90cd-4c39-aa46-b43e45feddd6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044970 Jun 02 19:09:36.459197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 571/1161] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:36.766516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ff6596ea-4cf3-44fa-945e-34eac9054e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:36.767150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ff6596ea-4cf3-44fa-945e-34eac9054e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:36.774182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff6596ea-4cf3-44fa-945e-34eac9054e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:36.774647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff6596ea-4cf3-44fa-945e-34eac9054e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:36.775420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff6596ea-4cf3-44fa-945e-34eac9054e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:36.775864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff6596ea-4cf3-44fa-945e-34eac9054e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:36.812967 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-83864669-3266-4d80-9074-6de2cf378236 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:36.813973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-83864669-3266-4d80-9074-6de2cf378236 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:36.821206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83864669-3266-4d80-9074-6de2cf378236 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:36.821650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83864669-3266-4d80-9074-6de2cf378236 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:36.822495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83864669-3266-4d80-9074-6de2cf378236 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:36.822928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83864669-3266-4d80-9074-6de2cf378236 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:36.843798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff6596ea-4cf3-44fa-945e-34eac9054e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:36.851580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ff6596ea-4cf3-44fa-945e-34eac9054e76 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089095 Jun 02 19:09:36.852156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 591/1162] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:36 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:36.854025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-83864669-3266-4d80-9074-6de2cf378236 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045046 Jun 02 19:09:36.854578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 572/1163] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:37.471103 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-37daf9ce-ab7c-4cbd-a014-9b6c496187d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:37.472026 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-37daf9ce-ab7c-4cbd-a014-9b6c496187d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:37.478556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37daf9ce-ab7c-4cbd-a014-9b6c496187d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:37.478997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37daf9ce-ab7c-4cbd-a014-9b6c496187d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:37.479769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37daf9ce-ab7c-4cbd-a014-9b6c496187d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:37.480209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37daf9ce-ab7c-4cbd-a014-9b6c496187d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:37.510850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-37daf9ce-ab7c-4cbd-a014-9b6c496187d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043869 Jun 02 19:09:37.511394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 592/1164] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:37.866488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0694369b-85b7-46fe-818b-dc7f5b7d695c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:37.867315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0694369b-85b7-46fe-818b-dc7f5b7d695c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:37.870075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4ca61943-0984-491a-95bb-f2e777252d40 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:37.870689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4ca61943-0984-491a-95bb-f2e777252d40 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:37.874912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0694369b-85b7-46fe-818b-dc7f5b7d695c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:37.875341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0694369b-85b7-46fe-818b-dc7f5b7d695c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:37.876112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0694369b-85b7-46fe-818b-dc7f5b7d695c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:37.876546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0694369b-85b7-46fe-818b-dc7f5b7d695c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:37.878133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4ca61943-0984-491a-95bb-f2e777252d40 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:37.878558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4ca61943-0984-491a-95bb-f2e777252d40 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:37.879332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4ca61943-0984-491a-95bb-f2e777252d40 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:37.879926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4ca61943-0984-491a-95bb-f2e777252d40 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:37.907244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0694369b-85b7-46fe-818b-dc7f5b7d695c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Jun 02 19:09:37.907960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 573/1165] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:37.960129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4ca61943-0984-491a-95bb-f2e777252d40 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:37.968486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4ca61943-0984-491a-95bb-f2e777252d40 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102600 Jun 02 19:09:37.969061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 593/1166] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:37 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:38.523833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8a16bb03-3848-469e-be0d-0361f2a9434a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:38.524990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8a16bb03-3848-469e-be0d-0361f2a9434a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:38.532137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8a16bb03-3848-469e-be0d-0361f2a9434a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:38.532587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8a16bb03-3848-469e-be0d-0361f2a9434a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:38.533364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8a16bb03-3848-469e-be0d-0361f2a9434a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:38.533826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8a16bb03-3848-469e-be0d-0361f2a9434a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:38.564565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8a16bb03-3848-469e-be0d-0361f2a9434a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045148 Jun 02 19:09:38.565047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 574/1167] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:38.919625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-52ba6156-46cd-4247-84bb-22fa4607cd03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:38.920580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-52ba6156-46cd-4247-84bb-22fa4607cd03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:38.927670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52ba6156-46cd-4247-84bb-22fa4607cd03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:38.928158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52ba6156-46cd-4247-84bb-22fa4607cd03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:38.928961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52ba6156-46cd-4247-84bb-22fa4607cd03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:38.929402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52ba6156-46cd-4247-84bb-22fa4607cd03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:38.963244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-52ba6156-46cd-4247-84bb-22fa4607cd03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047729 Jun 02 19:09:38.963808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 594/1168] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:38.984699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-07034272-c667-4dd0-bc82-a7d018127d7c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:38.985268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-07034272-c667-4dd0-bc82-a7d018127d7c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:38.992295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07034272-c667-4dd0-bc82-a7d018127d7c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:38.992741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07034272-c667-4dd0-bc82-a7d018127d7c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:38.993507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07034272-c667-4dd0-bc82-a7d018127d7c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:38.993973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07034272-c667-4dd0-bc82-a7d018127d7c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:39.056543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-07034272-c667-4dd0-bc82-a7d018127d7c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:39.065138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-07034272-c667-4dd0-bc82-a7d018127d7c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084378 Jun 02 19:09:39.065681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 575/1169] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:38 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:09:39.577108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3d4f6b65-e438-4ae5-a1c6-2391ed732b53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:39.578130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3d4f6b65-e438-4ae5-a1c6-2391ed732b53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:39.584676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d4f6b65-e438-4ae5-a1c6-2391ed732b53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:39.585079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d4f6b65-e438-4ae5-a1c6-2391ed732b53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:39.585912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d4f6b65-e438-4ae5-a1c6-2391ed732b53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:39.586334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d4f6b65-e438-4ae5-a1c6-2391ed732b53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:39.616974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3d4f6b65-e438-4ae5-a1c6-2391ed732b53 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044200 Jun 02 19:09:39.617538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 595/1170] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:39.975807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d2dd372d-a509-456a-8461-6b8fbfe1a173 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:39.976748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d2dd372d-a509-456a-8461-6b8fbfe1a173 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:39.983532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2dd372d-a509-456a-8461-6b8fbfe1a173 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:39.984005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2dd372d-a509-456a-8461-6b8fbfe1a173 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:39.984757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2dd372d-a509-456a-8461-6b8fbfe1a173 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:39.985470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2dd372d-a509-456a-8461-6b8fbfe1a173 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:40.015839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d2dd372d-a509-456a-8461-6b8fbfe1a173 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Jun 02 19:09:40.016392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 576/1171] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:40.083103 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-186600d7-2c9e-4e90-9591-6eb9fa2872fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:40.083735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-186600d7-2c9e-4e90-9591-6eb9fa2872fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:40.090823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-186600d7-2c9e-4e90-9591-6eb9fa2872fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:40.091255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-186600d7-2c9e-4e90-9591-6eb9fa2872fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:40.092308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-186600d7-2c9e-4e90-9591-6eb9fa2872fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:40.092746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-186600d7-2c9e-4e90-9591-6eb9fa2872fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:40.156627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-186600d7-2c9e-4e90-9591-6eb9fa2872fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:40.164626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-186600d7-2c9e-4e90-9591-6eb9fa2872fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085650 Jun 02 19:09:40.165192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 596/1172] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:40 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:40.629443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2725d20c-f940-4ddf-a2bd-bcde2eb86801 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:40.630408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2725d20c-f940-4ddf-a2bd-bcde2eb86801 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:40.637109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2725d20c-f940-4ddf-a2bd-bcde2eb86801 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:40.637561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2725d20c-f940-4ddf-a2bd-bcde2eb86801 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:40.638360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2725d20c-f940-4ddf-a2bd-bcde2eb86801 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:40.638875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2725d20c-f940-4ddf-a2bd-bcde2eb86801 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:40.670229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2725d20c-f940-4ddf-a2bd-bcde2eb86801 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044817 Jun 02 19:09:40.670835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 577/1173] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:41.028172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90f9bc27-107d-4b0b-b113-9f833b9776ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:41.029356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-90f9bc27-107d-4b0b-b113-9f833b9776ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:41.035970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90f9bc27-107d-4b0b-b113-9f833b9776ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:41.036402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90f9bc27-107d-4b0b-b113-9f833b9776ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:41.037206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90f9bc27-107d-4b0b-b113-9f833b9776ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:41.037653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90f9bc27-107d-4b0b-b113-9f833b9776ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:41.067413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-90f9bc27-107d-4b0b-b113-9f833b9776ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Jun 02 19:09:41.067982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 597/1174] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:41.182179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e82698ce-2a47-4417-8be6-c96d66eabd71 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:41.182790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e82698ce-2a47-4417-8be6-c96d66eabd71 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:41.189850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e82698ce-2a47-4417-8be6-c96d66eabd71 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:41.190327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e82698ce-2a47-4417-8be6-c96d66eabd71 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:41.191078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e82698ce-2a47-4417-8be6-c96d66eabd71 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:41.191508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e82698ce-2a47-4417-8be6-c96d66eabd71 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:41.255891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e82698ce-2a47-4417-8be6-c96d66eabd71 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:41.264554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e82698ce-2a47-4417-8be6-c96d66eabd71 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086377 Jun 02 19:09:41.265109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 578/1175] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:41 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:41.682675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0e326134-00d6-466e-a21d-e77b43ef81cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:41.683597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0e326134-00d6-466e-a21d-e77b43ef81cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:41.691130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0e326134-00d6-466e-a21d-e77b43ef81cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:41.691581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0e326134-00d6-466e-a21d-e77b43ef81cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:41.692347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0e326134-00d6-466e-a21d-e77b43ef81cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:41.692781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0e326134-00d6-466e-a21d-e77b43ef81cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:41.723357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0e326134-00d6-466e-a21d-e77b43ef81cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044669 Jun 02 19:09:41.723914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 598/1176] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:42.080217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-72403ea6-1143-491a-843e-a013f51a5bcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:42.081165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-72403ea6-1143-491a-843e-a013f51a5bcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:42.087969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72403ea6-1143-491a-843e-a013f51a5bcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:42.088434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72403ea6-1143-491a-843e-a013f51a5bcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:42.089182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72403ea6-1143-491a-843e-a013f51a5bcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:42.089616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72403ea6-1143-491a-843e-a013f51a5bcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:42.119673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-72403ea6-1143-491a-843e-a013f51a5bcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Jun 02 19:09:42.120291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 579/1177] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:42.281965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ce6bc021-cf01-48ca-b444-1cf4b38e9149 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:42.282585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ce6bc021-cf01-48ca-b444-1cf4b38e9149 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:42.289225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce6bc021-cf01-48ca-b444-1cf4b38e9149 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:42.289683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce6bc021-cf01-48ca-b444-1cf4b38e9149 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:42.290493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce6bc021-cf01-48ca-b444-1cf4b38e9149 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:42.290933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce6bc021-cf01-48ca-b444-1cf4b38e9149 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:42.357482 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ce6bc021-cf01-48ca-b444-1cf4b38e9149 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:42.360004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:42.366883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ce6bc021-cf01-48ca-b444-1cf4b38e9149 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088951 Jun 02 19:09:42.367470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 599/1178] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:42 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:42.736270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0df76d4e-b367-4356-b145-2c2bef66d1b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:42.737241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0df76d4e-b367-4356-b145-2c2bef66d1b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:42.740088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=86 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:42.747256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0df76d4e-b367-4356-b145-2c2bef66d1b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:42.747909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0df76d4e-b367-4356-b145-2c2bef66d1b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:42.748938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0df76d4e-b367-4356-b145-2c2bef66d1b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:42.749375 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0df76d4e-b367-4356-b145-2c2bef66d1b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:42.780656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0df76d4e-b367-4356-b145-2c2bef66d1b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049032 Jun 02 19:09:42.781327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 580/1179] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:43.135062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-491583c6-307c-4bff-be6f-712fbec082c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:43.136488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-491583c6-307c-4bff-be6f-712fbec082c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:43.145188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-491583c6-307c-4bff-be6f-712fbec082c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:43.145644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-491583c6-307c-4bff-be6f-712fbec082c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:43.146460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-491583c6-307c-4bff-be6f-712fbec082c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:43.146897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-491583c6-307c-4bff-be6f-712fbec082c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:43.178600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-491583c6-307c-4bff-be6f-712fbec082c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050087 Jun 02 19:09:43.179175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 600/1180] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:43.384304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad7c2bc0-a7fe-4c8f-8453-b522ecdc4fa5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:43.384914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad7c2bc0-a7fe-4c8f-8453-b522ecdc4fa5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:43.391552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad7c2bc0-a7fe-4c8f-8453-b522ecdc4fa5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:43.391921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad7c2bc0-a7fe-4c8f-8453-b522ecdc4fa5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:43.392962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad7c2bc0-a7fe-4c8f-8453-b522ecdc4fa5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:43.393413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad7c2bc0-a7fe-4c8f-8453-b522ecdc4fa5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:43.460378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad7c2bc0-a7fe-4c8f-8453-b522ecdc4fa5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:43.470587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad7c2bc0-a7fe-4c8f-8453-b522ecdc4fa5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090204 Jun 02 19:09:43.471164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 581/1181] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:43 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:43.793121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4107e45a-dd7c-4e08-a016-e1dc8cca29a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:43.794095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4107e45a-dd7c-4e08-a016-e1dc8cca29a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:43.801701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4107e45a-dd7c-4e08-a016-e1dc8cca29a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:43.802196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4107e45a-dd7c-4e08-a016-e1dc8cca29a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:43.802973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4107e45a-dd7c-4e08-a016-e1dc8cca29a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:43.803411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4107e45a-dd7c-4e08-a016-e1dc8cca29a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:43.840569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4107e45a-dd7c-4e08-a016-e1dc8cca29a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051477 Jun 02 19:09:43.841058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 601/1182] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:44.191239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8435b4ed-5c59-420f-901e-49028709cb48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:44.192173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8435b4ed-5c59-420f-901e-49028709cb48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:44.199733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8435b4ed-5c59-420f-901e-49028709cb48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:44.200179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8435b4ed-5c59-420f-901e-49028709cb48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:44.200942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8435b4ed-5c59-420f-901e-49028709cb48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:44.201367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8435b4ed-5c59-420f-901e-49028709cb48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:44.235645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8435b4ed-5c59-420f-901e-49028709cb48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048431 Jun 02 19:09:44.236175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 582/1183] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:44.489224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1e4d8169-7f1f-4046-a146-eab946564083 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:44.489871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1e4d8169-7f1f-4046-a146-eab946564083 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:44.492259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=84 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:44.498393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e4d8169-7f1f-4046-a146-eab946564083 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:44.498849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e4d8169-7f1f-4046-a146-eab946564083 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:44.500380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e4d8169-7f1f-4046-a146-eab946564083 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:44.500850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e4d8169-7f1f-4046-a146-eab946564083 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:44.567819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1e4d8169-7f1f-4046-a146-eab946564083 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:44.577219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1e4d8169-7f1f-4046-a146-eab946564083 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091863 Jun 02 19:09:44.578168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 602/1184] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:44 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:09:44.853535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f85f2d01-8bbf-4420-a10f-5d0cf12d37e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:44.854582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f85f2d01-8bbf-4420-a10f-5d0cf12d37e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:44.868548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f85f2d01-8bbf-4420-a10f-5d0cf12d37e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:44.868548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f85f2d01-8bbf-4420-a10f-5d0cf12d37e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:44.868548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f85f2d01-8bbf-4420-a10f-5d0cf12d37e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:44.868548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f85f2d01-8bbf-4420-a10f-5d0cf12d37e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:44.898128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f85f2d01-8bbf-4420-a10f-5d0cf12d37e4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049149 Jun 02 19:09:44.898711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 583/1185] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:45.247708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0e5d5c40-a27f-4452-859f-8949410207ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:45.248651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0e5d5c40-a27f-4452-859f-8949410207ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:45.255866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0e5d5c40-a27f-4452-859f-8949410207ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:45.256323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0e5d5c40-a27f-4452-859f-8949410207ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:45.257113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0e5d5c40-a27f-4452-859f-8949410207ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:45.257550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0e5d5c40-a27f-4452-859f-8949410207ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:45.288372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0e5d5c40-a27f-4452-859f-8949410207ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Jun 02 19:09:45.288944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 603/1186] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:45.595397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3c9ab9e4-9923-4a41-b038-f5fa38bce1e1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:45.596052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3c9ab9e4-9923-4a41-b038-f5fa38bce1e1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:45.603267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c9ab9e4-9923-4a41-b038-f5fa38bce1e1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:45.603759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c9ab9e4-9923-4a41-b038-f5fa38bce1e1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:45.604523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c9ab9e4-9923-4a41-b038-f5fa38bce1e1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:45.605214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c9ab9e4-9923-4a41-b038-f5fa38bce1e1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:45.673338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3c9ab9e4-9923-4a41-b038-f5fa38bce1e1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:45.682080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3c9ab9e4-9923-4a41-b038-f5fa38bce1e1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091141 Jun 02 19:09:45.682893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 584/1187] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:45 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:45.910811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2b575806-2467-4985-9057-17da7f922fb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:45.911803 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2b575806-2467-4985-9057-17da7f922fb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:45.918606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2b575806-2467-4985-9057-17da7f922fb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:45.919140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2b575806-2467-4985-9057-17da7f922fb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:45.920748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2b575806-2467-4985-9057-17da7f922fb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:45.920748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2b575806-2467-4985-9057-17da7f922fb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:45.952352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2b575806-2467-4985-9057-17da7f922fb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046049 Jun 02 19:09:45.953164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 604/1188] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:46.300691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1fef66b4-7807-4122-9c47-01324bec413d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:46.301542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1fef66b4-7807-4122-9c47-01324bec413d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:46.308145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fef66b4-7807-4122-9c47-01324bec413d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:46.308632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fef66b4-7807-4122-9c47-01324bec413d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:46.309450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fef66b4-7807-4122-9c47-01324bec413d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:46.309993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fef66b4-7807-4122-9c47-01324bec413d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:46.340100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1fef66b4-7807-4122-9c47-01324bec413d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Jun 02 19:09:46.340698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 585/1189] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:46.701106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eb756fb5-3248-4e4d-8aa9-d96ac27e54e6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:46.701745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-eb756fb5-3248-4e4d-8aa9-d96ac27e54e6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:46.710002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eb756fb5-3248-4e4d-8aa9-d96ac27e54e6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:46.710457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eb756fb5-3248-4e4d-8aa9-d96ac27e54e6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:46.711236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eb756fb5-3248-4e4d-8aa9-d96ac27e54e6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:46.711672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eb756fb5-3248-4e4d-8aa9-d96ac27e54e6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:46.779534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eb756fb5-3248-4e4d-8aa9-d96ac27e54e6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:46.787775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eb756fb5-3248-4e4d-8aa9-d96ac27e54e6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090713 Jun 02 19:09:46.788356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 605/1190] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:46 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:46.966895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7663695a-56fd-432f-96fb-c1c4ad5211a6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:46.967995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7663695a-56fd-432f-96fb-c1c4ad5211a6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:46.977225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7663695a-56fd-432f-96fb-c1c4ad5211a6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:46.977936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7663695a-56fd-432f-96fb-c1c4ad5211a6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:46.978826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7663695a-56fd-432f-96fb-c1c4ad5211a6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:46.979513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7663695a-56fd-432f-96fb-c1c4ad5211a6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:47.016596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7663695a-56fd-432f-96fb-c1c4ad5211a6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055099 Jun 02 19:09:47.017187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 586/1191] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:47.352791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c186e5c5-e1d9-4b2d-ae1e-df282e975d8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:47.353838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c186e5c5-e1d9-4b2d-ae1e-df282e975d8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:47.360554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c186e5c5-e1d9-4b2d-ae1e-df282e975d8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:47.361024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c186e5c5-e1d9-4b2d-ae1e-df282e975d8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:47.361837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c186e5c5-e1d9-4b2d-ae1e-df282e975d8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:47.362292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c186e5c5-e1d9-4b2d-ae1e-df282e975d8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:47.393739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c186e5c5-e1d9-4b2d-ae1e-df282e975d8b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045088 Jun 02 19:09:47.394331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 606/1192] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:47.807665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6682131a-e900-48ba-af69-9a29c2baa38f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:47.808459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6682131a-e900-48ba-af69-9a29c2baa38f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:47.815979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6682131a-e900-48ba-af69-9a29c2baa38f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:47.816452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6682131a-e900-48ba-af69-9a29c2baa38f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:47.817192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6682131a-e900-48ba-af69-9a29c2baa38f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:47.817622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6682131a-e900-48ba-af69-9a29c2baa38f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:47.834625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:47.889347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6682131a-e900-48ba-af69-9a29c2baa38f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:47.897742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6682131a-e900-48ba-af69-9a29c2baa38f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095521 Jun 02 19:09:47.898345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 587/1193] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:47 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:48.029189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5aec0fd9-3d6b-4c49-af4a-386e13f49994 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:48.030149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5aec0fd9-3d6b-4c49-af4a-386e13f49994 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:48.037438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aec0fd9-3d6b-4c49-af4a-386e13f49994 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:48.037936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aec0fd9-3d6b-4c49-af4a-386e13f49994 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:48.038702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aec0fd9-3d6b-4c49-af4a-386e13f49994 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:48.039134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aec0fd9-3d6b-4c49-af4a-386e13f49994 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:48.069884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5aec0fd9-3d6b-4c49-af4a-386e13f49994 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044430 Jun 02 19:09:48.070475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 607/1194] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:48.406830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9ad05d7-eca8-4b97-81b0-3053a1cdbf6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:48.407812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9ad05d7-eca8-4b97-81b0-3053a1cdbf6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:48.414642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9ad05d7-eca8-4b97-81b0-3053a1cdbf6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:48.415083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9ad05d7-eca8-4b97-81b0-3053a1cdbf6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:48.415858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9ad05d7-eca8-4b97-81b0-3053a1cdbf6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:48.416284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9ad05d7-eca8-4b97-81b0-3053a1cdbf6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:48.445688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9ad05d7-eca8-4b97-81b0-3053a1cdbf6e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Jun 02 19:09:48.446261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 588/1195] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:48.919051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-81fede20-f722-475c-9d41-d93bf8a76278 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:48.920146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-81fede20-f722-475c-9d41-d93bf8a76278 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:48.927692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81fede20-f722-475c-9d41-d93bf8a76278 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:48.928152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81fede20-f722-475c-9d41-d93bf8a76278 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:48.928902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81fede20-f722-475c-9d41-d93bf8a76278 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:48.929347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81fede20-f722-475c-9d41-d93bf8a76278 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:48.992387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81fede20-f722-475c-9d41-d93bf8a76278 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:49.000283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-81fede20-f722-475c-9d41-d93bf8a76278 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087997 Jun 02 19:09:49.000942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 608/1196] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:48 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:49.085136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e4b93dcc-c8d0-421b-97da-8df2e50d9372 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:49.086412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e4b93dcc-c8d0-421b-97da-8df2e50d9372 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:49.101141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4b93dcc-c8d0-421b-97da-8df2e50d9372 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:49.101791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4b93dcc-c8d0-421b-97da-8df2e50d9372 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:49.102975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4b93dcc-c8d0-421b-97da-8df2e50d9372 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:49.103640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4b93dcc-c8d0-421b-97da-8df2e50d9372 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:49.136339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e4b93dcc-c8d0-421b-97da-8df2e50d9372 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057524 Jun 02 19:09:49.136897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 589/1197] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:49.458097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6a2dbd25-1483-4fb3-b975-b9fe30bc6a0a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:49.459122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6a2dbd25-1483-4fb3-b975-b9fe30bc6a0a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:49.467603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a2dbd25-1483-4fb3-b975-b9fe30bc6a0a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:49.468114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a2dbd25-1483-4fb3-b975-b9fe30bc6a0a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:49.468939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a2dbd25-1483-4fb3-b975-b9fe30bc6a0a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:49.469481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a2dbd25-1483-4fb3-b975-b9fe30bc6a0a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:49.505583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6a2dbd25-1483-4fb3-b975-b9fe30bc6a0a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052119 Jun 02 19:09:49.506180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 609/1198] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:50.024899 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5a8b0a4a-2d14-4b79-98db-ed75ef320d1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:50.025671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5a8b0a4a-2d14-4b79-98db-ed75ef320d1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:50.034004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a8b0a4a-2d14-4b79-98db-ed75ef320d1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:50.034624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a8b0a4a-2d14-4b79-98db-ed75ef320d1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:50.035385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a8b0a4a-2d14-4b79-98db-ed75ef320d1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:50.035802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a8b0a4a-2d14-4b79-98db-ed75ef320d1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:50.116329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5a8b0a4a-2d14-4b79-98db-ed75ef320d1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:50.124914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5a8b0a4a-2d14-4b79-98db-ed75ef320d1b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.104895 Jun 02 19:09:50.125503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 590/1199] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:50 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:50.148670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-93217940-6a99-4e5f-b57a-3321bc08b930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:50.149602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-93217940-6a99-4e5f-b57a-3321bc08b930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:50.156111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93217940-6a99-4e5f-b57a-3321bc08b930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:50.156596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93217940-6a99-4e5f-b57a-3321bc08b930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:50.157358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93217940-6a99-4e5f-b57a-3321bc08b930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:50.157789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93217940-6a99-4e5f-b57a-3321bc08b930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:50.188108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-93217940-6a99-4e5f-b57a-3321bc08b930 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043550 Jun 02 19:09:50.188945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 610/1200] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:50.521391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-798d1190-9f49-4c01-bf50-c81a083db042 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:50.522466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-798d1190-9f49-4c01-bf50-c81a083db042 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:50.530348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-798d1190-9f49-4c01-bf50-c81a083db042 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:50.530785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-798d1190-9f49-4c01-bf50-c81a083db042 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:50.531539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-798d1190-9f49-4c01-bf50-c81a083db042 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:50.531963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-798d1190-9f49-4c01-bf50-c81a083db042 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:50.567881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-798d1190-9f49-4c01-bf50-c81a083db042 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051913 Jun 02 19:09:50.568434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 591/1201] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:51.145526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fe9365e7-5f30-4d00-8ad0-3ea7c8f86adf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:51.146274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fe9365e7-5f30-4d00-8ad0-3ea7c8f86adf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:51.153277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe9365e7-5f30-4d00-8ad0-3ea7c8f86adf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:51.153929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe9365e7-5f30-4d00-8ad0-3ea7c8f86adf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:51.154523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe9365e7-5f30-4d00-8ad0-3ea7c8f86adf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:51.154966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe9365e7-5f30-4d00-8ad0-3ea7c8f86adf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:51.200725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fb63a528-d48c-4208-ac3a-28f1af39b852 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:51.201648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fb63a528-d48c-4208-ac3a-28f1af39b852 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:51.208509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb63a528-d48c-4208-ac3a-28f1af39b852 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:51.208954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb63a528-d48c-4208-ac3a-28f1af39b852 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:51.209697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb63a528-d48c-4208-ac3a-28f1af39b852 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:51.210280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb63a528-d48c-4208-ac3a-28f1af39b852 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:51.220912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fe9365e7-5f30-4d00-8ad0-3ea7c8f86adf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:51.229311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fe9365e7-5f30-4d00-8ad0-3ea7c8f86adf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089901 Jun 02 19:09:51.229925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 611/1202] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:51 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:51.239658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fb63a528-d48c-4208-ac3a-28f1af39b852 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042989 Jun 02 19:09:51.240212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 592/1203] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:51.580341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cb201aa3-8a84-4606-93d2-d7781d2f0254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:51.581292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cb201aa3-8a84-4606-93d2-d7781d2f0254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:51.588315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb201aa3-8a84-4606-93d2-d7781d2f0254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:51.588773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb201aa3-8a84-4606-93d2-d7781d2f0254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:51.589544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb201aa3-8a84-4606-93d2-d7781d2f0254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:51.590021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb201aa3-8a84-4606-93d2-d7781d2f0254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:51.620366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cb201aa3-8a84-4606-93d2-d7781d2f0254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044066 Jun 02 19:09:51.620919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 612/1204] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:52.247073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ffa9032c-f350-4713-ac81-1c31806ae586 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:52.247852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ffa9032c-f350-4713-ac81-1c31806ae586 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:52.252619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-14263bef-8810-485a-ac76-e61c21e4184f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:52.254147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-14263bef-8810-485a-ac76-e61c21e4184f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:52.255202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffa9032c-f350-4713-ac81-1c31806ae586 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:52.255663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffa9032c-f350-4713-ac81-1c31806ae586 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:52.256428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffa9032c-f350-4713-ac81-1c31806ae586 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:52.256864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffa9032c-f350-4713-ac81-1c31806ae586 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:52.270439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14263bef-8810-485a-ac76-e61c21e4184f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:52.270890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14263bef-8810-485a-ac76-e61c21e4184f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:52.271704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14263bef-8810-485a-ac76-e61c21e4184f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:52.272137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14263bef-8810-485a-ac76-e61c21e4184f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:52.302762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-14263bef-8810-485a-ac76-e61c21e4184f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055963 Jun 02 19:09:52.303430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 613/1205] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 19:09:52.324475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ffa9032c-f350-4713-ac81-1c31806ae586 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:52.332770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ffa9032c-f350-4713-ac81-1c31806ae586 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090099 Jun 02 19:09:52.333363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 593/1206] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:52 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:52.631652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6491b807-cb8d-4f39-bb0f-c3ee0f9a3481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:52.633145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6491b807-cb8d-4f39-bb0f-c3ee0f9a3481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:52.647385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6491b807-cb8d-4f39-bb0f-c3ee0f9a3481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:52.647843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6491b807-cb8d-4f39-bb0f-c3ee0f9a3481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:52.648618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6491b807-cb8d-4f39-bb0f-c3ee0f9a3481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:52.649060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6491b807-cb8d-4f39-bb0f-c3ee0f9a3481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:52.679340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6491b807-cb8d-4f39-bb0f-c3ee0f9a3481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051746 Jun 02 19:09:52.679896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 614/1207] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:53.319117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-09c86ba8-6e56-4953-a5d2-c97019892d2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:53.320972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-09c86ba8-6e56-4953-a5d2-c97019892d2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:53.331944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09c86ba8-6e56-4953-a5d2-c97019892d2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:53.332407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09c86ba8-6e56-4953-a5d2-c97019892d2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:53.333183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09c86ba8-6e56-4953-a5d2-c97019892d2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:53.333610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09c86ba8-6e56-4953-a5d2-c97019892d2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:53.349942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a2fe0e72-90ca-42aa-b4fc-3eec8416a0dd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:53.350649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a2fe0e72-90ca-42aa-b4fc-3eec8416a0dd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:53.357355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2fe0e72-90ca-42aa-b4fc-3eec8416a0dd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:53.357828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2fe0e72-90ca-42aa-b4fc-3eec8416a0dd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:53.358623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2fe0e72-90ca-42aa-b4fc-3eec8416a0dd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:53.359065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2fe0e72-90ca-42aa-b4fc-3eec8416a0dd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:53.363321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-09c86ba8-6e56-4953-a5d2-c97019892d2e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050991 Jun 02 19:09:53.363880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 594/1208] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:53.422663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a2fe0e72-90ca-42aa-b4fc-3eec8416a0dd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:53.431054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a2fe0e72-90ca-42aa-b4fc-3eec8416a0dd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085113 Jun 02 19:09:53.431643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 615/1209] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:53 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:53.692270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5f6fd7c7-a4b2-4171-9702-3d1ecbdf1c30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:53.693204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5f6fd7c7-a4b2-4171-9702-3d1ecbdf1c30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:53.700596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f6fd7c7-a4b2-4171-9702-3d1ecbdf1c30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:53.701045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f6fd7c7-a4b2-4171-9702-3d1ecbdf1c30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:53.701831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f6fd7c7-a4b2-4171-9702-3d1ecbdf1c30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:53.702265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f6fd7c7-a4b2-4171-9702-3d1ecbdf1c30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:53.731810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5f6fd7c7-a4b2-4171-9702-3d1ecbdf1c30 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 Jun 02 19:09:53.732349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 595/1210] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:54.378983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7c115b7d-57e7-4396-9590-eca652505aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:54.380336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7c115b7d-57e7-4396-9590-eca652505aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:54.387777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c115b7d-57e7-4396-9590-eca652505aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:54.388237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c115b7d-57e7-4396-9590-eca652505aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:54.389019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c115b7d-57e7-4396-9590-eca652505aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:54.389458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c115b7d-57e7-4396-9590-eca652505aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:54.403366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:54.420129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7c115b7d-57e7-4396-9590-eca652505aea tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047907 Jun 02 19:09:54.420692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 616/1211] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:54.450158 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2af6b251-a8de-49dd-bd9a-7d195998a9a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:54.450762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2af6b251-a8de-49dd-bd9a-7d195998a9a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:54.457484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2af6b251-a8de-49dd-bd9a-7d195998a9a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:54.457983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2af6b251-a8de-49dd-bd9a-7d195998a9a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:54.458740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2af6b251-a8de-49dd-bd9a-7d195998a9a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:54.459174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2af6b251-a8de-49dd-bd9a-7d195998a9a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:54.528737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2af6b251-a8de-49dd-bd9a-7d195998a9a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:54.545385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2af6b251-a8de-49dd-bd9a-7d195998a9a1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.099214 Jun 02 19:09:54.545998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 596/1212] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:54 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:54.746376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1bb917a2-a5d2-4e55-8850-5b77bf5e44da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:54.747524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1bb917a2-a5d2-4e55-8850-5b77bf5e44da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:54.754894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1bb917a2-a5d2-4e55-8850-5b77bf5e44da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:54.755442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1bb917a2-a5d2-4e55-8850-5b77bf5e44da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:54.756437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1bb917a2-a5d2-4e55-8850-5b77bf5e44da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:54.756963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1bb917a2-a5d2-4e55-8850-5b77bf5e44da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:54.790148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1bb917a2-a5d2-4e55-8850-5b77bf5e44da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048428 Jun 02 19:09:54.790849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 617/1213] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:55.436311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92bd1c73-0922-4cd6-8534-2edd757a1f68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:55.437874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92bd1c73-0922-4cd6-8534-2edd757a1f68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:55.448475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92bd1c73-0922-4cd6-8534-2edd757a1f68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:55.449680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92bd1c73-0922-4cd6-8534-2edd757a1f68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:55.450989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92bd1c73-0922-4cd6-8534-2edd757a1f68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:55.451916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92bd1c73-0922-4cd6-8534-2edd757a1f68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:55.485283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92bd1c73-0922-4cd6-8534-2edd757a1f68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055790 Jun 02 19:09:55.485867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 597/1214] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:55.562783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a4fcb80a-ac9c-4c0a-bcf2-d781658cd0c3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:55.563393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a4fcb80a-ac9c-4c0a-bcf2-d781658cd0c3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:55.570754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4fcb80a-ac9c-4c0a-bcf2-d781658cd0c3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:55.571215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4fcb80a-ac9c-4c0a-bcf2-d781658cd0c3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:55.572015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4fcb80a-ac9c-4c0a-bcf2-d781658cd0c3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:55.572479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4fcb80a-ac9c-4c0a-bcf2-d781658cd0c3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:55.645826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a4fcb80a-ac9c-4c0a-bcf2-d781658cd0c3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:55.654553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a4fcb80a-ac9c-4c0a-bcf2-d781658cd0c3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095775 Jun 02 19:09:55.655102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 618/1215] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:55 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:55.806430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-484ac4e2-d998-4744-bfe0-5d7da822e1ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:55.807787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-484ac4e2-d998-4744-bfe0-5d7da822e1ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:55.817992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-484ac4e2-d998-4744-bfe0-5d7da822e1ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:55.818729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-484ac4e2-d998-4744-bfe0-5d7da822e1ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:55.820361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-484ac4e2-d998-4744-bfe0-5d7da822e1ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:55.820792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-484ac4e2-d998-4744-bfe0-5d7da822e1ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:55.849681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-484ac4e2-d998-4744-bfe0-5d7da822e1ab tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050328 Jun 02 19:09:55.850646 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 598/1216] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:56.501571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e5e939a4-aabb-4851-a013-e05b3492ce49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:56.503182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e5e939a4-aabb-4851-a013-e05b3492ce49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:56.511018 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5e939a4-aabb-4851-a013-e05b3492ce49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:56.511475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5e939a4-aabb-4851-a013-e05b3492ce49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:56.512265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5e939a4-aabb-4851-a013-e05b3492ce49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:56.512697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5e939a4-aabb-4851-a013-e05b3492ce49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:56.543272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e5e939a4-aabb-4851-a013-e05b3492ce49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048395 Jun 02 19:09:56.543854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 619/1217] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:56.675944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3870fd5f-e4e9-4d29-9c25-f5b2eb026c93 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:56.677155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3870fd5f-e4e9-4d29-9c25-f5b2eb026c93 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:56.688409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3870fd5f-e4e9-4d29-9c25-f5b2eb026c93 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:56.689146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3870fd5f-e4e9-4d29-9c25-f5b2eb026c93 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:56.690464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3870fd5f-e4e9-4d29-9c25-f5b2eb026c93 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:56.691171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3870fd5f-e4e9-4d29-9c25-f5b2eb026c93 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:56.754029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3870fd5f-e4e9-4d29-9c25-f5b2eb026c93 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:56.762129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3870fd5f-e4e9-4d29-9c25-f5b2eb026c93 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093084 Jun 02 19:09:56.762686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 599/1218] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:56 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:56.865587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a14eb9e4-7a5c-4266-9fe7-5b60efa1bd72 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:56.866860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a14eb9e4-7a5c-4266-9fe7-5b60efa1bd72 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:56.873893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a14eb9e4-7a5c-4266-9fe7-5b60efa1bd72 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:56.874358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a14eb9e4-7a5c-4266-9fe7-5b60efa1bd72 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:56.875137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a14eb9e4-7a5c-4266-9fe7-5b60efa1bd72 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:56.875581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a14eb9e4-7a5c-4266-9fe7-5b60efa1bd72 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:56.912095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a14eb9e4-7a5c-4266-9fe7-5b60efa1bd72 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052640 Jun 02 19:09:56.912906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 620/1219] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:57.560351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6f80de36-ce4e-4814-ab63-915651256563 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:57.562451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6f80de36-ce4e-4814-ab63-915651256563 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:57.571187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f80de36-ce4e-4814-ab63-915651256563 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:57.571641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f80de36-ce4e-4814-ab63-915651256563 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:57.572393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f80de36-ce4e-4814-ab63-915651256563 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:57.572823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f80de36-ce4e-4814-ab63-915651256563 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:57.602711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6f80de36-ce4e-4814-ab63-915651256563 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049946 Jun 02 19:09:57.603255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 600/1220] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:57.788650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f1251894-f961-47f8-8c9c-d24e89b7cac2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:57.789583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f1251894-f961-47f8-8c9c-d24e89b7cac2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:57.799779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1251894-f961-47f8-8c9c-d24e89b7cac2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:57.800541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1251894-f961-47f8-8c9c-d24e89b7cac2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:57.801831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1251894-f961-47f8-8c9c-d24e89b7cac2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:57.802564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1251894-f961-47f8-8c9c-d24e89b7cac2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:57.866040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f1251894-f961-47f8-8c9c-d24e89b7cac2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:57.874073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f1251894-f961-47f8-8c9c-d24e89b7cac2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092006 Jun 02 19:09:57.874639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 621/1221] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:57 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:57.929439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a893191b-a137-4a9a-bc81-5d59d718a8fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:57.930392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a893191b-a137-4a9a-bc81-5d59d718a8fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:57.937484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a893191b-a137-4a9a-bc81-5d59d718a8fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:57.937963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a893191b-a137-4a9a-bc81-5d59d718a8fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:57.938694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a893191b-a137-4a9a-bc81-5d59d718a8fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:57.939143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a893191b-a137-4a9a-bc81-5d59d718a8fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:57.968488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a893191b-a137-4a9a-bc81-5d59d718a8fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Jun 02 19:09:57.969068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 601/1222] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:58.617606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a86616af-415e-4bd1-a442-7efafd4db494 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:58.618484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a86616af-415e-4bd1-a442-7efafd4db494 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:58.626342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a86616af-415e-4bd1-a442-7efafd4db494 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:58.627045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a86616af-415e-4bd1-a442-7efafd4db494 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:58.628393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a86616af-415e-4bd1-a442-7efafd4db494 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:58.629146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a86616af-415e-4bd1-a442-7efafd4db494 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:58.663017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a86616af-415e-4bd1-a442-7efafd4db494 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051636 Jun 02 19:09:58.663239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 622/1223] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:09:58.895801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fbc71307-24ff-49bf-a5ac-22854a3f2a2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:58.896904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fbc71307-24ff-49bf-a5ac-22854a3f2a2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:58.907640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fbc71307-24ff-49bf-a5ac-22854a3f2a2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:58.908486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fbc71307-24ff-49bf-a5ac-22854a3f2a2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:58.909776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fbc71307-24ff-49bf-a5ac-22854a3f2a2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:58.910607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fbc71307-24ff-49bf-a5ac-22854a3f2a2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:58.974235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fbc71307-24ff-49bf-a5ac-22854a3f2a2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:09:58.980951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-80b77666-e519-4314-b702-fe3dc34ccb92 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:58.981932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-80b77666-e519-4314-b702-fe3dc34ccb92 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:58.982338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fbc71307-24ff-49bf-a5ac-22854a3f2a2e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093359 Jun 02 19:09:58.983111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 602/1224] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:58 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:09:58.988828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80b77666-e519-4314-b702-fe3dc34ccb92 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:58.989295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80b77666-e519-4314-b702-fe3dc34ccb92 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:58.990093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80b77666-e519-4314-b702-fe3dc34ccb92 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:58.990539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80b77666-e519-4314-b702-fe3dc34ccb92 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:59.025463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-80b77666-e519-4314-b702-fe3dc34ccb92 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048538 Jun 02 19:09:59.026075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 623/1225] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:09:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:09:59.681016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6153cbf4-291f-4a6a-839f-fb08588c64b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:09:59.682578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6153cbf4-291f-4a6a-839f-fb08588c64b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:09:59.693058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6153cbf4-291f-4a6a-839f-fb08588c64b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:59.693855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6153cbf4-291f-4a6a-839f-fb08588c64b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:59.695350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6153cbf4-291f-4a6a-839f-fb08588c64b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:09:59.695785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6153cbf4-291f-4a6a-839f-fb08588c64b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:09:59.725304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6153cbf4-291f-4a6a-839f-fb08588c64b1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051098 Jun 02 19:09:59.726299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 603/1226] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:09:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:00.001686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1db128ab-1214-43e2-9004-ff6db31ac29c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:00.002515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1db128ab-1214-43e2-9004-ff6db31ac29c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:00.012050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1db128ab-1214-43e2-9004-ff6db31ac29c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:00.012648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1db128ab-1214-43e2-9004-ff6db31ac29c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:00.013947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1db128ab-1214-43e2-9004-ff6db31ac29c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:00.014528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1db128ab-1214-43e2-9004-ff6db31ac29c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:00.037136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-96ae17be-ff81-4553-9973-e1fa9f66ddc2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:00.038231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-96ae17be-ff81-4553-9973-e1fa9f66ddc2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:00.044929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96ae17be-ff81-4553-9973-e1fa9f66ddc2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:00.045401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96ae17be-ff81-4553-9973-e1fa9f66ddc2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:00.046224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96ae17be-ff81-4553-9973-e1fa9f66ddc2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:00.046638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96ae17be-ff81-4553-9973-e1fa9f66ddc2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:00.049070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:00.078949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-96ae17be-ff81-4553-9973-e1fa9f66ddc2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Jun 02 19:10:00.079535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 604/1227] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:00.081855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1db128ab-1214-43e2-9004-ff6db31ac29c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:00.090157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1db128ab-1214-43e2-9004-ff6db31ac29c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093651 Jun 02 19:10:00.090716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 624/1228] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:09:59 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:00.741693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4523119b-0217-4e95-a734-fb26906ce399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:00.743281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4523119b-0217-4e95-a734-fb26906ce399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:00.754459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4523119b-0217-4e95-a734-fb26906ce399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:00.755207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4523119b-0217-4e95-a734-fb26906ce399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:00.756457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4523119b-0217-4e95-a734-fb26906ce399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:00.757175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4523119b-0217-4e95-a734-fb26906ce399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:00.788463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4523119b-0217-4e95-a734-fb26906ce399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053485 Jun 02 19:10:00.789855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 605/1229] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:01.091442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2f2cb86e-da77-4241-934c-a11de8a96266 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:01.092293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2f2cb86e-da77-4241-934c-a11de8a96266 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:01.099403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f2cb86e-da77-4241-934c-a11de8a96266 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:01.099859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f2cb86e-da77-4241-934c-a11de8a96266 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:01.100673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f2cb86e-da77-4241-934c-a11de8a96266 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:01.101114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f2cb86e-da77-4241-934c-a11de8a96266 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:01.108029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-221ace58-5e3c-4caf-95e7-6a68cd126a13 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:01.108877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-221ace58-5e3c-4caf-95e7-6a68cd126a13 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:01.115465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-221ace58-5e3c-4caf-95e7-6a68cd126a13 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:01.115921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-221ace58-5e3c-4caf-95e7-6a68cd126a13 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:01.116728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-221ace58-5e3c-4caf-95e7-6a68cd126a13 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:01.117245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-221ace58-5e3c-4caf-95e7-6a68cd126a13 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:01.137863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2f2cb86e-da77-4241-934c-a11de8a96266 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050463 Jun 02 19:10:01.138440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 625/1230] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:01.183251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-221ace58-5e3c-4caf-95e7-6a68cd126a13 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:01.191468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-221ace58-5e3c-4caf-95e7-6a68cd126a13 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087995 Jun 02 19:10:01.192013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 606/1231] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:01 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:01.805190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f5c7675f-2fb2-4cf7-a03b-dadbecd034f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:01.806099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f5c7675f-2fb2-4cf7-a03b-dadbecd034f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:01.812860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5c7675f-2fb2-4cf7-a03b-dadbecd034f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:01.813317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5c7675f-2fb2-4cf7-a03b-dadbecd034f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:01.814168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5c7675f-2fb2-4cf7-a03b-dadbecd034f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:01.814624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5c7675f-2fb2-4cf7-a03b-dadbecd034f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:01.847228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f5c7675f-2fb2-4cf7-a03b-dadbecd034f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048817 Jun 02 19:10:01.847788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 626/1232] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:02.151808 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f949f3bd-4d4d-4dc5-91e4-0ec2a26b1bae tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:02.152765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f949f3bd-4d4d-4dc5-91e4-0ec2a26b1bae tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:02.159896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f949f3bd-4d4d-4dc5-91e4-0ec2a26b1bae tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:02.160464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f949f3bd-4d4d-4dc5-91e4-0ec2a26b1bae tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:02.161218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f949f3bd-4d4d-4dc5-91e4-0ec2a26b1bae tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:02.161647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f949f3bd-4d4d-4dc5-91e4-0ec2a26b1bae tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:02.193040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f949f3bd-4d4d-4dc5-91e4-0ec2a26b1bae tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045972 Jun 02 19:10:02.193593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 607/1233] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:02.212949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e379a8ab-464a-48dc-b910-975b7f11ebd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:02.213930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e379a8ab-464a-48dc-b910-975b7f11ebd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:02.221164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e379a8ab-464a-48dc-b910-975b7f11ebd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:02.221609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e379a8ab-464a-48dc-b910-975b7f11ebd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:02.222400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e379a8ab-464a-48dc-b910-975b7f11ebd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:02.222839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e379a8ab-464a-48dc-b910-975b7f11ebd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:02.291852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e379a8ab-464a-48dc-b910-975b7f11ebd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:02.299901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e379a8ab-464a-48dc-b910-975b7f11ebd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092433 Jun 02 19:10:02.300460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 627/1234] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:02 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:02.861314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-66c4eb51-29cc-4fbd-a947-7c3090263eb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:02.862428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-66c4eb51-29cc-4fbd-a947-7c3090263eb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:02.870866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66c4eb51-29cc-4fbd-a947-7c3090263eb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:02.871320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66c4eb51-29cc-4fbd-a947-7c3090263eb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:02.872084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66c4eb51-29cc-4fbd-a947-7c3090263eb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:02.872521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66c4eb51-29cc-4fbd-a947-7c3090263eb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:02.903586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-66c4eb51-29cc-4fbd-a947-7c3090263eb3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047700 Jun 02 19:10:02.904166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 608/1235] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:03.205196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-794abdaf-0765-478c-a8a9-aa2a5bba4049 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:03.206157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-794abdaf-0765-478c-a8a9-aa2a5bba4049 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:03.212834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-794abdaf-0765-478c-a8a9-aa2a5bba4049 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:03.213303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-794abdaf-0765-478c-a8a9-aa2a5bba4049 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:03.214114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-794abdaf-0765-478c-a8a9-aa2a5bba4049 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:03.214553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-794abdaf-0765-478c-a8a9-aa2a5bba4049 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:03.244604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-794abdaf-0765-478c-a8a9-aa2a5bba4049 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043326 Jun 02 19:10:03.245174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 628/1236] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:03.317253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8737cafc-5a76-4752-be84-d1a9dc53b811 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:03.317911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8737cafc-5a76-4752-be84-d1a9dc53b811 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:03.325985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8737cafc-5a76-4752-be84-d1a9dc53b811 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:03.326523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8737cafc-5a76-4752-be84-d1a9dc53b811 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:03.327294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8737cafc-5a76-4752-be84-d1a9dc53b811 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:03.327727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8737cafc-5a76-4752-be84-d1a9dc53b811 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:03.391787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8737cafc-5a76-4752-be84-d1a9dc53b811 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:03.399562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8737cafc-5a76-4752-be84-d1a9dc53b811 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086300 Jun 02 19:10:03.400133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 609/1237] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:03 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:03.915842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e7ee82db-19ff-44e3-af28-e2e3b361da0e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:03.916769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e7ee82db-19ff-44e3-af28-e2e3b361da0e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:03.923308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7ee82db-19ff-44e3-af28-e2e3b361da0e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:03.923782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7ee82db-19ff-44e3-af28-e2e3b361da0e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:03.924557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7ee82db-19ff-44e3-af28-e2e3b361da0e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:03.924993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7ee82db-19ff-44e3-af28-e2e3b361da0e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:03.959832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e7ee82db-19ff-44e3-af28-e2e3b361da0e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047685 Jun 02 19:10:03.960490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 629/1238] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:04.256831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d3034ad4-d0ec-4577-87a4-fe24879af01f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:04.257692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d3034ad4-d0ec-4577-87a4-fe24879af01f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:04.264673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3034ad4-d0ec-4577-87a4-fe24879af01f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:04.265112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3034ad4-d0ec-4577-87a4-fe24879af01f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:04.265907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3034ad4-d0ec-4577-87a4-fe24879af01f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:04.266330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3034ad4-d0ec-4577-87a4-fe24879af01f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:04.296405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d3034ad4-d0ec-4577-87a4-fe24879af01f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Jun 02 19:10:04.296960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 610/1239] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:04.421111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4fcef3e2-0599-4fc8-b471-fb9260304b14 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:04.421743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4fcef3e2-0599-4fc8-b471-fb9260304b14 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:04.428767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4fcef3e2-0599-4fc8-b471-fb9260304b14 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:04.429240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4fcef3e2-0599-4fc8-b471-fb9260304b14 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:04.430023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4fcef3e2-0599-4fc8-b471-fb9260304b14 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:04.430674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4fcef3e2-0599-4fc8-b471-fb9260304b14 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:04.510467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4fcef3e2-0599-4fc8-b471-fb9260304b14 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:04.518151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4fcef3e2-0599-4fc8-b471-fb9260304b14 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.105150 Jun 02 19:10:04.518739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 630/1240] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:04 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:04.973678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8727b92f-3946-4355-947f-50e2e702e9ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:04.974649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8727b92f-3946-4355-947f-50e2e702e9ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:04.981968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8727b92f-3946-4355-947f-50e2e702e9ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:04.982417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8727b92f-3946-4355-947f-50e2e702e9ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:04.983187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8727b92f-3946-4355-947f-50e2e702e9ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:04.983618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8727b92f-3946-4355-947f-50e2e702e9ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:05.017305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8727b92f-3946-4355-947f-50e2e702e9ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047340 Jun 02 19:10:05.018188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 611/1241] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:05.311963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d74bc2e-1102-40c5-b5ef-599a3f25b3cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:05.313648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d74bc2e-1102-40c5-b5ef-599a3f25b3cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:05.323245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d74bc2e-1102-40c5-b5ef-599a3f25b3cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:05.323245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d74bc2e-1102-40c5-b5ef-599a3f25b3cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:05.324057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d74bc2e-1102-40c5-b5ef-599a3f25b3cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:05.324586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d74bc2e-1102-40c5-b5ef-599a3f25b3cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:05.358078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d74bc2e-1102-40c5-b5ef-599a3f25b3cc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052985 Jun 02 19:10:05.358683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 631/1242] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:05.535907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d8828010-0e76-4fc5-8e4c-11088d43398b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:05.536514 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d8828010-0e76-4fc5-8e4c-11088d43398b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:05.543229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8828010-0e76-4fc5-8e4c-11088d43398b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:05.543658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8828010-0e76-4fc5-8e4c-11088d43398b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:05.544416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8828010-0e76-4fc5-8e4c-11088d43398b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:05.544842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8828010-0e76-4fc5-8e4c-11088d43398b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:05.610327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d8828010-0e76-4fc5-8e4c-11088d43398b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:05.618564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d8828010-0e76-4fc5-8e4c-11088d43398b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086519 Jun 02 19:10:05.619145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 612/1243] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:05 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:10:06.032945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ec490866-a79b-41dd-a3c8-91482d195c1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:06.034471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ec490866-a79b-41dd-a3c8-91482d195c1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:06.044285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec490866-a79b-41dd-a3c8-91482d195c1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:06.044774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec490866-a79b-41dd-a3c8-91482d195c1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:06.045563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec490866-a79b-41dd-a3c8-91482d195c1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:06.046048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec490866-a79b-41dd-a3c8-91482d195c1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:06.079602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ec490866-a79b-41dd-a3c8-91482d195c1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053455 Jun 02 19:10:06.080229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 632/1244] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:06.371557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6860852d-cd41-4017-836e-43650a574972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:06.372480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6860852d-cd41-4017-836e-43650a574972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:06.379544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6860852d-cd41-4017-836e-43650a574972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:06.379982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6860852d-cd41-4017-836e-43650a574972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:06.380741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6860852d-cd41-4017-836e-43650a574972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:06.381255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6860852d-cd41-4017-836e-43650a574972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:06.420854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6860852d-cd41-4017-836e-43650a574972 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053066 Jun 02 19:10:06.421663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 613/1245] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:06.640632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0284679b-a127-4f3e-9d91-be0b3a20a4fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:06.641943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0284679b-a127-4f3e-9d91-be0b3a20a4fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:06.651252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0284679b-a127-4f3e-9d91-be0b3a20a4fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:06.651699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0284679b-a127-4f3e-9d91-be0b3a20a4fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:06.652455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0284679b-a127-4f3e-9d91-be0b3a20a4fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:06.652886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0284679b-a127-4f3e-9d91-be0b3a20a4fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:06.655433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:06.719840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0284679b-a127-4f3e-9d91-be0b3a20a4fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:06.730760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0284679b-a127-4f3e-9d91-be0b3a20a4fa tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097275 Jun 02 19:10:06.731338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 633/1246] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:06 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:07.093641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a3a457e2-852f-4035-aab7-8923cf9db744 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:07.094568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a3a457e2-852f-4035-aab7-8923cf9db744 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:07.100912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a3a457e2-852f-4035-aab7-8923cf9db744 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:07.101361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a3a457e2-852f-4035-aab7-8923cf9db744 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:07.102586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a3a457e2-852f-4035-aab7-8923cf9db744 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:07.103134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a3a457e2-852f-4035-aab7-8923cf9db744 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:07.138745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a3a457e2-852f-4035-aab7-8923cf9db744 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049122 Jun 02 19:10:07.139303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 614/1247] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:07.434534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-316528fc-5881-481a-89e9-465712614565 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:07.435478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-316528fc-5881-481a-89e9-465712614565 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:07.442498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-316528fc-5881-481a-89e9-465712614565 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:07.442951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-316528fc-5881-481a-89e9-465712614565 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:07.443720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-316528fc-5881-481a-89e9-465712614565 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:07.444234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-316528fc-5881-481a-89e9-465712614565 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:07.474544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-316528fc-5881-481a-89e9-465712614565 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Jun 02 19:10:07.475111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 634/1248] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:07.757490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-187e9586-1b11-4684-9a55-20788fea4813 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:07.758428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-187e9586-1b11-4684-9a55-20788fea4813 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:07.766214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-187e9586-1b11-4684-9a55-20788fea4813 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:07.766674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-187e9586-1b11-4684-9a55-20788fea4813 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:07.767444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-187e9586-1b11-4684-9a55-20788fea4813 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:07.767881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-187e9586-1b11-4684-9a55-20788fea4813 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:07.830317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-187e9586-1b11-4684-9a55-20788fea4813 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:07.838348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-187e9586-1b11-4684-9a55-20788fea4813 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087129 Jun 02 19:10:07.838685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 615/1249] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:07 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:08.155232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ef4c03c7-bcb6-4647-9b81-411c6ee76847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:08.156718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ef4c03c7-bcb6-4647-9b81-411c6ee76847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:08.167156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef4c03c7-bcb6-4647-9b81-411c6ee76847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:08.167622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef4c03c7-bcb6-4647-9b81-411c6ee76847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:08.168391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef4c03c7-bcb6-4647-9b81-411c6ee76847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:08.168842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef4c03c7-bcb6-4647-9b81-411c6ee76847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:08.199248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ef4c03c7-bcb6-4647-9b81-411c6ee76847 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051616 Jun 02 19:10:08.199801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 635/1250] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:08.491106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8e0d8b2e-26f5-4ca6-9ce6-af41e25d88f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:08.492535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8e0d8b2e-26f5-4ca6-9ce6-af41e25d88f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:08.503050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e0d8b2e-26f5-4ca6-9ce6-af41e25d88f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:08.503792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e0d8b2e-26f5-4ca6-9ce6-af41e25d88f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:08.505047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e0d8b2e-26f5-4ca6-9ce6-af41e25d88f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:08.505873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e0d8b2e-26f5-4ca6-9ce6-af41e25d88f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:08.537007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8e0d8b2e-26f5-4ca6-9ce6-af41e25d88f7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052843 Jun 02 19:10:08.537571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 616/1251] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:08.859751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f708a6e8-6c93-4278-b124-0c70a2eee3fd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:08.860639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f708a6e8-6c93-4278-b124-0c70a2eee3fd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:08.870933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f708a6e8-6c93-4278-b124-0c70a2eee3fd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:08.871388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f708a6e8-6c93-4278-b124-0c70a2eee3fd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:08.872151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f708a6e8-6c93-4278-b124-0c70a2eee3fd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:08.872587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f708a6e8-6c93-4278-b124-0c70a2eee3fd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:08.943015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f708a6e8-6c93-4278-b124-0c70a2eee3fd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:08.951651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f708a6e8-6c93-4278-b124-0c70a2eee3fd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.099058 Jun 02 19:10:08.952250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 636/1252] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:08 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:09.216019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a1fa88be-398c-4fba-9819-f1992b9457b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:09.218332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a1fa88be-398c-4fba-9819-f1992b9457b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:09.229244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a1fa88be-398c-4fba-9819-f1992b9457b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:09.229886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a1fa88be-398c-4fba-9819-f1992b9457b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:09.230652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a1fa88be-398c-4fba-9819-f1992b9457b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:09.231084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a1fa88be-398c-4fba-9819-f1992b9457b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:09.263095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a1fa88be-398c-4fba-9819-f1992b9457b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054083 Jun 02 19:10:09.263671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 617/1253] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:09.550680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-acf3e1a2-e215-400d-92f9-b08e978f6e56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:09.551905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-acf3e1a2-e215-400d-92f9-b08e978f6e56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:09.559653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acf3e1a2-e215-400d-92f9-b08e978f6e56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:09.560105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acf3e1a2-e215-400d-92f9-b08e978f6e56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:09.560864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acf3e1a2-e215-400d-92f9-b08e978f6e56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:09.561318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acf3e1a2-e215-400d-92f9-b08e978f6e56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:09.590593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-acf3e1a2-e215-400d-92f9-b08e978f6e56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Jun 02 19:10:09.591142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 637/1254] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:09.970768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1e863bd4-9329-46ed-b183-e95c2902ffba tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:09.971587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1e863bd4-9329-46ed-b183-e95c2902ffba tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:09.980542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e863bd4-9329-46ed-b183-e95c2902ffba tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:09.980991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e863bd4-9329-46ed-b183-e95c2902ffba tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:09.981748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e863bd4-9329-46ed-b183-e95c2902ffba tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:09.982216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e863bd4-9329-46ed-b183-e95c2902ffba tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:10.045433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e863bd4-9329-46ed-b183-e95c2902ffba tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:10.053348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1e863bd4-9329-46ed-b183-e95c2902ffba tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088632 Jun 02 19:10:10.053935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 618/1255] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:09 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:10.278154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8a79ed58-e65f-48ec-9a0a-434b88a688f1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:10.278996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8a79ed58-e65f-48ec-9a0a-434b88a688f1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:10.285662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a79ed58-e65f-48ec-9a0a-434b88a688f1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:10.286157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a79ed58-e65f-48ec-9a0a-434b88a688f1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:10.286926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a79ed58-e65f-48ec-9a0a-434b88a688f1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:10.287370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a79ed58-e65f-48ec-9a0a-434b88a688f1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:10.317783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8a79ed58-e65f-48ec-9a0a-434b88a688f1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045278 Jun 02 19:10:10.318370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 638/1256] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:10.605159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cf39d318-413c-4d2d-b665-48a9dc8cc3d3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:10.606428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cf39d318-413c-4d2d-b665-48a9dc8cc3d3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:10.615371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf39d318-413c-4d2d-b665-48a9dc8cc3d3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:10.615966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf39d318-413c-4d2d-b665-48a9dc8cc3d3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:10.616966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf39d318-413c-4d2d-b665-48a9dc8cc3d3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:10.617543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf39d318-413c-4d2d-b665-48a9dc8cc3d3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:10.650715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cf39d318-413c-4d2d-b665-48a9dc8cc3d3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051145 Jun 02 19:10:10.651250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 619/1257] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:10.886225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:10:10.886599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:10:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:10:11.075540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-09ee87e3-2fa2-475b-aa04-fd65c5fa230c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:11.076555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-09ee87e3-2fa2-475b-aa04-fd65c5fa230c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:11.086956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09ee87e3-2fa2-475b-aa04-fd65c5fa230c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:11.087722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09ee87e3-2fa2-475b-aa04-fd65c5fa230c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:11.088879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09ee87e3-2fa2-475b-aa04-fd65c5fa230c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:11.089543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09ee87e3-2fa2-475b-aa04-fd65c5fa230c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:11.153231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-09ee87e3-2fa2-475b-aa04-fd65c5fa230c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:11.164529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-09ee87e3-2fa2-475b-aa04-fd65c5fa230c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095628 Jun 02 19:10:11.165295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 639/1258] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:11 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:11.336286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6b78aef7-46ea-4642-b1f4-485467b2e205 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:11.337764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6b78aef7-46ea-4642-b1f4-485467b2e205 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:11.349025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b78aef7-46ea-4642-b1f4-485467b2e205 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:11.349755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b78aef7-46ea-4642-b1f4-485467b2e205 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:11.351037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b78aef7-46ea-4642-b1f4-485467b2e205 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:11.351795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b78aef7-46ea-4642-b1f4-485467b2e205 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:11.376626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:11.382894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6b78aef7-46ea-4642-b1f4-485467b2e205 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053741 Jun 02 19:10:11.383445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 620/1259] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:11.665495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-619faf44-5664-45f6-8318-d99e9fe05006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:11.667663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-619faf44-5664-45f6-8318-d99e9fe05006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:11.677733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-619faf44-5664-45f6-8318-d99e9fe05006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:11.678371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-619faf44-5664-45f6-8318-d99e9fe05006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:11.679603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-619faf44-5664-45f6-8318-d99e9fe05006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:11.680199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-619faf44-5664-45f6-8318-d99e9fe05006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:11.711659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-619faf44-5664-45f6-8318-d99e9fe05006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052603 Jun 02 19:10:11.712214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 640/1260] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:12.182307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6500ce67-3a00-4fdb-a17f-ac5a43581e9f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:12.183179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6500ce67-3a00-4fdb-a17f-ac5a43581e9f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:12.190435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6500ce67-3a00-4fdb-a17f-ac5a43581e9f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:12.190886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6500ce67-3a00-4fdb-a17f-ac5a43581e9f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:12.191619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6500ce67-3a00-4fdb-a17f-ac5a43581e9f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:12.192110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6500ce67-3a00-4fdb-a17f-ac5a43581e9f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:12.256337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6500ce67-3a00-4fdb-a17f-ac5a43581e9f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:12.267567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6500ce67-3a00-4fdb-a17f-ac5a43581e9f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089028 Jun 02 19:10:12.268280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 621/1261] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:12 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:12.399496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5594fae1-8387-423f-99c9-c72e9f7fa279 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:12.401013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5594fae1-8387-423f-99c9-c72e9f7fa279 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:12.408021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5594fae1-8387-423f-99c9-c72e9f7fa279 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:12.408475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5594fae1-8387-423f-99c9-c72e9f7fa279 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:12.409242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5594fae1-8387-423f-99c9-c72e9f7fa279 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:12.409682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5594fae1-8387-423f-99c9-c72e9f7fa279 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:12.441727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5594fae1-8387-423f-99c9-c72e9f7fa279 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048880 Jun 02 19:10:12.442227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 641/1262] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:12.730036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b8d0f12f-ec47-4da5-85cc-0a9c14456426 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:12.730908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b8d0f12f-ec47-4da5-85cc-0a9c14456426 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:12.737448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8d0f12f-ec47-4da5-85cc-0a9c14456426 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:12.737921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8d0f12f-ec47-4da5-85cc-0a9c14456426 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:12.738696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8d0f12f-ec47-4da5-85cc-0a9c14456426 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:12.739128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8d0f12f-ec47-4da5-85cc-0a9c14456426 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:12.771734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b8d0f12f-ec47-4da5-85cc-0a9c14456426 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049430 Jun 02 19:10:12.772279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 622/1263] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:13.288664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e6051f8-b7a0-4f36-aa42-6939adae9fdc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:13.289426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e6051f8-b7a0-4f36-aa42-6939adae9fdc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:13.297645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e6051f8-b7a0-4f36-aa42-6939adae9fdc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:13.298129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e6051f8-b7a0-4f36-aa42-6939adae9fdc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:13.299410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e6051f8-b7a0-4f36-aa42-6939adae9fdc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:13.299410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e6051f8-b7a0-4f36-aa42-6939adae9fdc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:13.373082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5e6051f8-b7a0-4f36-aa42-6939adae9fdc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:13.382410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e6051f8-b7a0-4f36-aa42-6939adae9fdc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.099243 Jun 02 19:10:13.382977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 642/1264] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:13 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:13.456273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a317f348-70cd-4136-8f90-5235fd32746c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:13.457481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a317f348-70cd-4136-8f90-5235fd32746c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:13.460386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=86 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:13.466831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a317f348-70cd-4136-8f90-5235fd32746c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:13.467476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a317f348-70cd-4136-8f90-5235fd32746c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:13.468708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a317f348-70cd-4136-8f90-5235fd32746c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:13.469360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a317f348-70cd-4136-8f90-5235fd32746c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:13.501316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a317f348-70cd-4136-8f90-5235fd32746c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051073 Jun 02 19:10:13.501945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 623/1265] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:13.787824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-af54d35d-4a46-460c-8464-63e9bf221aa7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:13.789353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-af54d35d-4a46-460c-8464-63e9bf221aa7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:13.797827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af54d35d-4a46-460c-8464-63e9bf221aa7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:13.798288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af54d35d-4a46-460c-8464-63e9bf221aa7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:13.799056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af54d35d-4a46-460c-8464-63e9bf221aa7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:13.799495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af54d35d-4a46-460c-8464-63e9bf221aa7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:13.832025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-af54d35d-4a46-460c-8464-63e9bf221aa7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050943 Jun 02 19:10:13.832573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 643/1266] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:14.399802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-327f721d-f50f-4e39-a240-8c004fda7b1c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:14.400406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-327f721d-f50f-4e39-a240-8c004fda7b1c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:14.407160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-327f721d-f50f-4e39-a240-8c004fda7b1c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:14.407605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-327f721d-f50f-4e39-a240-8c004fda7b1c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:14.408356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-327f721d-f50f-4e39-a240-8c004fda7b1c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:14.408784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-327f721d-f50f-4e39-a240-8c004fda7b1c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:14.474355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-327f721d-f50f-4e39-a240-8c004fda7b1c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:14.482432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-327f721d-f50f-4e39-a240-8c004fda7b1c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086588 Jun 02 19:10:14.482984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 624/1267] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:14 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:14.513947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fd16553f-966e-4ab9-a237-cad40a5e8746 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:14.514917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fd16553f-966e-4ab9-a237-cad40a5e8746 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:14.517301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=84 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:14.523040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd16553f-966e-4ab9-a237-cad40a5e8746 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:14.523492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd16553f-966e-4ab9-a237-cad40a5e8746 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:14.524256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd16553f-966e-4ab9-a237-cad40a5e8746 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:14.524687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd16553f-966e-4ab9-a237-cad40a5e8746 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:14.553835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fd16553f-966e-4ab9-a237-cad40a5e8746 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044639 Jun 02 19:10:14.554381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 644/1268] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:14.845453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2509a13a-5094-43f0-87ee-99461bbf0574 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:14.846458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2509a13a-5094-43f0-87ee-99461bbf0574 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:14.853395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2509a13a-5094-43f0-87ee-99461bbf0574 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:14.853892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2509a13a-5094-43f0-87ee-99461bbf0574 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:14.854895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2509a13a-5094-43f0-87ee-99461bbf0574 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:14.855286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2509a13a-5094-43f0-87ee-99461bbf0574 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:14.883973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2509a13a-5094-43f0-87ee-99461bbf0574 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 Jun 02 19:10:14.884513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 625/1269] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:15.500205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eba5d443-c6db-4d8f-bb79-3f2de82adb08 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:15.500822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-eba5d443-c6db-4d8f-bb79-3f2de82adb08 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:15.509290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eba5d443-c6db-4d8f-bb79-3f2de82adb08 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:15.509753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eba5d443-c6db-4d8f-bb79-3f2de82adb08 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:15.510596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eba5d443-c6db-4d8f-bb79-3f2de82adb08 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:15.511036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eba5d443-c6db-4d8f-bb79-3f2de82adb08 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:15.565360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3c8409d2-34d6-4572-9ec3-05980abcdf9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:15.566277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3c8409d2-34d6-4572-9ec3-05980abcdf9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:15.574488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c8409d2-34d6-4572-9ec3-05980abcdf9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:15.574488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c8409d2-34d6-4572-9ec3-05980abcdf9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:15.575216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c8409d2-34d6-4572-9ec3-05980abcdf9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:15.575836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c8409d2-34d6-4572-9ec3-05980abcdf9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:15.576500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eba5d443-c6db-4d8f-bb79-3f2de82adb08 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:15.584647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eba5d443-c6db-4d8f-bb79-3f2de82adb08 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088852 Jun 02 19:10:15.585229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 645/1270] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:15 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:15.615833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3c8409d2-34d6-4572-9ec3-05980abcdf9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054518 Jun 02 19:10:15.616378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 626/1271] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:15.900436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-651c8393-f7ec-47ae-a6e2-20de23f1670b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:15.902682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-651c8393-f7ec-47ae-a6e2-20de23f1670b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:15.913866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-651c8393-f7ec-47ae-a6e2-20de23f1670b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:15.914693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-651c8393-f7ec-47ae-a6e2-20de23f1670b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:15.915954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-651c8393-f7ec-47ae-a6e2-20de23f1670b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:15.916688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-651c8393-f7ec-47ae-a6e2-20de23f1670b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:15.949014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-651c8393-f7ec-47ae-a6e2-20de23f1670b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055446 Jun 02 19:10:15.949868 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 646/1272] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:16.605867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b884064e-430a-48ff-b6c5-6af85df5b82a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:16.606415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b884064e-430a-48ff-b6c5-6af85df5b82a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:16.613178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b884064e-430a-48ff-b6c5-6af85df5b82a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:16.613623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b884064e-430a-48ff-b6c5-6af85df5b82a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:16.614428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b884064e-430a-48ff-b6c5-6af85df5b82a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:16.614856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b884064e-430a-48ff-b6c5-6af85df5b82a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:16.628624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7e81a8bb-8105-421f-a3bc-b91a1fae8c04 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:16.629566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7e81a8bb-8105-421f-a3bc-b91a1fae8c04 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:16.636569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e81a8bb-8105-421f-a3bc-b91a1fae8c04 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:16.637896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e81a8bb-8105-421f-a3bc-b91a1fae8c04 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:16.638676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e81a8bb-8105-421f-a3bc-b91a1fae8c04 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:16.639121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e81a8bb-8105-421f-a3bc-b91a1fae8c04 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:16.669884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7e81a8bb-8105-421f-a3bc-b91a1fae8c04 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045331 Jun 02 19:10:16.670454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 647/1273] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:16.680153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b884064e-430a-48ff-b6c5-6af85df5b82a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:16.688264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b884064e-430a-48ff-b6c5-6af85df5b82a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088106 Jun 02 19:10:16.688823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 627/1274] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:16 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:16.965740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-36ca354e-ec61-4b7f-880f-4ea655942e84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:16.966919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-36ca354e-ec61-4b7f-880f-4ea655942e84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:16.974550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36ca354e-ec61-4b7f-880f-4ea655942e84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:16.974731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36ca354e-ec61-4b7f-880f-4ea655942e84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:16.975549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36ca354e-ec61-4b7f-880f-4ea655942e84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:16.976072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36ca354e-ec61-4b7f-880f-4ea655942e84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:17.007598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-36ca354e-ec61-4b7f-880f-4ea655942e84 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047374 Jun 02 19:10:17.008141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 648/1275] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:17.683044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-152867b0-8c1a-467a-89b1-10383cc69197 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:17.684007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-152867b0-8c1a-467a-89b1-10383cc69197 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:17.690839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-152867b0-8c1a-467a-89b1-10383cc69197 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:17.691283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-152867b0-8c1a-467a-89b1-10383cc69197 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:17.692038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-152867b0-8c1a-467a-89b1-10383cc69197 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:17.692464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-152867b0-8c1a-467a-89b1-10383cc69197 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:17.706616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a9939a86-0d67-4f66-bc14-88a79e81bcd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:17.707316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a9939a86-0d67-4f66-bc14-88a79e81bcd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:17.714343 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9939a86-0d67-4f66-bc14-88a79e81bcd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:17.714779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9939a86-0d67-4f66-bc14-88a79e81bcd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:17.715677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9939a86-0d67-4f66-bc14-88a79e81bcd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:17.716293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9939a86-0d67-4f66-bc14-88a79e81bcd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:17.723331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-152867b0-8c1a-467a-89b1-10383cc69197 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045115 Jun 02 19:10:17.723886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 628/1276] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:17.784099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a9939a86-0d67-4f66-bc14-88a79e81bcd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:17.787492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:17.796985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a9939a86-0d67-4f66-bc14-88a79e81bcd2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094100 Jun 02 19:10:17.797746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 649/1277] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:17 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:18.023691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eb7f47ea-b305-4498-9fc9-eef912854138 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:18.025291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-eb7f47ea-b305-4498-9fc9-eef912854138 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:18.035871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb7f47ea-b305-4498-9fc9-eef912854138 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:18.036619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb7f47ea-b305-4498-9fc9-eef912854138 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:18.038023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb7f47ea-b305-4498-9fc9-eef912854138 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:18.038634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb7f47ea-b305-4498-9fc9-eef912854138 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:18.070209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-eb7f47ea-b305-4498-9fc9-eef912854138 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052867 Jun 02 19:10:18.070769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 629/1278] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:18.739285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-87ad7275-a2bf-4f17-8749-d38e8501d0af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:18.740648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-87ad7275-a2bf-4f17-8749-d38e8501d0af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:18.751518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-87ad7275-a2bf-4f17-8749-d38e8501d0af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:18.752201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-87ad7275-a2bf-4f17-8749-d38e8501d0af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:18.753354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-87ad7275-a2bf-4f17-8749-d38e8501d0af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:18.754094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-87ad7275-a2bf-4f17-8749-d38e8501d0af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:18.788640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-87ad7275-a2bf-4f17-8749-d38e8501d0af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055831 Jun 02 19:10:18.789192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 650/1279] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:18.822736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b2d3ad77-9430-4ea2-a7e9-2e8a6adbd331 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:18.823414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b2d3ad77-9430-4ea2-a7e9-2e8a6adbd331 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:18.830819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2d3ad77-9430-4ea2-a7e9-2e8a6adbd331 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:18.831267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2d3ad77-9430-4ea2-a7e9-2e8a6adbd331 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:18.832144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2d3ad77-9430-4ea2-a7e9-2e8a6adbd331 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:18.832579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2d3ad77-9430-4ea2-a7e9-2e8a6adbd331 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:18.902815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b2d3ad77-9430-4ea2-a7e9-2e8a6adbd331 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:18.910067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b2d3ad77-9430-4ea2-a7e9-2e8a6adbd331 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094095 Jun 02 19:10:18.910626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 630/1280] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:18 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:19.085385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-81ebf635-a302-484d-b2bd-a0c0708a2c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:19.086606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-81ebf635-a302-484d-b2bd-a0c0708a2c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:19.094477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81ebf635-a302-484d-b2bd-a0c0708a2c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:19.094931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81ebf635-a302-484d-b2bd-a0c0708a2c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:19.095741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81ebf635-a302-484d-b2bd-a0c0708a2c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:19.096176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81ebf635-a302-484d-b2bd-a0c0708a2c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:19.128088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-81ebf635-a302-484d-b2bd-a0c0708a2c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049448 Jun 02 19:10:19.128626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 651/1281] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:19.801612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-93c17df4-345e-4c3f-a9e8-b49f545bbc3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:19.802489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-93c17df4-345e-4c3f-a9e8-b49f545bbc3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:19.809236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93c17df4-345e-4c3f-a9e8-b49f545bbc3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:19.809681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93c17df4-345e-4c3f-a9e8-b49f545bbc3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:19.810466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93c17df4-345e-4c3f-a9e8-b49f545bbc3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:19.810893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93c17df4-345e-4c3f-a9e8-b49f545bbc3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:19.845750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-93c17df4-345e-4c3f-a9e8-b49f545bbc3c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048258 Jun 02 19:10:19.846431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 631/1282] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:19.928620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-641346d3-e3ef-4a77-b304-3a58d67fd32c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:19.929265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-641346d3-e3ef-4a77-b304-3a58d67fd32c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:19.937822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-641346d3-e3ef-4a77-b304-3a58d67fd32c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:19.938278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-641346d3-e3ef-4a77-b304-3a58d67fd32c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:19.939064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-641346d3-e3ef-4a77-b304-3a58d67fd32c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:19.939501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-641346d3-e3ef-4a77-b304-3a58d67fd32c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:20.004604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-641346d3-e3ef-4a77-b304-3a58d67fd32c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:20.015688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-641346d3-e3ef-4a77-b304-3a58d67fd32c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092572 Jun 02 19:10:20.016552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 652/1283] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:19 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:20.141788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9bed82f6-e5e0-4839-9c1a-784d8f22eed3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:20.142755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9bed82f6-e5e0-4839-9c1a-784d8f22eed3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:20.149789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bed82f6-e5e0-4839-9c1a-784d8f22eed3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:20.150436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bed82f6-e5e0-4839-9c1a-784d8f22eed3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:20.151205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bed82f6-e5e0-4839-9c1a-784d8f22eed3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:20.151634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bed82f6-e5e0-4839-9c1a-784d8f22eed3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:20.186295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9bed82f6-e5e0-4839-9c1a-784d8f22eed3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048531 Jun 02 19:10:20.186881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 632/1284] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:20.809342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:10:20.809571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:10:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:10:20.860061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d0f09d4-49ef-4dfb-bcfa-8e4f75a52fb0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:20.861006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d0f09d4-49ef-4dfb-bcfa-8e4f75a52fb0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:20.867279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0f09d4-49ef-4dfb-bcfa-8e4f75a52fb0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:20.867765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0f09d4-49ef-4dfb-bcfa-8e4f75a52fb0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:20.868535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0f09d4-49ef-4dfb-bcfa-8e4f75a52fb0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:20.868968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0f09d4-49ef-4dfb-bcfa-8e4f75a52fb0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:20.903493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d0f09d4-49ef-4dfb-bcfa-8e4f75a52fb0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046671 Jun 02 19:10:20.904195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 653/1285] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:21.033377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9a55ca6d-3dd3-49f7-b407-eb7f390bb68c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:21.034154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9a55ca6d-3dd3-49f7-b407-eb7f390bb68c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:21.040882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a55ca6d-3dd3-49f7-b407-eb7f390bb68c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:21.041351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a55ca6d-3dd3-49f7-b407-eb7f390bb68c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:21.042144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a55ca6d-3dd3-49f7-b407-eb7f390bb68c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:21.042585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a55ca6d-3dd3-49f7-b407-eb7f390bb68c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:21.107506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9a55ca6d-3dd3-49f7-b407-eb7f390bb68c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:21.115413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9a55ca6d-3dd3-49f7-b407-eb7f390bb68c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.086080 Jun 02 19:10:21.115973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 633/1286] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:21 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:21.255569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b9aad2be-60aa-468b-af2f-acb853a72899 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:21.256601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b9aad2be-60aa-468b-af2f-acb853a72899 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:21.263518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9aad2be-60aa-468b-af2f-acb853a72899 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:21.263980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9aad2be-60aa-468b-af2f-acb853a72899 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:21.264752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9aad2be-60aa-468b-af2f-acb853a72899 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:21.265186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9aad2be-60aa-468b-af2f-acb853a72899 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:21.294453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b9aad2be-60aa-468b-af2f-acb853a72899 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042929 Jun 02 19:10:21.295019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 654/1287] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:21.916987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e1e73b8f-79f2-4ec3-bb44-4bc48c800a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:21.917942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e1e73b8f-79f2-4ec3-bb44-4bc48c800a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:21.925099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1e73b8f-79f2-4ec3-bb44-4bc48c800a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:21.925549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1e73b8f-79f2-4ec3-bb44-4bc48c800a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:21.926369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1e73b8f-79f2-4ec3-bb44-4bc48c800a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:21.926803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1e73b8f-79f2-4ec3-bb44-4bc48c800a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:21.958211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e1e73b8f-79f2-4ec3-bb44-4bc48c800a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045238 Jun 02 19:10:21.958766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 634/1288] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:22.136658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3fe027c7-b94c-4ec4-8d2d-d45aa6c74d65 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:22.137714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3fe027c7-b94c-4ec4-8d2d-d45aa6c74d65 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:22.147964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3fe027c7-b94c-4ec4-8d2d-d45aa6c74d65 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:22.148725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3fe027c7-b94c-4ec4-8d2d-d45aa6c74d65 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:22.150039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3fe027c7-b94c-4ec4-8d2d-d45aa6c74d65 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:22.150761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3fe027c7-b94c-4ec4-8d2d-d45aa6c74d65 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:22.227473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3fe027c7-b94c-4ec4-8d2d-d45aa6c74d65 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:22.235747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3fe027c7-b94c-4ec4-8d2d-d45aa6c74d65 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.105648 Jun 02 19:10:22.236336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 655/1289] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:22 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:22.310245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6c9689fc-37b8-4f92-b86d-d372f989dcce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:22.311218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6c9689fc-37b8-4f92-b86d-d372f989dcce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:22.318489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c9689fc-37b8-4f92-b86d-d372f989dcce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:22.318937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c9689fc-37b8-4f92-b86d-d372f989dcce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:22.320049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c9689fc-37b8-4f92-b86d-d372f989dcce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:22.320483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c9689fc-37b8-4f92-b86d-d372f989dcce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:22.350235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6c9689fc-37b8-4f92-b86d-d372f989dcce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047170 Jun 02 19:10:22.350805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 635/1290] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:22.972217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47aaa3ef-a57c-4d2c-9215-32359c21d848 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:22.973153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47aaa3ef-a57c-4d2c-9215-32359c21d848 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:22.980207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47aaa3ef-a57c-4d2c-9215-32359c21d848 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:22.980665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47aaa3ef-a57c-4d2c-9215-32359c21d848 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:22.981631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47aaa3ef-a57c-4d2c-9215-32359c21d848 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:22.982088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47aaa3ef-a57c-4d2c-9215-32359c21d848 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:23.012409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47aaa3ef-a57c-4d2c-9215-32359c21d848 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044258 Jun 02 19:10:23.013198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 656/1291] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:23.255303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0c6997b0-9394-4eed-9eb2-a77b6fa8e67d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:23.255957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0c6997b0-9394-4eed-9eb2-a77b6fa8e67d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:23.263820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c6997b0-9394-4eed-9eb2-a77b6fa8e67d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:23.264616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c6997b0-9394-4eed-9eb2-a77b6fa8e67d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:23.265399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c6997b0-9394-4eed-9eb2-a77b6fa8e67d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:23.265827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c6997b0-9394-4eed-9eb2-a77b6fa8e67d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:23.339856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0c6997b0-9394-4eed-9eb2-a77b6fa8e67d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:23.348107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0c6997b0-9394-4eed-9eb2-a77b6fa8e67d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098126 Jun 02 19:10:23.348682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 636/1292] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:23 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:23.362017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8238ae18-ae93-4bd0-8ec7-b75309cf680d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:23.362951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8238ae18-ae93-4bd0-8ec7-b75309cf680d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:23.369353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8238ae18-ae93-4bd0-8ec7-b75309cf680d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:23.369840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8238ae18-ae93-4bd0-8ec7-b75309cf680d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:23.370669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8238ae18-ae93-4bd0-8ec7-b75309cf680d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:23.371108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8238ae18-ae93-4bd0-8ec7-b75309cf680d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:23.400986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8238ae18-ae93-4bd0-8ec7-b75309cf680d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Jun 02 19:10:23.401548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 657/1293] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:24.024501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16dc0964-16fd-4203-8b81-0b343493249b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:24.025433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-16dc0964-16fd-4203-8b81-0b343493249b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:24.032861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16dc0964-16fd-4203-8b81-0b343493249b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:24.033215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16dc0964-16fd-4203-8b81-0b343493249b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:24.034024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16dc0964-16fd-4203-8b81-0b343493249b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:24.034428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16dc0964-16fd-4203-8b81-0b343493249b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:24.049883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:24.065674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16dc0964-16fd-4203-8b81-0b343493249b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045314 Jun 02 19:10:24.066255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 637/1294] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:24.365076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-14a12d83-fea9-4fb3-b6ea-da7e04b393cb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:24.365697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-14a12d83-fea9-4fb3-b6ea-da7e04b393cb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:24.372351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14a12d83-fea9-4fb3-b6ea-da7e04b393cb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:24.372811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14a12d83-fea9-4fb3-b6ea-da7e04b393cb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:24.373583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14a12d83-fea9-4fb3-b6ea-da7e04b393cb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:24.374051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14a12d83-fea9-4fb3-b6ea-da7e04b393cb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:24.414288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-772f5235-07e0-41da-a15c-840371a05f3f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:24.415231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-772f5235-07e0-41da-a15c-840371a05f3f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:24.422258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-772f5235-07e0-41da-a15c-840371a05f3f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:24.422738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-772f5235-07e0-41da-a15c-840371a05f3f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:24.423546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-772f5235-07e0-41da-a15c-840371a05f3f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:24.423980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-772f5235-07e0-41da-a15c-840371a05f3f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:24.435272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-14a12d83-fea9-4fb3-b6ea-da7e04b393cb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:24.443055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-14a12d83-fea9-4fb3-b6ea-da7e04b393cb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.081979 Jun 02 19:10:24.443654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 658/1295] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:24 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:24.454129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-772f5235-07e0-41da-a15c-840371a05f3f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Jun 02 19:10:24.454729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 638/1296] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:10:25.082642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8fd73fd3-1582-4600-b41d-d9959fdfef75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:25.084208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8fd73fd3-1582-4600-b41d-d9959fdfef75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:25.094208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fd73fd3-1582-4600-b41d-d9959fdfef75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:25.094657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fd73fd3-1582-4600-b41d-d9959fdfef75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:25.095423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fd73fd3-1582-4600-b41d-d9959fdfef75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:25.095855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fd73fd3-1582-4600-b41d-d9959fdfef75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:25.126302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8fd73fd3-1582-4600-b41d-d9959fdfef75 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050498 Jun 02 19:10:25.126853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 659/1297] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:25.464371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0c000ab4-afe3-49df-8749-544fd27168f4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:25.465450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0c000ab4-afe3-49df-8749-544fd27168f4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:25.469850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92b77c71-5572-440a-8975-3502c0bfea2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:25.471442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92b77c71-5572-440a-8975-3502c0bfea2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:25.476796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c000ab4-afe3-49df-8749-544fd27168f4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:25.477544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c000ab4-afe3-49df-8749-544fd27168f4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:25.478845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c000ab4-afe3-49df-8749-544fd27168f4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:25.479571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c000ab4-afe3-49df-8749-544fd27168f4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:25.482248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92b77c71-5572-440a-8975-3502c0bfea2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:25.483013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92b77c71-5572-440a-8975-3502c0bfea2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:25.484796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92b77c71-5572-440a-8975-3502c0bfea2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:25.485243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92b77c71-5572-440a-8975-3502c0bfea2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:25.515932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92b77c71-5572-440a-8975-3502c0bfea2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052371 Jun 02 19:10:25.516521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 660/1298] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:25.543521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0c000ab4-afe3-49df-8749-544fd27168f4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:25.551632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0c000ab4-afe3-49df-8749-544fd27168f4 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093870 Jun 02 19:10:25.552198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 639/1299] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:25 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:26.141576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-992a9ad3-85f0-4717-b445-d55610bcff81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:26.142645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-992a9ad3-85f0-4717-b445-d55610bcff81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:26.149313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-992a9ad3-85f0-4717-b445-d55610bcff81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:26.149821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-992a9ad3-85f0-4717-b445-d55610bcff81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:26.150633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-992a9ad3-85f0-4717-b445-d55610bcff81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:26.151098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-992a9ad3-85f0-4717-b445-d55610bcff81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:26.182533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-992a9ad3-85f0-4717-b445-d55610bcff81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047002 Jun 02 19:10:26.183083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 661/1300] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:26.532033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9a536fec-9cd0-40db-b8e9-0bb85d6cf7c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:26.532890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9a536fec-9cd0-40db-b8e9-0bb85d6cf7c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:26.540057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a536fec-9cd0-40db-b8e9-0bb85d6cf7c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:26.540521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a536fec-9cd0-40db-b8e9-0bb85d6cf7c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:26.541377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a536fec-9cd0-40db-b8e9-0bb85d6cf7c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:26.541823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a536fec-9cd0-40db-b8e9-0bb85d6cf7c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:26.568717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cac9ee19-a354-4c05-8d11-e765802e300f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:26.569811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cac9ee19-a354-4c05-8d11-e765802e300f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:26.572520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9a536fec-9cd0-40db-b8e9-0bb85d6cf7c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046931 Jun 02 19:10:26.573092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 640/1301] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:26.576695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cac9ee19-a354-4c05-8d11-e765802e300f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:26.577154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cac9ee19-a354-4c05-8d11-e765802e300f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:26.577966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cac9ee19-a354-4c05-8d11-e765802e300f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:26.578417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cac9ee19-a354-4c05-8d11-e765802e300f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:26.651893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cac9ee19-a354-4c05-8d11-e765802e300f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:26.662200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cac9ee19-a354-4c05-8d11-e765802e300f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097356 Jun 02 19:10:26.662768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 662/1302] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:26 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:27.195287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd68d6af-a11c-48eb-81c9-1377b941e5fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:27.196116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fd68d6af-a11c-48eb-81c9-1377b941e5fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:27.202936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd68d6af-a11c-48eb-81c9-1377b941e5fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:27.203529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd68d6af-a11c-48eb-81c9-1377b941e5fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:27.204284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd68d6af-a11c-48eb-81c9-1377b941e5fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:27.204715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd68d6af-a11c-48eb-81c9-1377b941e5fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:27.234523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd68d6af-a11c-48eb-81c9-1377b941e5fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043803 Jun 02 19:10:27.235069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 641/1303] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:27.588364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-20ea7689-2aeb-4187-8926-1ffeb7fbe953 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:27.589756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-20ea7689-2aeb-4187-8926-1ffeb7fbe953 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:27.600347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-20ea7689-2aeb-4187-8926-1ffeb7fbe953 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:27.601021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-20ea7689-2aeb-4187-8926-1ffeb7fbe953 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:27.602267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-20ea7689-2aeb-4187-8926-1ffeb7fbe953 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:27.602934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-20ea7689-2aeb-4187-8926-1ffeb7fbe953 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:27.634618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-20ea7689-2aeb-4187-8926-1ffeb7fbe953 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052782 Jun 02 19:10:27.635155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 663/1304] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:27.684561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59874bfe-7c7c-4781-8a5a-621079e53178 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:27.685569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-59874bfe-7c7c-4781-8a5a-621079e53178 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:27.697007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59874bfe-7c7c-4781-8a5a-621079e53178 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:27.697755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59874bfe-7c7c-4781-8a5a-621079e53178 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:27.699074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59874bfe-7c7c-4781-8a5a-621079e53178 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:27.699791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59874bfe-7c7c-4781-8a5a-621079e53178 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:27.778353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-59874bfe-7c7c-4781-8a5a-621079e53178 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:27.790546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-59874bfe-7c7c-4781-8a5a-621079e53178 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.112488 Jun 02 19:10:27.791178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 642/1305] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:27 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:28.250441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a68265e8-05f4-4a9e-b178-e973caa881a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:28.251511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a68265e8-05f4-4a9e-b178-e973caa881a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:28.258060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a68265e8-05f4-4a9e-b178-e973caa881a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:28.258524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a68265e8-05f4-4a9e-b178-e973caa881a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:28.259293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a68265e8-05f4-4a9e-b178-e973caa881a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:28.259735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a68265e8-05f4-4a9e-b178-e973caa881a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:28.299861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a68265e8-05f4-4a9e-b178-e973caa881a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055931 Jun 02 19:10:28.300421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 664/1306] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:28.652494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2b33d238-1014-47fc-865b-cd80b90f38d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:28.654083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2b33d238-1014-47fc-865b-cd80b90f38d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:28.661231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b33d238-1014-47fc-865b-cd80b90f38d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:28.661683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b33d238-1014-47fc-865b-cd80b90f38d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:28.662470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b33d238-1014-47fc-865b-cd80b90f38d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:28.662927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b33d238-1014-47fc-865b-cd80b90f38d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:28.692314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2b33d238-1014-47fc-865b-cd80b90f38d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Jun 02 19:10:28.692990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 643/1307] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:28.813317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-86cd0eea-28d3-4ebe-b75a-c017d656fecf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:28.813906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-86cd0eea-28d3-4ebe-b75a-c017d656fecf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:28.821637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86cd0eea-28d3-4ebe-b75a-c017d656fecf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:28.822139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86cd0eea-28d3-4ebe-b75a-c017d656fecf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:28.822911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86cd0eea-28d3-4ebe-b75a-c017d656fecf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:28.823352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86cd0eea-28d3-4ebe-b75a-c017d656fecf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:28.886800 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-86cd0eea-28d3-4ebe-b75a-c017d656fecf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:28.894756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-86cd0eea-28d3-4ebe-b75a-c017d656fecf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089214 Jun 02 19:10:28.895313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 665/1308] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:28 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:29.313686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8566aae3-5a3b-45da-be8e-e8dcdd773af2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:29.314811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8566aae3-5a3b-45da-be8e-e8dcdd773af2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:29.322799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8566aae3-5a3b-45da-be8e-e8dcdd773af2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:29.323332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8566aae3-5a3b-45da-be8e-e8dcdd773af2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:29.324185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8566aae3-5a3b-45da-be8e-e8dcdd773af2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:29.324721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8566aae3-5a3b-45da-be8e-e8dcdd773af2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:29.356395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8566aae3-5a3b-45da-be8e-e8dcdd773af2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047981 Jun 02 19:10:29.357263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 644/1309] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:29.708979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a8a0a018-4d98-4b93-b4b8-11b89a1302cf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:29.710548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a8a0a018-4d98-4b93-b4b8-11b89a1302cf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:29.720088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8a0a018-4d98-4b93-b4b8-11b89a1302cf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:29.720545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8a0a018-4d98-4b93-b4b8-11b89a1302cf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:29.721322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8a0a018-4d98-4b93-b4b8-11b89a1302cf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:29.721760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8a0a018-4d98-4b93-b4b8-11b89a1302cf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:29.736686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:29.755707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a8a0a018-4d98-4b93-b4b8-11b89a1302cf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053847 Jun 02 19:10:29.756266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 666/1310] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:29.916408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-948f3b1e-4707-47e8-9418-eab4b65c1250 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:29.916996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-948f3b1e-4707-47e8-9418-eab4b65c1250 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:29.923574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-948f3b1e-4707-47e8-9418-eab4b65c1250 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:29.924050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-948f3b1e-4707-47e8-9418-eab4b65c1250 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:29.924934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-948f3b1e-4707-47e8-9418-eab4b65c1250 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:29.925341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-948f3b1e-4707-47e8-9418-eab4b65c1250 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:29.997641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-948f3b1e-4707-47e8-9418-eab4b65c1250 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:30.006833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-948f3b1e-4707-47e8-9418-eab4b65c1250 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094363 Jun 02 19:10:30.007409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 645/1311] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:29 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:30.370769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b0afa730-0a54-40cf-a0ef-4a53df85d833 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:30.371911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b0afa730-0a54-40cf-a0ef-4a53df85d833 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:30.379110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0afa730-0a54-40cf-a0ef-4a53df85d833 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:30.379560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0afa730-0a54-40cf-a0ef-4a53df85d833 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:30.380319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0afa730-0a54-40cf-a0ef-4a53df85d833 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:30.380755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0afa730-0a54-40cf-a0ef-4a53df85d833 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:30.410269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b0afa730-0a54-40cf-a0ef-4a53df85d833 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044740 Jun 02 19:10:30.410816 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 667/1312] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:30.770949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6bd7e23f-59d6-4220-8f38-48645b9f3d5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:30.772165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6bd7e23f-59d6-4220-8f38-48645b9f3d5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:30.781199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bd7e23f-59d6-4220-8f38-48645b9f3d5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:30.781999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bd7e23f-59d6-4220-8f38-48645b9f3d5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:30.783060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bd7e23f-59d6-4220-8f38-48645b9f3d5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:30.783639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bd7e23f-59d6-4220-8f38-48645b9f3d5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:30.816491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6bd7e23f-59d6-4220-8f38-48645b9f3d5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051347 Jun 02 19:10:30.817048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 646/1313] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:31.029021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2e042c62-a561-4d90-9591-45d3e6c03ee9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:31.029871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2e042c62-a561-4d90-9591-45d3e6c03ee9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:31.037523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e042c62-a561-4d90-9591-45d3e6c03ee9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:31.038039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e042c62-a561-4d90-9591-45d3e6c03ee9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:31.038829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e042c62-a561-4d90-9591-45d3e6c03ee9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:31.039273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e042c62-a561-4d90-9591-45d3e6c03ee9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:31.103654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e042c62-a561-4d90-9591-45d3e6c03ee9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:31.111422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2e042c62-a561-4d90-9591-45d3e6c03ee9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088951 Jun 02 19:10:31.111961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 668/1314] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:31 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:31.422676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-42720d41-e38a-4a89-b76c-2cfc9ac506c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:31.423460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-42720d41-e38a-4a89-b76c-2cfc9ac506c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:31.429738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42720d41-e38a-4a89-b76c-2cfc9ac506c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:31.430224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42720d41-e38a-4a89-b76c-2cfc9ac506c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:31.431226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42720d41-e38a-4a89-b76c-2cfc9ac506c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:31.431661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42720d41-e38a-4a89-b76c-2cfc9ac506c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:31.464278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-42720d41-e38a-4a89-b76c-2cfc9ac506c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046035 Jun 02 19:10:31.464834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 647/1315] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:31.834138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a21b118-84bf-447f-b4c0-bb54015f1eb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:31.835654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2a21b118-84bf-447f-b4c0-bb54015f1eb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:31.845556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a21b118-84bf-447f-b4c0-bb54015f1eb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:31.846179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a21b118-84bf-447f-b4c0-bb54015f1eb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:31.847021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a21b118-84bf-447f-b4c0-bb54015f1eb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:31.847486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2a21b118-84bf-447f-b4c0-bb54015f1eb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:31.882467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a21b118-84bf-447f-b4c0-bb54015f1eb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055255 Jun 02 19:10:31.883015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 669/1316] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:32.134058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-290982f2-3612-4820-b709-08e7989fba78 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:32.135258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-290982f2-3612-4820-b709-08e7989fba78 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:32.144940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-290982f2-3612-4820-b709-08e7989fba78 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:32.145384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-290982f2-3612-4820-b709-08e7989fba78 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:32.146180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-290982f2-3612-4820-b709-08e7989fba78 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:32.146605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-290982f2-3612-4820-b709-08e7989fba78 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:32.215175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-290982f2-3612-4820-b709-08e7989fba78 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:32.227394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-290982f2-3612-4820-b709-08e7989fba78 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.100729 Jun 02 19:10:32.228105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 648/1317] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:32 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:32.477182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e51b3c0e-0a5f-49f5-90ba-46ce991394d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:32.478125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e51b3c0e-0a5f-49f5-90ba-46ce991394d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:32.484872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e51b3c0e-0a5f-49f5-90ba-46ce991394d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:32.485365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e51b3c0e-0a5f-49f5-90ba-46ce991394d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:32.486173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e51b3c0e-0a5f-49f5-90ba-46ce991394d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:32.486614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e51b3c0e-0a5f-49f5-90ba-46ce991394d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:32.516549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e51b3c0e-0a5f-49f5-90ba-46ce991394d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043500 Jun 02 19:10:32.517101 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 670/1318] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:32.898064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b5a85e28-23bc-4708-a348-76b8887ebfb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:32.899026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b5a85e28-23bc-4708-a348-76b8887ebfb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:32.906081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5a85e28-23bc-4708-a348-76b8887ebfb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:32.906607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5a85e28-23bc-4708-a348-76b8887ebfb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:32.907361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5a85e28-23bc-4708-a348-76b8887ebfb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:32.907795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5a85e28-23bc-4708-a348-76b8887ebfb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:32.937911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b5a85e28-23bc-4708-a348-76b8887ebfb5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Jun 02 19:10:32.938453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 649/1319] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:33.250793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6641e031-6cd8-4d70-825f-cff1ab62247c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:33.251383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6641e031-6cd8-4d70-825f-cff1ab62247c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:33.258759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6641e031-6cd8-4d70-825f-cff1ab62247c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:33.259243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6641e031-6cd8-4d70-825f-cff1ab62247c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:33.260089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6641e031-6cd8-4d70-825f-cff1ab62247c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:33.260554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6641e031-6cd8-4d70-825f-cff1ab62247c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:33.327241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6641e031-6cd8-4d70-825f-cff1ab62247c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:33.339164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6641e031-6cd8-4d70-825f-cff1ab62247c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094534 Jun 02 19:10:33.339836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 671/1320] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:33 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:33.536443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3e9182dc-b59c-47a3-8510-3ddafa5b276e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:33.537858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3e9182dc-b59c-47a3-8510-3ddafa5b276e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:33.548084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e9182dc-b59c-47a3-8510-3ddafa5b276e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:33.548537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e9182dc-b59c-47a3-8510-3ddafa5b276e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:33.549335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e9182dc-b59c-47a3-8510-3ddafa5b276e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:33.549764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e9182dc-b59c-47a3-8510-3ddafa5b276e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:33.580821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3e9182dc-b59c-47a3-8510-3ddafa5b276e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052908 Jun 02 19:10:33.581376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 650/1321] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:33.952332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-33d54fff-e013-48d7-b027-315177599da1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:33.954061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-33d54fff-e013-48d7-b027-315177599da1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:33.962571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33d54fff-e013-48d7-b027-315177599da1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:33.963185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33d54fff-e013-48d7-b027-315177599da1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:33.964227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33d54fff-e013-48d7-b027-315177599da1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:33.964821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33d54fff-e013-48d7-b027-315177599da1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:33.998175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-33d54fff-e013-48d7-b027-315177599da1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051272 Jun 02 19:10:33.998744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 672/1322] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:34.359988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-48ef134c-8716-490a-9f8d-ed321f3ff3fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:34.360958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-48ef134c-8716-490a-9f8d-ed321f3ff3fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:34.368775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48ef134c-8716-490a-9f8d-ed321f3ff3fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:34.369513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48ef134c-8716-490a-9f8d-ed321f3ff3fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:34.370837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48ef134c-8716-490a-9f8d-ed321f3ff3fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:34.371402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48ef134c-8716-490a-9f8d-ed321f3ff3fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:34.435239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-48ef134c-8716-490a-9f8d-ed321f3ff3fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:34.447658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-48ef134c-8716-490a-9f8d-ed321f3ff3fb tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093396 Jun 02 19:10:34.448266 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 651/1323] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:34 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:34.595873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0ca90d0d-d897-42a8-ab14-63645f99775c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:34.596732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0ca90d0d-d897-42a8-ab14-63645f99775c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:34.603640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ca90d0d-d897-42a8-ab14-63645f99775c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:34.604100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ca90d0d-d897-42a8-ab14-63645f99775c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:34.604972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ca90d0d-d897-42a8-ab14-63645f99775c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:34.605407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ca90d0d-d897-42a8-ab14-63645f99775c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:34.636049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0ca90d0d-d897-42a8-ab14-63645f99775c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046258 Jun 02 19:10:34.636624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 673/1324] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:35.011281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b74aa9b4-13f0-4e53-85c9-1c8cb921a9d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:35.012253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b74aa9b4-13f0-4e53-85c9-1c8cb921a9d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:35.020409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b74aa9b4-13f0-4e53-85c9-1c8cb921a9d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:35.020855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b74aa9b4-13f0-4e53-85c9-1c8cb921a9d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:35.021608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b74aa9b4-13f0-4e53-85c9-1c8cb921a9d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:35.022074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b74aa9b4-13f0-4e53-85c9-1c8cb921a9d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:35.054595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b74aa9b4-13f0-4e53-85c9-1c8cb921a9d5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047193 Jun 02 19:10:35.055532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 652/1325] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:35.466713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-69c9a4e7-80f7-49aa-8ee5-8d1e55722e63 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:35.467515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-69c9a4e7-80f7-49aa-8ee5-8d1e55722e63 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:35.474743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69c9a4e7-80f7-49aa-8ee5-8d1e55722e63 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:35.475191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69c9a4e7-80f7-49aa-8ee5-8d1e55722e63 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:35.475956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69c9a4e7-80f7-49aa-8ee5-8d1e55722e63 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:35.476391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69c9a4e7-80f7-49aa-8ee5-8d1e55722e63 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:35.553117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-69c9a4e7-80f7-49aa-8ee5-8d1e55722e63 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:35.561059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-69c9a4e7-80f7-49aa-8ee5-8d1e55722e63 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.099570 Jun 02 19:10:35.561693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 674/1326] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:35 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:10:35.654187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9072f21e-8ffb-409f-bc96-cfb9a3893534 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:35.655901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9072f21e-8ffb-409f-bc96-cfb9a3893534 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:35.664655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9072f21e-8ffb-409f-bc96-cfb9a3893534 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:35.665119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9072f21e-8ffb-409f-bc96-cfb9a3893534 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:35.666403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9072f21e-8ffb-409f-bc96-cfb9a3893534 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:35.667125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9072f21e-8ffb-409f-bc96-cfb9a3893534 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:35.706374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9072f21e-8ffb-409f-bc96-cfb9a3893534 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060225 Jun 02 19:10:35.706944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 653/1327] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:36.068262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-21456d98-091b-4725-8caf-42763d7c981f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:36.069199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-21456d98-091b-4725-8caf-42763d7c981f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:36.076295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21456d98-091b-4725-8caf-42763d7c981f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:36.076757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21456d98-091b-4725-8caf-42763d7c981f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:36.077527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21456d98-091b-4725-8caf-42763d7c981f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:36.077982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21456d98-091b-4725-8caf-42763d7c981f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:36.109195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-21456d98-091b-4725-8caf-42763d7c981f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045616 Jun 02 19:10:36.109765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 675/1328] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:36.584150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0425211f-900e-4c32-9b4b-ef645a8b7a5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:36.584897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0425211f-900e-4c32-9b4b-ef645a8b7a5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:36.594234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0425211f-900e-4c32-9b4b-ef645a8b7a5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:36.595084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0425211f-900e-4c32-9b4b-ef645a8b7a5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:36.595854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0425211f-900e-4c32-9b4b-ef645a8b7a5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:36.596287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0425211f-900e-4c32-9b4b-ef645a8b7a5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:36.598924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:36.668838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0425211f-900e-4c32-9b4b-ef645a8b7a5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:36.677059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0425211f-900e-4c32-9b4b-ef645a8b7a5d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098725 Jun 02 19:10:36.677622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 654/1329] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:36 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:36.718435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-41d8d594-5103-428f-b9dd-3d63b409f72b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:36.719363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-41d8d594-5103-428f-b9dd-3d63b409f72b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:36.726115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41d8d594-5103-428f-b9dd-3d63b409f72b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:36.726568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41d8d594-5103-428f-b9dd-3d63b409f72b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:36.727324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41d8d594-5103-428f-b9dd-3d63b409f72b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:36.727757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41d8d594-5103-428f-b9dd-3d63b409f72b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:36.757369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-41d8d594-5103-428f-b9dd-3d63b409f72b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042888 Jun 02 19:10:36.757942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 676/1330] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:37.125759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-efe57c11-0685-48c4-8ae0-ef50b9018d4b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:37.127404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-efe57c11-0685-48c4-8ae0-ef50b9018d4b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:37.136348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efe57c11-0685-48c4-8ae0-ef50b9018d4b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:37.137028 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efe57c11-0685-48c4-8ae0-ef50b9018d4b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:37.138246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efe57c11-0685-48c4-8ae0-ef50b9018d4b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:37.138907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efe57c11-0685-48c4-8ae0-ef50b9018d4b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:37.169401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-efe57c11-0685-48c4-8ae0-ef50b9018d4b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050105 Jun 02 19:10:37.170007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 655/1331] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:37.694309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bcbee0ee-0f21-4ed4-8d66-109f198fc39d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:37.695280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bcbee0ee-0f21-4ed4-8d66-109f198fc39d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:37.702503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bcbee0ee-0f21-4ed4-8d66-109f198fc39d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:37.702951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bcbee0ee-0f21-4ed4-8d66-109f198fc39d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:37.703711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bcbee0ee-0f21-4ed4-8d66-109f198fc39d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:37.704144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bcbee0ee-0f21-4ed4-8d66-109f198fc39d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:37.766564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bcbee0ee-0f21-4ed4-8d66-109f198fc39d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:37.769600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1bed3675-8d3a-42af-8b42-34b91d6e6a00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:37.770551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1bed3675-8d3a-42af-8b42-34b91d6e6a00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:37.775141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bcbee0ee-0f21-4ed4-8d66-109f198fc39d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084687 Jun 02 19:10:37.775831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 677/1332] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:37 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:37.781877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bed3675-8d3a-42af-8b42-34b91d6e6a00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:37.782376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bed3675-8d3a-42af-8b42-34b91d6e6a00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:37.783296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bed3675-8d3a-42af-8b42-34b91d6e6a00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:37.783723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bed3675-8d3a-42af-8b42-34b91d6e6a00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:37.813897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1bed3675-8d3a-42af-8b42-34b91d6e6a00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048962 Jun 02 19:10:37.814335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 656/1333] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:38.184350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f60cf1a1-bc56-4497-80a6-33c32beeda93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:38.185737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f60cf1a1-bc56-4497-80a6-33c32beeda93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:38.193393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f60cf1a1-bc56-4497-80a6-33c32beeda93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:38.193844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f60cf1a1-bc56-4497-80a6-33c32beeda93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:38.194995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f60cf1a1-bc56-4497-80a6-33c32beeda93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:38.195436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f60cf1a1-bc56-4497-80a6-33c32beeda93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:38.225214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f60cf1a1-bc56-4497-80a6-33c32beeda93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 Jun 02 19:10:38.225810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 678/1334] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:38.796527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cffea3d2-6172-4399-8048-570882129227 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:38.797348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cffea3d2-6172-4399-8048-570882129227 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:38.807615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cffea3d2-6172-4399-8048-570882129227 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:38.808298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cffea3d2-6172-4399-8048-570882129227 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:38.809444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cffea3d2-6172-4399-8048-570882129227 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:38.810143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cffea3d2-6172-4399-8048-570882129227 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:38.831057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e86d0a6d-7a75-4ec3-b9e4-bcd2d5aa483d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:38.832269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e86d0a6d-7a75-4ec3-b9e4-bcd2d5aa483d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:38.843265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e86d0a6d-7a75-4ec3-b9e4-bcd2d5aa483d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:38.843895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e86d0a6d-7a75-4ec3-b9e4-bcd2d5aa483d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:38.845066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e86d0a6d-7a75-4ec3-b9e4-bcd2d5aa483d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:38.845583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e86d0a6d-7a75-4ec3-b9e4-bcd2d5aa483d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:38.876324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e86d0a6d-7a75-4ec3-b9e4-bcd2d5aa483d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052709 Jun 02 19:10:38.876894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 679/1335] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 19:10:38.893131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cffea3d2-6172-4399-8048-570882129227 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:38.905534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cffea3d2-6172-4399-8048-570882129227 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.115324 Jun 02 19:10:38.906346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 657/1336] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:38 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:39.243564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-884b14b3-dc68-45d2-9471-90145018fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:39.244536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-884b14b3-dc68-45d2-9471-90145018fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:39.251326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-884b14b3-dc68-45d2-9471-90145018fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:39.251786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-884b14b3-dc68-45d2-9471-90145018fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:39.252719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-884b14b3-dc68-45d2-9471-90145018fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:39.253184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-884b14b3-dc68-45d2-9471-90145018fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:39.284859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-884b14b3-dc68-45d2-9471-90145018fa1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048164 Jun 02 19:10:39.285425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 680/1337] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:39.888593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-57fb5954-88a7-4a1f-8984-e69b84cda280 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:39.889514 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-57fb5954-88a7-4a1f-8984-e69b84cda280 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:39.897076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57fb5954-88a7-4a1f-8984-e69b84cda280 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:39.897269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57fb5954-88a7-4a1f-8984-e69b84cda280 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:39.898005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57fb5954-88a7-4a1f-8984-e69b84cda280 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:39.898435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57fb5954-88a7-4a1f-8984-e69b84cda280 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:39.923068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f6a20f2b-ee20-4939-ad81-5981a7c3d2a7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:39.923643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f6a20f2b-ee20-4939-ad81-5981a7c3d2a7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:39.929624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-57fb5954-88a7-4a1f-8984-e69b84cda280 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045081 Jun 02 19:10:39.930226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 658/1338] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:39.931056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6a20f2b-ee20-4939-ad81-5981a7c3d2a7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:39.931406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6a20f2b-ee20-4939-ad81-5981a7c3d2a7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:39.932099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6a20f2b-ee20-4939-ad81-5981a7c3d2a7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:39.932540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6a20f2b-ee20-4939-ad81-5981a7c3d2a7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:40.003666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f6a20f2b-ee20-4939-ad81-5981a7c3d2a7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:40.011505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f6a20f2b-ee20-4939-ad81-5981a7c3d2a7 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092285 Jun 02 19:10:40.012064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 681/1339] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:39 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:40.297012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9f43f0e4-c79a-405e-88e4-19da95cd369f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:40.297934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9f43f0e4-c79a-405e-88e4-19da95cd369f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:40.304425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f43f0e4-c79a-405e-88e4-19da95cd369f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:40.304881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f43f0e4-c79a-405e-88e4-19da95cd369f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:40.305647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f43f0e4-c79a-405e-88e4-19da95cd369f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:40.306108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f43f0e4-c79a-405e-88e4-19da95cd369f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:40.344537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9f43f0e4-c79a-405e-88e4-19da95cd369f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051327 Jun 02 19:10:40.345527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 659/1340] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:40.942669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1da13dfb-ec65-4dce-a3ea-9261a5b987cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:40.943638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1da13dfb-ec65-4dce-a3ea-9261a5b987cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:40.954132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1da13dfb-ec65-4dce-a3ea-9261a5b987cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:40.954952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1da13dfb-ec65-4dce-a3ea-9261a5b987cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:40.956047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1da13dfb-ec65-4dce-a3ea-9261a5b987cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:40.956693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1da13dfb-ec65-4dce-a3ea-9261a5b987cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:40.994964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1da13dfb-ec65-4dce-a3ea-9261a5b987cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056313 Jun 02 19:10:40.995523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 682/1341] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:41.034084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-daa2cd8c-4250-46b1-aff1-6a7b3b61bd51 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:41.034679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-daa2cd8c-4250-46b1-aff1-6a7b3b61bd51 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:41.042242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-daa2cd8c-4250-46b1-aff1-6a7b3b61bd51 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:41.042682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-daa2cd8c-4250-46b1-aff1-6a7b3b61bd51 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:41.043438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-daa2cd8c-4250-46b1-aff1-6a7b3b61bd51 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:41.043863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-daa2cd8c-4250-46b1-aff1-6a7b3b61bd51 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:41.110145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-daa2cd8c-4250-46b1-aff1-6a7b3b61bd51 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:41.117826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-daa2cd8c-4250-46b1-aff1-6a7b3b61bd51 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089678 Jun 02 19:10:41.118408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 660/1342] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:41 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:41.358679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a42b1494-5e5a-4711-b3b1-fdd44df6ece0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:41.359584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a42b1494-5e5a-4711-b3b1-fdd44df6ece0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:41.366436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a42b1494-5e5a-4711-b3b1-fdd44df6ece0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:41.367146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a42b1494-5e5a-4711-b3b1-fdd44df6ece0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:41.368050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a42b1494-5e5a-4711-b3b1-fdd44df6ece0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:41.368494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a42b1494-5e5a-4711-b3b1-fdd44df6ece0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:41.370903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:41.400023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a42b1494-5e5a-4711-b3b1-fdd44df6ece0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Jun 02 19:10:41.400600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 683/1343] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:42.013590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cddfd0a8-ca69-46b4-a27f-1c49c2d4d50b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:42.015222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cddfd0a8-ca69-46b4-a27f-1c49c2d4d50b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:42.025497 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cddfd0a8-ca69-46b4-a27f-1c49c2d4d50b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:42.026225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cddfd0a8-ca69-46b4-a27f-1c49c2d4d50b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:42.027113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cddfd0a8-ca69-46b4-a27f-1c49c2d4d50b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:42.027544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cddfd0a8-ca69-46b4-a27f-1c49c2d4d50b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:42.058168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cddfd0a8-ca69-46b4-a27f-1c49c2d4d50b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052798 Jun 02 19:10:42.058924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 661/1344] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:42.139223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f5d4ca3-bfcd-4f48-87ba-c0296c08ef37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:42.139843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1f5d4ca3-bfcd-4f48-87ba-c0296c08ef37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:42.149702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f5d4ca3-bfcd-4f48-87ba-c0296c08ef37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:42.150192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f5d4ca3-bfcd-4f48-87ba-c0296c08ef37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:42.150969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f5d4ca3-bfcd-4f48-87ba-c0296c08ef37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:42.151412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f5d4ca3-bfcd-4f48-87ba-c0296c08ef37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:42.227162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1f5d4ca3-bfcd-4f48-87ba-c0296c08ef37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:42.235578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1f5d4ca3-bfcd-4f48-87ba-c0296c08ef37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102600 Jun 02 19:10:42.236139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 684/1345] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:42 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:42.415042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5634bc6e-a93f-41c5-b1ad-4ac4e637990d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:42.415874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5634bc6e-a93f-41c5-b1ad-4ac4e637990d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:42.422143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5634bc6e-a93f-41c5-b1ad-4ac4e637990d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:42.422579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5634bc6e-a93f-41c5-b1ad-4ac4e637990d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:42.423336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5634bc6e-a93f-41c5-b1ad-4ac4e637990d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:42.423753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5634bc6e-a93f-41c5-b1ad-4ac4e637990d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:42.454255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5634bc6e-a93f-41c5-b1ad-4ac4e637990d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Jun 02 19:10:42.454795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 662/1346] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:43.075034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cadd4b34-2b99-45f7-a54a-be33bd7e7899 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:43.076001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cadd4b34-2b99-45f7-a54a-be33bd7e7899 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:43.082540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cadd4b34-2b99-45f7-a54a-be33bd7e7899 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:43.082983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cadd4b34-2b99-45f7-a54a-be33bd7e7899 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:43.083776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cadd4b34-2b99-45f7-a54a-be33bd7e7899 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:43.084218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cadd4b34-2b99-45f7-a54a-be33bd7e7899 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:43.115915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cadd4b34-2b99-45f7-a54a-be33bd7e7899 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046006 Jun 02 19:10:43.116477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 685/1347] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:43.256045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ff0e8887-33dc-48be-ac30-6d8d4f0bbdab tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:43.256635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ff0e8887-33dc-48be-ac30-6d8d4f0bbdab tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:43.264310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff0e8887-33dc-48be-ac30-6d8d4f0bbdab tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:43.264729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff0e8887-33dc-48be-ac30-6d8d4f0bbdab tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:43.265485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff0e8887-33dc-48be-ac30-6d8d4f0bbdab tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:43.265945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff0e8887-33dc-48be-ac30-6d8d4f0bbdab tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:43.337487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ff0e8887-33dc-48be-ac30-6d8d4f0bbdab tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:43.348751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ff0e8887-33dc-48be-ac30-6d8d4f0bbdab tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098524 Jun 02 19:10:43.349521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 663/1348] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:43 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:43.470477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f1cfa1ab-4760-41dd-90a2-c8364c736826 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:43.471958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f1cfa1ab-4760-41dd-90a2-c8364c736826 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:43.483299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1cfa1ab-4760-41dd-90a2-c8364c736826 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:43.484060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1cfa1ab-4760-41dd-90a2-c8364c736826 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:43.485360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1cfa1ab-4760-41dd-90a2-c8364c736826 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:43.486139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1cfa1ab-4760-41dd-90a2-c8364c736826 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:43.517521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f1cfa1ab-4760-41dd-90a2-c8364c736826 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053923 Jun 02 19:10:43.518114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 686/1349] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:44.128174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9150d029-2c6c-4690-9db8-8a0d4c5614d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:44.129093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9150d029-2c6c-4690-9db8-8a0d4c5614d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:44.131006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=82 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:44.137000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9150d029-2c6c-4690-9db8-8a0d4c5614d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:44.137436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9150d029-2c6c-4690-9db8-8a0d4c5614d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:44.138212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9150d029-2c6c-4690-9db8-8a0d4c5614d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:44.138636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9150d029-2c6c-4690-9db8-8a0d4c5614d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:44.167862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9150d029-2c6c-4690-9db8-8a0d4c5614d1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043798 Jun 02 19:10:44.168391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 664/1350] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:44.370448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e3f44997-96be-4d7d-9e34-7c277470ba37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:44.371400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e3f44997-96be-4d7d-9e34-7c277470ba37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:44.377919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3f44997-96be-4d7d-9e34-7c277470ba37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:44.378458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3f44997-96be-4d7d-9e34-7c277470ba37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:44.379159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3f44997-96be-4d7d-9e34-7c277470ba37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:44.379576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3f44997-96be-4d7d-9e34-7c277470ba37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:44.466495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e3f44997-96be-4d7d-9e34-7c277470ba37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:44.474578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e3f44997-96be-4d7d-9e34-7c277470ba37 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.110686 Jun 02 19:10:44.475161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 687/1351] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:44 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:44.528926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dcdf13c7-b481-4dec-9ba2-2c2e7f4ed64f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:44.529925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dcdf13c7-b481-4dec-9ba2-2c2e7f4ed64f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:44.536931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dcdf13c7-b481-4dec-9ba2-2c2e7f4ed64f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:44.537388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dcdf13c7-b481-4dec-9ba2-2c2e7f4ed64f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:44.538187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dcdf13c7-b481-4dec-9ba2-2c2e7f4ed64f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:44.538621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dcdf13c7-b481-4dec-9ba2-2c2e7f4ed64f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:44.568239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dcdf13c7-b481-4dec-9ba2-2c2e7f4ed64f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043434 Jun 02 19:10:44.568814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 665/1352] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:45.183842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4cd694be-e5c8-4464-8327-7fcfb7e3fbce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:45.184818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4cd694be-e5c8-4464-8327-7fcfb7e3fbce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:45.186948 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=88 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:45.192512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4cd694be-e5c8-4464-8327-7fcfb7e3fbce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:45.192968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4cd694be-e5c8-4464-8327-7fcfb7e3fbce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:45.193759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4cd694be-e5c8-4464-8327-7fcfb7e3fbce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:45.194303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4cd694be-e5c8-4464-8327-7fcfb7e3fbce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:45.225185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4cd694be-e5c8-4464-8327-7fcfb7e3fbce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047980 Jun 02 19:10:45.225748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 688/1353] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:45.493909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd825d91-ffcd-46f0-8b66-f0990dd1d430 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:45.494408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fd825d91-ffcd-46f0-8b66-f0990dd1d430 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:45.503035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd825d91-ffcd-46f0-8b66-f0990dd1d430 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:45.503575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd825d91-ffcd-46f0-8b66-f0990dd1d430 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:45.504682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd825d91-ffcd-46f0-8b66-f0990dd1d430 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:45.505271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd825d91-ffcd-46f0-8b66-f0990dd1d430 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:45.573878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fd825d91-ffcd-46f0-8b66-f0990dd1d430 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:45.581750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd825d91-ffcd-46f0-8b66-f0990dd1d430 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092727 Jun 02 19:10:45.582324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 666/1354] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:45 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:45.582506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cba9b09f-7ec3-49b6-9b07-76b1ae3907d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:45.583706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cba9b09f-7ec3-49b6-9b07-76b1ae3907d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:45.592040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cba9b09f-7ec3-49b6-9b07-76b1ae3907d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:45.592491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cba9b09f-7ec3-49b6-9b07-76b1ae3907d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:45.593261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cba9b09f-7ec3-49b6-9b07-76b1ae3907d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:45.593905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cba9b09f-7ec3-49b6-9b07-76b1ae3907d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:45.624260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cba9b09f-7ec3-49b6-9b07-76b1ae3907d7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047093 Jun 02 19:10:45.624817 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 689/1355] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:46.238962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-57e77639-d3d0-4138-a172-f9c3f4fe8fd3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:46.239892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-57e77639-d3d0-4138-a172-f9c3f4fe8fd3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:46.246617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57e77639-d3d0-4138-a172-f9c3f4fe8fd3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:46.247042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57e77639-d3d0-4138-a172-f9c3f4fe8fd3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:46.247830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57e77639-d3d0-4138-a172-f9c3f4fe8fd3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:46.248239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57e77639-d3d0-4138-a172-f9c3f4fe8fd3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:46.278628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-57e77639-d3d0-4138-a172-f9c3f4fe8fd3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043750 Jun 02 19:10:46.279190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 667/1356] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:46.601270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-77ee06b8-969f-4300-9f6d-b3c747fbcce0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:46.602221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-77ee06b8-969f-4300-9f6d-b3c747fbcce0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:46.611931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77ee06b8-969f-4300-9f6d-b3c747fbcce0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:46.612561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77ee06b8-969f-4300-9f6d-b3c747fbcce0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:46.613729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77ee06b8-969f-4300-9f6d-b3c747fbcce0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:46.614347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77ee06b8-969f-4300-9f6d-b3c747fbcce0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:46.636173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aa3b227d-f300-425a-91eb-d28875dbdb10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:46.637279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aa3b227d-f300-425a-91eb-d28875dbdb10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:46.644460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa3b227d-f300-425a-91eb-d28875dbdb10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:46.644907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa3b227d-f300-425a-91eb-d28875dbdb10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:46.645678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa3b227d-f300-425a-91eb-d28875dbdb10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:46.646146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa3b227d-f300-425a-91eb-d28875dbdb10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:46.675552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aa3b227d-f300-425a-91eb-d28875dbdb10 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 Jun 02 19:10:46.676121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 668/1357] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:46.680248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-77ee06b8-969f-4300-9f6d-b3c747fbcce0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:46.689191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-77ee06b8-969f-4300-9f6d-b3c747fbcce0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093750 Jun 02 19:10:46.689868 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 690/1358] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:46 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:47.293393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-53974f03-623f-4f2e-934a-2c5e6586b43f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:47.294692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-53974f03-623f-4f2e-934a-2c5e6586b43f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:47.304018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53974f03-623f-4f2e-934a-2c5e6586b43f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:47.304575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53974f03-623f-4f2e-934a-2c5e6586b43f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:47.305666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53974f03-623f-4f2e-934a-2c5e6586b43f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:47.306332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53974f03-623f-4f2e-934a-2c5e6586b43f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:47.338077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-53974f03-623f-4f2e-934a-2c5e6586b43f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050459 Jun 02 19:10:47.338623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 669/1359] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:47.692617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-29a72526-ce67-4d4b-a8aa-8e3f755f883f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:47.694067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-29a72526-ce67-4d4b-a8aa-8e3f755f883f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:47.703098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29a72526-ce67-4d4b-a8aa-8e3f755f883f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:47.703532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29a72526-ce67-4d4b-a8aa-8e3f755f883f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:47.704309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29a72526-ce67-4d4b-a8aa-8e3f755f883f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:47.704742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29a72526-ce67-4d4b-a8aa-8e3f755f883f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:47.706612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-68350c77-eb51-4fdb-870a-6f21fb78a4a9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:47.707245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-68350c77-eb51-4fdb-870a-6f21fb78a4a9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:47.713760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68350c77-eb51-4fdb-870a-6f21fb78a4a9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:47.714244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68350c77-eb51-4fdb-870a-6f21fb78a4a9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:47.714993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68350c77-eb51-4fdb-870a-6f21fb78a4a9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:47.715463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68350c77-eb51-4fdb-870a-6f21fb78a4a9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:47.733875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-29a72526-ce67-4d4b-a8aa-8e3f755f883f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048242 Jun 02 19:10:47.734450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 691/1360] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:47.776983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-68350c77-eb51-4fdb-870a-6f21fb78a4a9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:47.779834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:47.787045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-68350c77-eb51-4fdb-870a-6f21fb78a4a9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084244 Jun 02 19:10:47.787669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 670/1361] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:47 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:48.350982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-95827fa2-2b08-4e11-95c8-d05e13cb6bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:48.351873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-95827fa2-2b08-4e11-95c8-d05e13cb6bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:48.359666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95827fa2-2b08-4e11-95c8-d05e13cb6bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:48.360125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95827fa2-2b08-4e11-95c8-d05e13cb6bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:48.360888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95827fa2-2b08-4e11-95c8-d05e13cb6bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:48.361323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95827fa2-2b08-4e11-95c8-d05e13cb6bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:48.394412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-95827fa2-2b08-4e11-95c8-d05e13cb6bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048138 Jun 02 19:10:48.394967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 692/1362] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:48.745419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f6459ec5-9b4a-43aa-98c0-125b68bf38fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:48.746380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f6459ec5-9b4a-43aa-98c0-125b68bf38fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:48.754129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6459ec5-9b4a-43aa-98c0-125b68bf38fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:48.754556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6459ec5-9b4a-43aa-98c0-125b68bf38fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:48.755307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6459ec5-9b4a-43aa-98c0-125b68bf38fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:48.755742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6459ec5-9b4a-43aa-98c0-125b68bf38fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:48.785019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f6459ec5-9b4a-43aa-98c0-125b68bf38fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Jun 02 19:10:48.785571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 671/1363] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:48.804285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-757beaac-3bb7-4808-a444-786cb526303f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:48.804899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-757beaac-3bb7-4808-a444-786cb526303f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:48.812714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-757beaac-3bb7-4808-a444-786cb526303f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:48.813146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-757beaac-3bb7-4808-a444-786cb526303f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:48.813942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-757beaac-3bb7-4808-a444-786cb526303f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:48.814388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-757beaac-3bb7-4808-a444-786cb526303f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:48.879240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-757beaac-3bb7-4808-a444-786cb526303f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:48.887612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-757beaac-3bb7-4808-a444-786cb526303f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087202 Jun 02 19:10:48.888205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 693/1364] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:48 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:49.407302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c085507b-244d-4c0e-90e4-4f456e0f5e1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:49.408226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c085507b-244d-4c0e-90e4-4f456e0f5e1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:49.414805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c085507b-244d-4c0e-90e4-4f456e0f5e1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:49.415190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c085507b-244d-4c0e-90e4-4f456e0f5e1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:49.415952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c085507b-244d-4c0e-90e4-4f456e0f5e1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:49.416381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c085507b-244d-4c0e-90e4-4f456e0f5e1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:49.446838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c085507b-244d-4c0e-90e4-4f456e0f5e1a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044764 Jun 02 19:10:49.447388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 672/1365] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:49.799045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d7e84ad-29c7-472f-a0e3-a36bea6eef14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:49.799889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d7e84ad-29c7-472f-a0e3-a36bea6eef14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:49.806679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d7e84ad-29c7-472f-a0e3-a36bea6eef14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:49.807279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d7e84ad-29c7-472f-a0e3-a36bea6eef14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:49.807877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d7e84ad-29c7-472f-a0e3-a36bea6eef14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:49.808312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d7e84ad-29c7-472f-a0e3-a36bea6eef14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:49.842416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d7e84ad-29c7-472f-a0e3-a36bea6eef14 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047931 Jun 02 19:10:49.843154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 694/1366] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:49.912709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ffdeb429-86cc-4ce9-9aab-125b2cd5ad18 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:49.913390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ffdeb429-86cc-4ce9-9aab-125b2cd5ad18 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:49.920635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffdeb429-86cc-4ce9-9aab-125b2cd5ad18 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:49.921113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffdeb429-86cc-4ce9-9aab-125b2cd5ad18 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:49.921930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffdeb429-86cc-4ce9-9aab-125b2cd5ad18 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:49.922427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffdeb429-86cc-4ce9-9aab-125b2cd5ad18 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:49.992395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ffdeb429-86cc-4ce9-9aab-125b2cd5ad18 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:50.000346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ffdeb429-86cc-4ce9-9aab-125b2cd5ad18 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092122 Jun 02 19:10:50.000900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 673/1367] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:49 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:50.459712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a20ffda5-6180-473a-822c-f7054efcacf8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:50.460631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a20ffda5-6180-473a-822c-f7054efcacf8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:50.467083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a20ffda5-6180-473a-822c-f7054efcacf8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:50.467526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a20ffda5-6180-473a-822c-f7054efcacf8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:50.468638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a20ffda5-6180-473a-822c-f7054efcacf8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:50.469079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a20ffda5-6180-473a-822c-f7054efcacf8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:50.500257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a20ffda5-6180-473a-822c-f7054efcacf8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044818 Jun 02 19:10:50.500808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 695/1368] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:50.856513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cb42577c-3c7f-43d2-bacb-59fd0ac8c268 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:50.857690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cb42577c-3c7f-43d2-bacb-59fd0ac8c268 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:50.866109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb42577c-3c7f-43d2-bacb-59fd0ac8c268 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:50.866749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb42577c-3c7f-43d2-bacb-59fd0ac8c268 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:50.867982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb42577c-3c7f-43d2-bacb-59fd0ac8c268 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:50.868635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb42577c-3c7f-43d2-bacb-59fd0ac8c268 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:50.898148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cb42577c-3c7f-43d2-bacb-59fd0ac8c268 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047796 Jun 02 19:10:50.898680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 674/1369] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:51.016973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3a6338b9-a1fb-405e-a457-2efa9a5a9868 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:51.017594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a6338b9-a1fb-405e-a457-2efa9a5a9868 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:51.024735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6338b9-a1fb-405e-a457-2efa9a5a9868 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:51.025196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6338b9-a1fb-405e-a457-2efa9a5a9868 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:51.026002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6338b9-a1fb-405e-a457-2efa9a5a9868 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:51.026449 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6338b9-a1fb-405e-a457-2efa9a5a9868 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:51.096511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a6338b9-a1fb-405e-a457-2efa9a5a9868 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:51.107809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3a6338b9-a1fb-405e-a457-2efa9a5a9868 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094544 Jun 02 19:10:51.108598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 696/1370] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:51 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:51.517261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ff6bc242-c084-445c-b9b1-7f64c40ec57c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:51.525301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ff6bc242-c084-445c-b9b1-7f64c40ec57c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:51.531194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff6bc242-c084-445c-b9b1-7f64c40ec57c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:51.531194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff6bc242-c084-445c-b9b1-7f64c40ec57c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:51.532517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff6bc242-c084-445c-b9b1-7f64c40ec57c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:51.532942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff6bc242-c084-445c-b9b1-7f64c40ec57c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:51.576509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ff6bc242-c084-445c-b9b1-7f64c40ec57c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065959 Jun 02 19:10:51.577075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 675/1371] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:51.919180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-efcea5d7-f759-4ada-befa-c51c61f684e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:51.920805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-efcea5d7-f759-4ada-befa-c51c61f684e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:51.928945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efcea5d7-f759-4ada-befa-c51c61f684e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:51.929405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efcea5d7-f759-4ada-befa-c51c61f684e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:51.930242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efcea5d7-f759-4ada-befa-c51c61f684e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:51.930691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efcea5d7-f759-4ada-befa-c51c61f684e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:51.961920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-efcea5d7-f759-4ada-befa-c51c61f684e4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053359 Jun 02 19:10:51.962527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 697/1372] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:52.130835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-99d0c463-0665-4d35-bdf0-1bdb26edea83 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:52.131632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-99d0c463-0665-4d35-bdf0-1bdb26edea83 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:52.141591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99d0c463-0665-4d35-bdf0-1bdb26edea83 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:52.142367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99d0c463-0665-4d35-bdf0-1bdb26edea83 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:52.143785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99d0c463-0665-4d35-bdf0-1bdb26edea83 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:52.144288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99d0c463-0665-4d35-bdf0-1bdb26edea83 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:52.215985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-99d0c463-0665-4d35-bdf0-1bdb26edea83 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:52.224566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-99d0c463-0665-4d35-bdf0-1bdb26edea83 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.100270 Jun 02 19:10:52.225140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 676/1373] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:52 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:52.589214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cd78d80d-8019-4e2a-aadd-ecc9a31ac39c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:52.590187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cd78d80d-8019-4e2a-aadd-ecc9a31ac39c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:52.597604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd78d80d-8019-4e2a-aadd-ecc9a31ac39c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:52.598097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd78d80d-8019-4e2a-aadd-ecc9a31ac39c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:52.598893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd78d80d-8019-4e2a-aadd-ecc9a31ac39c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:52.599340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd78d80d-8019-4e2a-aadd-ecc9a31ac39c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:52.633762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cd78d80d-8019-4e2a-aadd-ecc9a31ac39c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048557 Jun 02 19:10:52.634378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 698/1374] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:52.974596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3e9c8f2-a3ed-40ee-b29a-0c364e8dba6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:52.975567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c3e9c8f2-a3ed-40ee-b29a-0c364e8dba6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:52.982600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3e9c8f2-a3ed-40ee-b29a-0c364e8dba6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:52.983046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3e9c8f2-a3ed-40ee-b29a-0c364e8dba6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:52.983810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3e9c8f2-a3ed-40ee-b29a-0c364e8dba6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:52.984249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3e9c8f2-a3ed-40ee-b29a-0c364e8dba6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:53.014211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3e9c8f2-a3ed-40ee-b29a-0c364e8dba6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 Jun 02 19:10:53.014761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 677/1375] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:53.245309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-805e0486-f32a-47e0-a6fd-25813dd94d6f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:53.246231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-805e0486-f32a-47e0-a6fd-25813dd94d6f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:53.255242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-805e0486-f32a-47e0-a6fd-25813dd94d6f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:53.255802 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-805e0486-f32a-47e0-a6fd-25813dd94d6f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:53.256613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-805e0486-f32a-47e0-a6fd-25813dd94d6f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:53.257049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-805e0486-f32a-47e0-a6fd-25813dd94d6f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:53.324131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-805e0486-f32a-47e0-a6fd-25813dd94d6f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:53.326397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:53.333209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-805e0486-f32a-47e0-a6fd-25813dd94d6f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094650 Jun 02 19:10:53.333779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 699/1376] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:53 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:53.646703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2c4a170b-d038-4bd6-9bd9-fc2b840d89b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:53.647634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2c4a170b-d038-4bd6-9bd9-fc2b840d89b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:53.654776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c4a170b-d038-4bd6-9bd9-fc2b840d89b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:53.655217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c4a170b-d038-4bd6-9bd9-fc2b840d89b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:53.655976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c4a170b-d038-4bd6-9bd9-fc2b840d89b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:53.656433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c4a170b-d038-4bd6-9bd9-fc2b840d89b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:53.686930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2c4a170b-d038-4bd6-9bd9-fc2b840d89b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044527 Jun 02 19:10:53.687479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 678/1377] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:54.026570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b34724b8-b2ec-4017-9f06-d7e4d27af460 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:54.027740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b34724b8-b2ec-4017-9f06-d7e4d27af460 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:54.036671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b34724b8-b2ec-4017-9f06-d7e4d27af460 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:54.037138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b34724b8-b2ec-4017-9f06-d7e4d27af460 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:54.037962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b34724b8-b2ec-4017-9f06-d7e4d27af460 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:54.038410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b34724b8-b2ec-4017-9f06-d7e4d27af460 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:54.074901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b34724b8-b2ec-4017-9f06-d7e4d27af460 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052066 Jun 02 19:10:54.075578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 700/1378] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:54.351469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dd4cd589-3c48-4d94-8609-1683b35c286d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:54.352214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dd4cd589-3c48-4d94-8609-1683b35c286d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:54.359600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dd4cd589-3c48-4d94-8609-1683b35c286d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:54.360098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dd4cd589-3c48-4d94-8609-1683b35c286d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:54.360873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dd4cd589-3c48-4d94-8609-1683b35c286d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:54.361309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dd4cd589-3c48-4d94-8609-1683b35c286d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:54.426622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dd4cd589-3c48-4d94-8609-1683b35c286d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:54.438098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dd4cd589-3c48-4d94-8609-1683b35c286d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091141 Jun 02 19:10:54.438854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 679/1379] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:54 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:54.703950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f8b68213-6cb6-4d71-9457-fe334cd126e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:54.705450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f8b68213-6cb6-4d71-9457-fe334cd126e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:54.716150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8b68213-6cb6-4d71-9457-fe334cd126e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:54.716912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8b68213-6cb6-4d71-9457-fe334cd126e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:54.718296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8b68213-6cb6-4d71-9457-fe334cd126e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:54.719020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8b68213-6cb6-4d71-9457-fe334cd126e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:54.754010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f8b68213-6cb6-4d71-9457-fe334cd126e5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056694 Jun 02 19:10:54.754949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 701/1380] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:55.089401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c480beda-c713-4de0-8496-5f2c0cdb930a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:55.090292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c480beda-c713-4de0-8496-5f2c0cdb930a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:55.096815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c480beda-c713-4de0-8496-5f2c0cdb930a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:55.097267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c480beda-c713-4de0-8496-5f2c0cdb930a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:55.098089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c480beda-c713-4de0-8496-5f2c0cdb930a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:55.098524 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c480beda-c713-4de0-8496-5f2c0cdb930a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:55.127830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c480beda-c713-4de0-8496-5f2c0cdb930a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042541 Jun 02 19:10:55.128383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 680/1381] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:55.459304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d3934a38-5b2b-4296-b5b4-45bac8d4f266 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:55.459916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d3934a38-5b2b-4296-b5b4-45bac8d4f266 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:55.470160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3934a38-5b2b-4296-b5b4-45bac8d4f266 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:55.470717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3934a38-5b2b-4296-b5b4-45bac8d4f266 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:55.471801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3934a38-5b2b-4296-b5b4-45bac8d4f266 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:55.472372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3934a38-5b2b-4296-b5b4-45bac8d4f266 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:55.542911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d3934a38-5b2b-4296-b5b4-45bac8d4f266 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:55.554205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d3934a38-5b2b-4296-b5b4-45bac8d4f266 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.100549 Jun 02 19:10:55.554205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 702/1382] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:55 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:55.769388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9b700350-0a63-4273-b485-6927397edb09 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:55.770417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9b700350-0a63-4273-b485-6927397edb09 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:55.777692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b700350-0a63-4273-b485-6927397edb09 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:55.778234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b700350-0a63-4273-b485-6927397edb09 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:55.779066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b700350-0a63-4273-b485-6927397edb09 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:55.779624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b700350-0a63-4273-b485-6927397edb09 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:55.811620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9b700350-0a63-4273-b485-6927397edb09 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048311 Jun 02 19:10:55.812217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 681/1383] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:56.139754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-67530987-2957-4240-9a1f-3770fcbc64ed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:56.140768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-67530987-2957-4240-9a1f-3770fcbc64ed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:56.148718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67530987-2957-4240-9a1f-3770fcbc64ed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:56.149171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67530987-2957-4240-9a1f-3770fcbc64ed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:56.149980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67530987-2957-4240-9a1f-3770fcbc64ed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:56.150418 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67530987-2957-4240-9a1f-3770fcbc64ed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:56.181414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-67530987-2957-4240-9a1f-3770fcbc64ed tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Jun 02 19:10:56.182141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 703/1384] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:56.571818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9bd27e55-5b5d-4964-bc2b-865ede9efbed tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:56.572420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9bd27e55-5b5d-4964-bc2b-865ede9efbed tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:56.579554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bd27e55-5b5d-4964-bc2b-865ede9efbed tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:56.580001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bd27e55-5b5d-4964-bc2b-865ede9efbed tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:56.580781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bd27e55-5b5d-4964-bc2b-865ede9efbed tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:56.581215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bd27e55-5b5d-4964-bc2b-865ede9efbed tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:56.647433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9bd27e55-5b5d-4964-bc2b-865ede9efbed tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:56.655518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9bd27e55-5b5d-4964-bc2b-865ede9efbed tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088181 Jun 02 19:10:56.656072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 682/1385] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:56 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:56.824657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ef6a5f2f-8bf6-4609-a8ba-4b603031eac6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:56.825489 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ef6a5f2f-8bf6-4609-a8ba-4b603031eac6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:56.832610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef6a5f2f-8bf6-4609-a8ba-4b603031eac6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:56.833096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef6a5f2f-8bf6-4609-a8ba-4b603031eac6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:56.833959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef6a5f2f-8bf6-4609-a8ba-4b603031eac6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:56.834398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef6a5f2f-8bf6-4609-a8ba-4b603031eac6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:56.864511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ef6a5f2f-8bf6-4609-a8ba-4b603031eac6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044367 Jun 02 19:10:56.865355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 704/1386] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:57.193727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e39d4cd3-79d4-4f49-8608-20969a538d9f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:57.195362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e39d4cd3-79d4-4f49-8608-20969a538d9f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:57.202432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e39d4cd3-79d4-4f49-8608-20969a538d9f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:57.202871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e39d4cd3-79d4-4f49-8608-20969a538d9f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:57.203642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e39d4cd3-79d4-4f49-8608-20969a538d9f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:57.204038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e39d4cd3-79d4-4f49-8608-20969a538d9f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:57.235434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e39d4cd3-79d4-4f49-8608-20969a538d9f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Jun 02 19:10:57.235987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 683/1387] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:57.678522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-99652444-240d-43fd-833d-a7a7442defee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:57.680088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-99652444-240d-43fd-833d-a7a7442defee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:57.686596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99652444-240d-43fd-833d-a7a7442defee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:57.687055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99652444-240d-43fd-833d-a7a7442defee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:57.687819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99652444-240d-43fd-833d-a7a7442defee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:57.688263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99652444-240d-43fd-833d-a7a7442defee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:57.761935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99652444-240d-43fd-833d-a7a7442defee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:57.773247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-99652444-240d-43fd-833d-a7a7442defee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.100946 Jun 02 19:10:57.773939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 705/1388] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:57 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:57.880248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-25956cbc-7c65-4619-b622-b328647363b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:57.881813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-25956cbc-7c65-4619-b622-b328647363b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:57.892520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-25956cbc-7c65-4619-b622-b328647363b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:57.893277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-25956cbc-7c65-4619-b622-b328647363b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:57.894565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-25956cbc-7c65-4619-b622-b328647363b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:57.895284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-25956cbc-7c65-4619-b622-b328647363b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:57.930064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-25956cbc-7c65-4619-b622-b328647363b7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055938 Jun 02 19:10:57.930662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 684/1389] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:58.251696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-42734a05-2b88-47a8-8afb-95bb48251b43 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:58.252740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-42734a05-2b88-47a8-8afb-95bb48251b43 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:58.261787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42734a05-2b88-47a8-8afb-95bb48251b43 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:58.262268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42734a05-2b88-47a8-8afb-95bb48251b43 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:58.263040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42734a05-2b88-47a8-8afb-95bb48251b43 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:58.263476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42734a05-2b88-47a8-8afb-95bb48251b43 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:58.297218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-42734a05-2b88-47a8-8afb-95bb48251b43 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052099 Jun 02 19:10:58.297781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 706/1390] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:58.795709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-504016b6-5298-4270-b1c3-786691aa58ec tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:58.796322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-504016b6-5298-4270-b1c3-786691aa58ec tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:58.803587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-504016b6-5298-4270-b1c3-786691aa58ec tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:58.803889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-504016b6-5298-4270-b1c3-786691aa58ec tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:58.804658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-504016b6-5298-4270-b1c3-786691aa58ec tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:58.805089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-504016b6-5298-4270-b1c3-786691aa58ec tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:58.876647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-504016b6-5298-4270-b1c3-786691aa58ec tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:58.884599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-504016b6-5298-4270-b1c3-786691aa58ec tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093353 Jun 02 19:10:58.885165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 685/1391] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:58 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:10:58.945169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f17c6a4b-b64c-408b-a82e-b2c9e83238b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:58.946447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f17c6a4b-b64c-408b-a82e-b2c9e83238b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:58.953830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f17c6a4b-b64c-408b-a82e-b2c9e83238b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:58.954269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f17c6a4b-b64c-408b-a82e-b2c9e83238b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:58.955315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f17c6a4b-b64c-408b-a82e-b2c9e83238b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:58.955460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f17c6a4b-b64c-408b-a82e-b2c9e83238b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:58.987067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f17c6a4b-b64c-408b-a82e-b2c9e83238b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047917 Jun 02 19:10:58.987616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 707/1392] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:10:59.309990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-93aa0ec1-b716-4b86-a7c9-bc724248ec6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:59.311382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-93aa0ec1-b716-4b86-a7c9-bc724248ec6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:59.321164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93aa0ec1-b716-4b86-a7c9-bc724248ec6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:59.321675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93aa0ec1-b716-4b86-a7c9-bc724248ec6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:59.322804 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93aa0ec1-b716-4b86-a7c9-bc724248ec6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:59.323353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93aa0ec1-b716-4b86-a7c9-bc724248ec6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:59.358875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-93aa0ec1-b716-4b86-a7c9-bc724248ec6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053815 Jun 02 19:10:59.359426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 686/1393] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:10:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:10:59.909309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ca00cdb7-e1dd-40cb-b1d7-9063d70d2288 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:10:59.909950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ca00cdb7-e1dd-40cb-b1d7-9063d70d2288 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:10:59.918372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca00cdb7-e1dd-40cb-b1d7-9063d70d2288 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:59.918827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca00cdb7-e1dd-40cb-b1d7-9063d70d2288 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:59.919608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca00cdb7-e1dd-40cb-b1d7-9063d70d2288 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:10:59.920086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca00cdb7-e1dd-40cb-b1d7-9063d70d2288 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:10:59.998961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ca00cdb7-e1dd-40cb-b1d7-9063d70d2288 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:10:59.999519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d32cc535-bfdf-48c7-9e66-531b0b89e68d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:00.000951 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d32cc535-bfdf-48c7-9e66-531b0b89e68d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:00.007220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ca00cdb7-e1dd-40cb-b1d7-9063d70d2288 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.103815 Jun 02 19:11:00.007450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d32cc535-bfdf-48c7-9e66-531b0b89e68d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:00.007754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d32cc535-bfdf-48c7-9e66-531b0b89e68d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:00.008018 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 708/1394] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:10:59 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:00.008605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d32cc535-bfdf-48c7-9e66-531b0b89e68d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:00.009215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d32cc535-bfdf-48c7-9e66-531b0b89e68d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:00.025011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:00.041298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d32cc535-bfdf-48c7-9e66-531b0b89e68d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045966 Jun 02 19:11:00.041853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 687/1395] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:10:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 19:11:00.373509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8fa4b753-e9cf-4cc1-b1fe-88da921052bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:00.374940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8fa4b753-e9cf-4cc1-b1fe-88da921052bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:00.386590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fa4b753-e9cf-4cc1-b1fe-88da921052bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:00.387038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fa4b753-e9cf-4cc1-b1fe-88da921052bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:00.387831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fa4b753-e9cf-4cc1-b1fe-88da921052bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:00.388421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fa4b753-e9cf-4cc1-b1fe-88da921052bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:00.419127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8fa4b753-e9cf-4cc1-b1fe-88da921052bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052087 Jun 02 19:11:00.419684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 709/1396] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:01.030502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4a886c0f-f4d3-4d46-ba75-8151fa84a300 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:01.031379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4a886c0f-f4d3-4d46-ba75-8151fa84a300 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:01.039216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a886c0f-f4d3-4d46-ba75-8151fa84a300 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:01.039668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a886c0f-f4d3-4d46-ba75-8151fa84a300 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:01.040430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a886c0f-f4d3-4d46-ba75-8151fa84a300 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:01.040864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a886c0f-f4d3-4d46-ba75-8151fa84a300 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:01.053864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b6d9393e-31f3-4de4-97d7-92ab7a3844eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:01.055017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b6d9393e-31f3-4de4-97d7-92ab7a3844eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:01.061863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6d9393e-31f3-4de4-97d7-92ab7a3844eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:01.062323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6d9393e-31f3-4de4-97d7-92ab7a3844eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:01.063093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6d9393e-31f3-4de4-97d7-92ab7a3844eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:01.063532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6d9393e-31f3-4de4-97d7-92ab7a3844eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:01.094879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b6d9393e-31f3-4de4-97d7-92ab7a3844eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046024 Jun 02 19:11:01.095621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 710/1397] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:01.104122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4a886c0f-f4d3-4d46-ba75-8151fa84a300 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:01.111805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4a886c0f-f4d3-4d46-ba75-8151fa84a300 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087405 Jun 02 19:11:01.112359 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 688/1398] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:01 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:01.432962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2f7fce68-80b0-48aa-83b6-590903881ed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:01.433928 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2f7fce68-80b0-48aa-83b6-590903881ed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:01.441228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f7fce68-80b0-48aa-83b6-590903881ed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:01.441686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f7fce68-80b0-48aa-83b6-590903881ed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:01.442512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f7fce68-80b0-48aa-83b6-590903881ed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:01.442940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f7fce68-80b0-48aa-83b6-590903881ed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:01.472981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2f7fce68-80b0-48aa-83b6-590903881ed9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Jun 02 19:11:01.473532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 711/1399] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:02.111112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-454daa7a-dc93-4a31-ad97-3d04ef93294f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:02.112265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-454daa7a-dc93-4a31-ad97-3d04ef93294f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:02.120925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-454daa7a-dc93-4a31-ad97-3d04ef93294f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:02.121380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-454daa7a-dc93-4a31-ad97-3d04ef93294f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:02.122174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-454daa7a-dc93-4a31-ad97-3d04ef93294f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:02.122619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-454daa7a-dc93-4a31-ad97-3d04ef93294f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:02.128636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d9c7dee0-5438-4fe8-8e56-451b51700a0c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:02.129246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d9c7dee0-5438-4fe8-8e56-451b51700a0c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:02.135777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9c7dee0-5438-4fe8-8e56-451b51700a0c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:02.136238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9c7dee0-5438-4fe8-8e56-451b51700a0c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:02.137000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9c7dee0-5438-4fe8-8e56-451b51700a0c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:02.137416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9c7dee0-5438-4fe8-8e56-451b51700a0c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:02.152989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-454daa7a-dc93-4a31-ad97-3d04ef93294f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048504 Jun 02 19:11:02.153588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 689/1400] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:02.212224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d9c7dee0-5438-4fe8-8e56-451b51700a0c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:02.221403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d9c7dee0-5438-4fe8-8e56-451b51700a0c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.096611 Jun 02 19:11:02.222056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 712/1401] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:02 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:02.487427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a90ecef9-0332-481a-b3af-77d6fe54e1a3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:02.488762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a90ecef9-0332-481a-b3af-77d6fe54e1a3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:02.497706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a90ecef9-0332-481a-b3af-77d6fe54e1a3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:02.498386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a90ecef9-0332-481a-b3af-77d6fe54e1a3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:02.499478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a90ecef9-0332-481a-b3af-77d6fe54e1a3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:02.500118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a90ecef9-0332-481a-b3af-77d6fe54e1a3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:02.533835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a90ecef9-0332-481a-b3af-77d6fe54e1a3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051727 Jun 02 19:11:02.534404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 690/1402] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:03.165344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c2dc6d00-244a-48c6-b220-18a40f06ca1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:03.166480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c2dc6d00-244a-48c6-b220-18a40f06ca1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:03.173565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2dc6d00-244a-48c6-b220-18a40f06ca1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:03.174079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2dc6d00-244a-48c6-b220-18a40f06ca1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:03.174838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2dc6d00-244a-48c6-b220-18a40f06ca1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:03.175269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2dc6d00-244a-48c6-b220-18a40f06ca1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:03.204832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c2dc6d00-244a-48c6-b220-18a40f06ca1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043646 Jun 02 19:11:03.205392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 713/1403] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:03.241533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dbd620b4-ff93-4bdf-8ce3-c3d3f176cc2b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:03.242507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dbd620b4-ff93-4bdf-8ce3-c3d3f176cc2b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:03.253429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbd620b4-ff93-4bdf-8ce3-c3d3f176cc2b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:03.253900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbd620b4-ff93-4bdf-8ce3-c3d3f176cc2b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:03.254661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbd620b4-ff93-4bdf-8ce3-c3d3f176cc2b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:03.255086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbd620b4-ff93-4bdf-8ce3-c3d3f176cc2b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:03.318966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dbd620b4-ff93-4bdf-8ce3-c3d3f176cc2b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:03.327561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dbd620b4-ff93-4bdf-8ce3-c3d3f176cc2b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092382 Jun 02 19:11:03.328197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 691/1404] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:03 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:03.545891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-69f90cc3-dce1-4beb-8d38-bf20f98853fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:03.546962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-69f90cc3-dce1-4beb-8d38-bf20f98853fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:03.553470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69f90cc3-dce1-4beb-8d38-bf20f98853fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:03.554005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69f90cc3-dce1-4beb-8d38-bf20f98853fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:03.554799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69f90cc3-dce1-4beb-8d38-bf20f98853fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:03.555240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69f90cc3-dce1-4beb-8d38-bf20f98853fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:03.586770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-69f90cc3-dce1-4beb-8d38-bf20f98853fa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Jun 02 19:11:03.587415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 714/1405] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:04.220542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-71fbd68e-b582-4f72-b657-4a953e823a4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:04.221713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-71fbd68e-b582-4f72-b657-4a953e823a4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:04.229089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-71fbd68e-b582-4f72-b657-4a953e823a4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:04.229629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-71fbd68e-b582-4f72-b657-4a953e823a4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:04.230567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-71fbd68e-b582-4f72-b657-4a953e823a4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:04.231058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-71fbd68e-b582-4f72-b657-4a953e823a4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:04.263111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-71fbd68e-b582-4f72-b657-4a953e823a4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049755 Jun 02 19:11:04.263828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 692/1406] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:04.348229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fef37f02-548f-437d-9495-ccc76900a973 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:04.348969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fef37f02-548f-437d-9495-ccc76900a973 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:04.358621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fef37f02-548f-437d-9495-ccc76900a973 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:04.358863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fef37f02-548f-437d-9495-ccc76900a973 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:04.359888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fef37f02-548f-437d-9495-ccc76900a973 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:04.360463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fef37f02-548f-437d-9495-ccc76900a973 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:04.423338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fef37f02-548f-437d-9495-ccc76900a973 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:04.431168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fef37f02-548f-437d-9495-ccc76900a973 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089676 Jun 02 19:11:04.431725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 715/1407] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:04 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:04.599827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-04d8208b-44a6-4d80-8e50-1d09af2b8d22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:04.600688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-04d8208b-44a6-4d80-8e50-1d09af2b8d22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:04.607688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04d8208b-44a6-4d80-8e50-1d09af2b8d22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:04.608134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04d8208b-44a6-4d80-8e50-1d09af2b8d22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:04.608874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04d8208b-44a6-4d80-8e50-1d09af2b8d22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:04.609327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04d8208b-44a6-4d80-8e50-1d09af2b8d22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:04.639045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-04d8208b-44a6-4d80-8e50-1d09af2b8d22 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Jun 02 19:11:04.639598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 693/1408] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:05.280125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8e7efa61-fa7e-47ef-a7f3-08b8cf82f3ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:05.281768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8e7efa61-fa7e-47ef-a7f3-08b8cf82f3ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:05.292476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e7efa61-fa7e-47ef-a7f3-08b8cf82f3ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:05.293560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e7efa61-fa7e-47ef-a7f3-08b8cf82f3ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:05.294369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e7efa61-fa7e-47ef-a7f3-08b8cf82f3ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:05.294808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e7efa61-fa7e-47ef-a7f3-08b8cf82f3ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:05.309511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:05.327719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8e7efa61-fa7e-47ef-a7f3-08b8cf82f3ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054657 Jun 02 19:11:05.328520 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 716/1409] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:05.449878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-62936add-d0e3-4a0b-8b6e-e260e8468dbf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:05.450491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-62936add-d0e3-4a0b-8b6e-e260e8468dbf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:05.457214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62936add-d0e3-4a0b-8b6e-e260e8468dbf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:05.457661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62936add-d0e3-4a0b-8b6e-e260e8468dbf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:05.458445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62936add-d0e3-4a0b-8b6e-e260e8468dbf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:05.458877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62936add-d0e3-4a0b-8b6e-e260e8468dbf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:05.522506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-62936add-d0e3-4a0b-8b6e-e260e8468dbf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:05.530242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-62936add-d0e3-4a0b-8b6e-e260e8468dbf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085093 Jun 02 19:11:05.530707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 694/1410] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:05 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:05.654100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-29f90d57-2ed9-4d1d-9d23-85e2272a6869 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:05.655035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-29f90d57-2ed9-4d1d-9d23-85e2272a6869 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:05.662002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29f90d57-2ed9-4d1d-9d23-85e2272a6869 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:05.662460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29f90d57-2ed9-4d1d-9d23-85e2272a6869 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:05.663230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29f90d57-2ed9-4d1d-9d23-85e2272a6869 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:05.663669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29f90d57-2ed9-4d1d-9d23-85e2272a6869 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:05.693490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-29f90d57-2ed9-4d1d-9d23-85e2272a6869 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Jun 02 19:11:05.694009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 717/1411] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:06.343790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0a0de543-2d24-4253-ad22-5108622b8435 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:06.344754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0a0de543-2d24-4253-ad22-5108622b8435 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:06.351528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0de543-2d24-4253-ad22-5108622b8435 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:06.351982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0de543-2d24-4253-ad22-5108622b8435 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:06.352742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0de543-2d24-4253-ad22-5108622b8435 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:06.353174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0de543-2d24-4253-ad22-5108622b8435 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:06.384677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0a0de543-2d24-4253-ad22-5108622b8435 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047501 Jun 02 19:11:06.385239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 695/1412] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:06.547947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c532b671-60db-46a5-bf0d-287930cab045 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:06.548587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c532b671-60db-46a5-bf0d-287930cab045 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:06.555082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c532b671-60db-46a5-bf0d-287930cab045 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:06.555537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c532b671-60db-46a5-bf0d-287930cab045 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:06.556307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c532b671-60db-46a5-bf0d-287930cab045 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:06.556742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c532b671-60db-46a5-bf0d-287930cab045 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:06.634227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c532b671-60db-46a5-bf0d-287930cab045 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:06.642224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c532b671-60db-46a5-bf0d-287930cab045 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.098875 Jun 02 19:11:06.642796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 718/1413] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:06 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:06.707100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cca8c26f-b8ec-4c28-8889-c9578788b6e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:06.708035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cca8c26f-b8ec-4c28-8889-c9578788b6e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:06.715235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cca8c26f-b8ec-4c28-8889-c9578788b6e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:06.715686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cca8c26f-b8ec-4c28-8889-c9578788b6e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:06.716452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cca8c26f-b8ec-4c28-8889-c9578788b6e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:06.716921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cca8c26f-b8ec-4c28-8889-c9578788b6e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:06.747283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cca8c26f-b8ec-4c28-8889-c9578788b6e5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Jun 02 19:11:06.747822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 696/1414] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:07.401079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e3b8f6b7-6670-444e-85b0-e3f1b0c160d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:07.402657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e3b8f6b7-6670-444e-85b0-e3f1b0c160d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:07.413616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3b8f6b7-6670-444e-85b0-e3f1b0c160d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:07.414420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3b8f6b7-6670-444e-85b0-e3f1b0c160d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:07.415654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3b8f6b7-6670-444e-85b0-e3f1b0c160d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:07.416372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3b8f6b7-6670-444e-85b0-e3f1b0c160d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:07.448726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e3b8f6b7-6670-444e-85b0-e3f1b0c160d0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054488 Jun 02 19:11:07.449276 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 719/1415] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:07.660299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c8045fde-e5de-4ab8-aeb3-a4e0ae584e94 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:07.660800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c8045fde-e5de-4ab8-aeb3-a4e0ae584e94 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:07.667602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8045fde-e5de-4ab8-aeb3-a4e0ae584e94 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:07.668051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8045fde-e5de-4ab8-aeb3-a4e0ae584e94 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:07.668800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8045fde-e5de-4ab8-aeb3-a4e0ae584e94 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:07.669229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8045fde-e5de-4ab8-aeb3-a4e0ae584e94 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:07.738195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c8045fde-e5de-4ab8-aeb3-a4e0ae584e94 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:07.750088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c8045fde-e5de-4ab8-aeb3-a4e0ae584e94 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093691 Jun 02 19:11:07.750738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 697/1416] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:07 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:07.759484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5aa2441b-969f-45cb-93b6-9c69d1905954 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:07.760808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5aa2441b-969f-45cb-93b6-9c69d1905954 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:07.770423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aa2441b-969f-45cb-93b6-9c69d1905954 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:07.771038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aa2441b-969f-45cb-93b6-9c69d1905954 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:07.772187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aa2441b-969f-45cb-93b6-9c69d1905954 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:07.772780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aa2441b-969f-45cb-93b6-9c69d1905954 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:07.803539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5aa2441b-969f-45cb-93b6-9c69d1905954 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048080 Jun 02 19:11:07.804316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 720/1417] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:08.465071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d66a8f02-546e-4363-bcb6-c594ff363c14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:08.466522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d66a8f02-546e-4363-bcb6-c594ff363c14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:08.473832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d66a8f02-546e-4363-bcb6-c594ff363c14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:08.474323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d66a8f02-546e-4363-bcb6-c594ff363c14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:08.475176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d66a8f02-546e-4363-bcb6-c594ff363c14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:08.475515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d66a8f02-546e-4363-bcb6-c594ff363c14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:08.505317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d66a8f02-546e-4363-bcb6-c594ff363c14 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047073 Jun 02 19:11:08.505883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 698/1418] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:08.769472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6d8be298-83f4-4b29-aa21-b9f716149014 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:08.770126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6d8be298-83f4-4b29-aa21-b9f716149014 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:08.777095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d8be298-83f4-4b29-aa21-b9f716149014 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:08.777557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d8be298-83f4-4b29-aa21-b9f716149014 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:08.778364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d8be298-83f4-4b29-aa21-b9f716149014 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:08.778810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d8be298-83f4-4b29-aa21-b9f716149014 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:08.815078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-587cc461-af56-4dae-b815-881b86b62d3b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:08.816095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-587cc461-af56-4dae-b815-881b86b62d3b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:08.823552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-587cc461-af56-4dae-b815-881b86b62d3b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:08.823994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-587cc461-af56-4dae-b815-881b86b62d3b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:08.824893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-587cc461-af56-4dae-b815-881b86b62d3b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:08.825321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-587cc461-af56-4dae-b815-881b86b62d3b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:08.842461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d8be298-83f4-4b29-aa21-b9f716149014 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:08.850502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6d8be298-83f4-4b29-aa21-b9f716149014 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085917 Jun 02 19:11:08.851078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 721/1419] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:08 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:08.855540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-587cc461-af56-4dae-b815-881b86b62d3b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Jun 02 19:11:08.856053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 699/1420] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:09.519448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8acdd1fb-248b-44a9-93cf-8af9dc7b7f9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:09.520390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8acdd1fb-248b-44a9-93cf-8af9dc7b7f9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:09.526895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8acdd1fb-248b-44a9-93cf-8af9dc7b7f9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:09.527345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8acdd1fb-248b-44a9-93cf-8af9dc7b7f9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:09.528189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8acdd1fb-248b-44a9-93cf-8af9dc7b7f9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:09.528633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8acdd1fb-248b-44a9-93cf-8af9dc7b7f9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:09.560862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8acdd1fb-248b-44a9-93cf-8af9dc7b7f9a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046085 Jun 02 19:11:09.561414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 722/1421] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:09.871799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4d379ada-f6af-487e-a841-e5fd03e17158 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:09.872682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-42834995-c59d-4ce6-ba9d-c8bf9e2a5142 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:09.873350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4d379ada-f6af-487e-a841-e5fd03e17158 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:09.873541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-42834995-c59d-4ce6-ba9d-c8bf9e2a5142 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:09.881503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42834995-c59d-4ce6-ba9d-c8bf9e2a5142 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:09.881724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d379ada-f6af-487e-a841-e5fd03e17158 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:09.881958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42834995-c59d-4ce6-ba9d-c8bf9e2a5142 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:09.882088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d379ada-f6af-487e-a841-e5fd03e17158 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:09.882762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42834995-c59d-4ce6-ba9d-c8bf9e2a5142 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:09.882910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d379ada-f6af-487e-a841-e5fd03e17158 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:09.883192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d379ada-f6af-487e-a841-e5fd03e17158 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:09.883336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42834995-c59d-4ce6-ba9d-c8bf9e2a5142 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:09.914002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4d379ada-f6af-487e-a841-e5fd03e17158 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049135 Jun 02 19:11:09.914570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 700/1422] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:09.947888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-42834995-c59d-4ce6-ba9d-c8bf9e2a5142 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:09.956104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-42834995-c59d-4ce6-ba9d-c8bf9e2a5142 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.090715 Jun 02 19:11:09.956677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 723/1423] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:09 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:10.577199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bfe18582-d1c1-406c-9db9-11de06cd5c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:10.578599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bfe18582-d1c1-406c-9db9-11de06cd5c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:10.585269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfe18582-d1c1-406c-9db9-11de06cd5c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:10.585726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfe18582-d1c1-406c-9db9-11de06cd5c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:10.586533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfe18582-d1c1-406c-9db9-11de06cd5c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:10.586979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfe18582-d1c1-406c-9db9-11de06cd5c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:10.617233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bfe18582-d1c1-406c-9db9-11de06cd5c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046567 Jun 02 19:11:10.617786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 701/1424] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:10.928412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e679549-73f0-4af4-abaa-63268b933dba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:10.929531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e679549-73f0-4af4-abaa-63268b933dba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:10.938079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e679549-73f0-4af4-abaa-63268b933dba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:10.938627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e679549-73f0-4af4-abaa-63268b933dba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:10.939405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e679549-73f0-4af4-abaa-63268b933dba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:10.939844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e679549-73f0-4af4-abaa-63268b933dba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:10.972355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e679549-73f0-4af4-abaa-63268b933dba tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048861 Jun 02 19:11:10.972931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 724/1425] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:10.973168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-31025c68-f73c-45e0-a8d7-fe526fe97ff0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:10.973764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-31025c68-f73c-45e0-a8d7-fe526fe97ff0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:10.980716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31025c68-f73c-45e0-a8d7-fe526fe97ff0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:10.981167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31025c68-f73c-45e0-a8d7-fe526fe97ff0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:10.981962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31025c68-f73c-45e0-a8d7-fe526fe97ff0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:10.982398 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31025c68-f73c-45e0-a8d7-fe526fe97ff0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:11.046290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-31025c68-f73c-45e0-a8d7-fe526fe97ff0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:11.053939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-31025c68-f73c-45e0-a8d7-fe526fe97ff0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.084859 Jun 02 19:11:11.054499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 702/1426] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:10 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:11.631960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9d2481ff-4475-4b46-be59-5be6f8bf1b07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:11.633039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9d2481ff-4475-4b46-be59-5be6f8bf1b07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:11.640582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d2481ff-4475-4b46-be59-5be6f8bf1b07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:11.641116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d2481ff-4475-4b46-be59-5be6f8bf1b07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:11.642688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d2481ff-4475-4b46-be59-5be6f8bf1b07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:11.643214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d2481ff-4475-4b46-be59-5be6f8bf1b07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:11.675819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9d2481ff-4475-4b46-be59-5be6f8bf1b07 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048596 Jun 02 19:11:11.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 725/1427] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:11.986846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-781e190d-6b65-4900-8d31-cf0c79ac80c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:11.987809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-781e190d-6b65-4900-8d31-cf0c79ac80c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:11.995465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-781e190d-6b65-4900-8d31-cf0c79ac80c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:11.995943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-781e190d-6b65-4900-8d31-cf0c79ac80c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:11.996744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-781e190d-6b65-4900-8d31-cf0c79ac80c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:11.997201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-781e190d-6b65-4900-8d31-cf0c79ac80c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:12.028232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-781e190d-6b65-4900-8d31-cf0c79ac80c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047274 Jun 02 19:11:12.028786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 703/1428] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:12.075156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c8db52f9-8cf5-4683-9bc3-ded5c9e8c4dc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:12.076046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c8db52f9-8cf5-4683-9bc3-ded5c9e8c4dc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:12.084529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8db52f9-8cf5-4683-9bc3-ded5c9e8c4dc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:12.085044 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8db52f9-8cf5-4683-9bc3-ded5c9e8c4dc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:12.085817 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8db52f9-8cf5-4683-9bc3-ded5c9e8c4dc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:12.086370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8db52f9-8cf5-4683-9bc3-ded5c9e8c4dc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:12.155034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c8db52f9-8cf5-4683-9bc3-ded5c9e8c4dc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:12.163136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c8db52f9-8cf5-4683-9bc3-ded5c9e8c4dc tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094730 Jun 02 19:11:12.163704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 726/1429] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:12 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:12.693164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-acbce1e3-3204-410f-aff2-a0b69ed1adfa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:12.695132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-acbce1e3-3204-410f-aff2-a0b69ed1adfa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:12.705189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-acbce1e3-3204-410f-aff2-a0b69ed1adfa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:12.705637 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-acbce1e3-3204-410f-aff2-a0b69ed1adfa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:12.706439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-acbce1e3-3204-410f-aff2-a0b69ed1adfa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:12.706871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-acbce1e3-3204-410f-aff2-a0b69ed1adfa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:12.709221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:12.739838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-acbce1e3-3204-410f-aff2-a0b69ed1adfa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053950 Jun 02 19:11:12.740412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 704/1430] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:13.045634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5dcc6aa4-9c97-42b2-89c7-f3eff458d512 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:13.046987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5dcc6aa4-9c97-42b2-89c7-f3eff458d512 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:13.056917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5dcc6aa4-9c97-42b2-89c7-f3eff458d512 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:13.057606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5dcc6aa4-9c97-42b2-89c7-f3eff458d512 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:13.058827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5dcc6aa4-9c97-42b2-89c7-f3eff458d512 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:13.059494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5dcc6aa4-9c97-42b2-89c7-f3eff458d512 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:13.100354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5dcc6aa4-9c97-42b2-89c7-f3eff458d512 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060879 Jun 02 19:11:13.101061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 727/1431] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:13.184427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-370591b9-62fc-441e-ad72-c67a219c8e5e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:13.185405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-370591b9-62fc-441e-ad72-c67a219c8e5e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:13.194076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-370591b9-62fc-441e-ad72-c67a219c8e5e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:13.194527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-370591b9-62fc-441e-ad72-c67a219c8e5e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:13.195639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-370591b9-62fc-441e-ad72-c67a219c8e5e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:13.196076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-370591b9-62fc-441e-ad72-c67a219c8e5e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:13.264169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-370591b9-62fc-441e-ad72-c67a219c8e5e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:13.272984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-370591b9-62fc-441e-ad72-c67a219c8e5e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095089 Jun 02 19:11:13.273545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 705/1432] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:13 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:13.752410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c6f0c082-2cb9-4614-9a9c-99bd3a334ad5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:13.753322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c6f0c082-2cb9-4614-9a9c-99bd3a334ad5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:13.760302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c6f0c082-2cb9-4614-9a9c-99bd3a334ad5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:13.760756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c6f0c082-2cb9-4614-9a9c-99bd3a334ad5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:13.761636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c6f0c082-2cb9-4614-9a9c-99bd3a334ad5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:13.762115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c6f0c082-2cb9-4614-9a9c-99bd3a334ad5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:13.793122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c6f0c082-2cb9-4614-9a9c-99bd3a334ad5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044856 Jun 02 19:11:13.794048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 728/1433] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:14.113213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-522666b9-c1f7-4029-8c82-958e0f2e89f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:14.114388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-522666b9-c1f7-4029-8c82-958e0f2e89f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:14.122607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-522666b9-c1f7-4029-8c82-958e0f2e89f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:14.123252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-522666b9-c1f7-4029-8c82-958e0f2e89f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:14.124323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-522666b9-c1f7-4029-8c82-958e0f2e89f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:14.124999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-522666b9-c1f7-4029-8c82-958e0f2e89f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:14.161830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-522666b9-c1f7-4029-8c82-958e0f2e89f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052870 Jun 02 19:11:14.162508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 706/1434] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:14.293533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9a8076d8-e40c-400e-b527-406a4279e189 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:14.294620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9a8076d8-e40c-400e-b527-406a4279e189 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:14.302492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a8076d8-e40c-400e-b527-406a4279e189 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:14.303277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a8076d8-e40c-400e-b527-406a4279e189 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:14.304283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a8076d8-e40c-400e-b527-406a4279e189 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:14.304830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a8076d8-e40c-400e-b527-406a4279e189 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:14.382384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9a8076d8-e40c-400e-b527-406a4279e189 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:14.390440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9a8076d8-e40c-400e-b527-406a4279e189 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102331 Jun 02 19:11:14.391019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 729/1435] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:14 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:14.811166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edc601b1-1ddb-437d-90f5-5c6157a2eaff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:14.812626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-edc601b1-1ddb-437d-90f5-5c6157a2eaff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:14.815978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=86 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:14.822268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc601b1-1ddb-437d-90f5-5c6157a2eaff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:14.822863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc601b1-1ddb-437d-90f5-5c6157a2eaff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:14.824020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc601b1-1ddb-437d-90f5-5c6157a2eaff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:14.824737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc601b1-1ddb-437d-90f5-5c6157a2eaff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:14.856944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-edc601b1-1ddb-437d-90f5-5c6157a2eaff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052495 Jun 02 19:11:14.857492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 707/1436] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:15.179602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-46329293-46ec-49b3-a043-65d0a5470bad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:15.181304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-46329293-46ec-49b3-a043-65d0a5470bad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:15.190897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-46329293-46ec-49b3-a043-65d0a5470bad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:15.191350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-46329293-46ec-49b3-a043-65d0a5470bad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:15.192119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-46329293-46ec-49b3-a043-65d0a5470bad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:15.192554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-46329293-46ec-49b3-a043-65d0a5470bad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:15.224104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-46329293-46ec-49b3-a043-65d0a5470bad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051949 Jun 02 19:11:15.224674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 730/1437] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:15.410396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c6b8ef54-6b01-4a7b-b441-75980567ac8b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:15.411077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c6b8ef54-6b01-4a7b-b441-75980567ac8b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:15.417945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c6b8ef54-6b01-4a7b-b441-75980567ac8b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:15.418397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c6b8ef54-6b01-4a7b-b441-75980567ac8b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:15.419152 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c6b8ef54-6b01-4a7b-b441-75980567ac8b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:15.419588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c6b8ef54-6b01-4a7b-b441-75980567ac8b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:15.486603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c6b8ef54-6b01-4a7b-b441-75980567ac8b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:15.494615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c6b8ef54-6b01-4a7b-b441-75980567ac8b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089008 Jun 02 19:11:15.495156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 708/1438] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:15 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:15.873608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-62f04f83-35c8-42ef-926d-0988beb70eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:15.874823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-62f04f83-35c8-42ef-926d-0988beb70eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:15.877424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=86 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:15.882896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62f04f83-35c8-42ef-926d-0988beb70eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:15.883353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62f04f83-35c8-42ef-926d-0988beb70eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:15.884123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62f04f83-35c8-42ef-926d-0988beb70eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:15.884564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62f04f83-35c8-42ef-926d-0988beb70eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:15.916786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-62f04f83-35c8-42ef-926d-0988beb70eac tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050005 Jun 02 19:11:15.917331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 731/1439] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:16.237325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d2ca003a-2257-4f16-9581-4cf64b358797 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:16.238330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d2ca003a-2257-4f16-9581-4cf64b358797 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:16.247188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2ca003a-2257-4f16-9581-4cf64b358797 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:16.247797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2ca003a-2257-4f16-9581-4cf64b358797 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:16.248970 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2ca003a-2257-4f16-9581-4cf64b358797 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:16.249579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2ca003a-2257-4f16-9581-4cf64b358797 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:16.284844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d2ca003a-2257-4f16-9581-4cf64b358797 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052236 Jun 02 19:11:16.285406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 709/1440] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:16.512840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1995f5c0-d8b2-408f-bcaa-ec2d17ffc496 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:16.513362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1995f5c0-d8b2-408f-bcaa-ec2d17ffc496 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:16.520412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1995f5c0-d8b2-408f-bcaa-ec2d17ffc496 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:16.520847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1995f5c0-d8b2-408f-bcaa-ec2d17ffc496 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:16.521607 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1995f5c0-d8b2-408f-bcaa-ec2d17ffc496 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:16.522073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1995f5c0-d8b2-408f-bcaa-ec2d17ffc496 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:16.595616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1995f5c0-d8b2-408f-bcaa-ec2d17ffc496 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:16.603565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1995f5c0-d8b2-408f-bcaa-ec2d17ffc496 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094933 Jun 02 19:11:16.604131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 732/1441] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:16 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:16.931165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1ec9a751-d1b7-4216-8502-9e0f9aeb0909 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:16.932631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1ec9a751-d1b7-4216-8502-9e0f9aeb0909 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:16.940964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ec9a751-d1b7-4216-8502-9e0f9aeb0909 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:16.941424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ec9a751-d1b7-4216-8502-9e0f9aeb0909 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:16.942192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ec9a751-d1b7-4216-8502-9e0f9aeb0909 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:16.942621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ec9a751-d1b7-4216-8502-9e0f9aeb0909 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:16.973579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1ec9a751-d1b7-4216-8502-9e0f9aeb0909 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047868 Jun 02 19:11:16.974159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 710/1442] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:17.298750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7ab51934-8c8b-4076-99ef-01eb9cfafc1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:17.299597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7ab51934-8c8b-4076-99ef-01eb9cfafc1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:17.306157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ab51934-8c8b-4076-99ef-01eb9cfafc1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:17.306615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ab51934-8c8b-4076-99ef-01eb9cfafc1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:17.307386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ab51934-8c8b-4076-99ef-01eb9cfafc1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:17.307825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ab51934-8c8b-4076-99ef-01eb9cfafc1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:17.310194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:17.337632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7ab51934-8c8b-4076-99ef-01eb9cfafc1f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Jun 02 19:11:17.338235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 733/1443] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:17.626641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-21b67ff1-0fac-4eff-805c-01d18ec1810c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:17.627226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-21b67ff1-0fac-4eff-805c-01d18ec1810c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:17.635668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21b67ff1-0fac-4eff-805c-01d18ec1810c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:17.636107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21b67ff1-0fac-4eff-805c-01d18ec1810c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:17.636870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21b67ff1-0fac-4eff-805c-01d18ec1810c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:17.637282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21b67ff1-0fac-4eff-805c-01d18ec1810c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:17.703025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-21b67ff1-0fac-4eff-805c-01d18ec1810c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:17.711594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-21b67ff1-0fac-4eff-805c-01d18ec1810c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089598 Jun 02 19:11:17.712148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 711/1444] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:17 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:17.988843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6258dad7-da6e-4999-8bb1-1c4dfd2155d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:17.989761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6258dad7-da6e-4999-8bb1-1c4dfd2155d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:17.996783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6258dad7-da6e-4999-8bb1-1c4dfd2155d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:17.997232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6258dad7-da6e-4999-8bb1-1c4dfd2155d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:17.998034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6258dad7-da6e-4999-8bb1-1c4dfd2155d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:17.998476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6258dad7-da6e-4999-8bb1-1c4dfd2155d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:18.028127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6258dad7-da6e-4999-8bb1-1c4dfd2155d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044228 Jun 02 19:11:18.028685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 734/1445] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:18.350893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3caa413a-8ab4-44e7-818d-3596c94e9067 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:18.351752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3caa413a-8ab4-44e7-818d-3596c94e9067 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:18.358605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3caa413a-8ab4-44e7-818d-3596c94e9067 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:18.359049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3caa413a-8ab4-44e7-818d-3596c94e9067 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:18.359808 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3caa413a-8ab4-44e7-818d-3596c94e9067 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:18.360228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3caa413a-8ab4-44e7-818d-3596c94e9067 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:18.390893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3caa413a-8ab4-44e7-818d-3596c94e9067 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Jun 02 19:11:18.391483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 712/1446] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:18.730549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9bd85212-0691-4988-aae5-2df0cdd2aadf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:18.731245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9bd85212-0691-4988-aae5-2df0cdd2aadf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:18.739043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bd85212-0691-4988-aae5-2df0cdd2aadf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:18.739537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bd85212-0691-4988-aae5-2df0cdd2aadf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:18.740304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bd85212-0691-4988-aae5-2df0cdd2aadf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:18.740749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bd85212-0691-4988-aae5-2df0cdd2aadf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:18.811477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9bd85212-0691-4988-aae5-2df0cdd2aadf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:18.820260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9bd85212-0691-4988-aae5-2df0cdd2aadf tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094136 Jun 02 19:11:18.820831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 735/1447] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:18 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:19.040968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-65aa3d2e-d7d6-4363-a9ca-7a3dff7f65f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:19.041815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-65aa3d2e-d7d6-4363-a9ca-7a3dff7f65f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:19.049655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65aa3d2e-d7d6-4363-a9ca-7a3dff7f65f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:19.050188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65aa3d2e-d7d6-4363-a9ca-7a3dff7f65f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:19.051193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65aa3d2e-d7d6-4363-a9ca-7a3dff7f65f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:19.051625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65aa3d2e-d7d6-4363-a9ca-7a3dff7f65f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:19.093661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-65aa3d2e-d7d6-4363-a9ca-7a3dff7f65f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056905 Jun 02 19:11:19.094626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 713/1448] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:19.403429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cc17d7cb-8d69-4612-ba4e-68be0281d376 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:19.404406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cc17d7cb-8d69-4612-ba4e-68be0281d376 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:19.411341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc17d7cb-8d69-4612-ba4e-68be0281d376 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:19.411797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc17d7cb-8d69-4612-ba4e-68be0281d376 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:19.412565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc17d7cb-8d69-4612-ba4e-68be0281d376 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:19.413006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc17d7cb-8d69-4612-ba4e-68be0281d376 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:19.450561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cc17d7cb-8d69-4612-ba4e-68be0281d376 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050815 Jun 02 19:11:19.451396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 736/1449] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:11:19.844633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6f2c0d4e-bbb2-4f33-a2f8-17aedcc52ab0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:19.845196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6f2c0d4e-bbb2-4f33-a2f8-17aedcc52ab0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:19.851611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f2c0d4e-bbb2-4f33-a2f8-17aedcc52ab0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:19.852063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f2c0d4e-bbb2-4f33-a2f8-17aedcc52ab0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:19.852825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f2c0d4e-bbb2-4f33-a2f8-17aedcc52ab0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:19.853257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f2c0d4e-bbb2-4f33-a2f8-17aedcc52ab0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:19.923000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6f2c0d4e-bbb2-4f33-a2f8-17aedcc52ab0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:19.932360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6f2c0d4e-bbb2-4f33-a2f8-17aedcc52ab0 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091786 Jun 02 19:11:19.932937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 714/1450] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:19 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:20.109773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cb475301-7c9d-4aff-8895-1005bf788fed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:20.111074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cb475301-7c9d-4aff-8895-1005bf788fed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:20.118728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb475301-7c9d-4aff-8895-1005bf788fed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:20.119187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb475301-7c9d-4aff-8895-1005bf788fed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:20.119944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb475301-7c9d-4aff-8895-1005bf788fed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:20.120379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb475301-7c9d-4aff-8895-1005bf788fed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:20.152297 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cb475301-7c9d-4aff-8895-1005bf788fed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048867 Jun 02 19:11:20.152857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 737/1451] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:20.467778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6d26c29c-f9cb-441f-8c5a-d6e03a48cd32 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:20.468923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6d26c29c-f9cb-441f-8c5a-d6e03a48cd32 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:20.477677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d26c29c-f9cb-441f-8c5a-d6e03a48cd32 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:20.478157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d26c29c-f9cb-441f-8c5a-d6e03a48cd32 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:20.478932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d26c29c-f9cb-441f-8c5a-d6e03a48cd32 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:20.479363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d26c29c-f9cb-441f-8c5a-d6e03a48cd32 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:20.510171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6d26c29c-f9cb-441f-8c5a-d6e03a48cd32 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048825 Jun 02 19:11:20.510725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 715/1452] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:20.950628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e644fa59-f9b0-4fc0-ba92-f7107acea70e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:20.951269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e644fa59-f9b0-4fc0-ba92-f7107acea70e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:20.958518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e644fa59-f9b0-4fc0-ba92-f7107acea70e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:20.958964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e644fa59-f9b0-4fc0-ba92-f7107acea70e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:20.959718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e644fa59-f9b0-4fc0-ba92-f7107acea70e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:20.960182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e644fa59-f9b0-4fc0-ba92-f7107acea70e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:21.023343 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e644fa59-f9b0-4fc0-ba92-f7107acea70e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:21.032173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e644fa59-f9b0-4fc0-ba92-f7107acea70e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085481 Jun 02 19:11:21.032781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 738/1453] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:20 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:21.166402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8889ad98-4bc4-41e5-9867-4d3564e4b867 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:21.167414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8889ad98-4bc4-41e5-9867-4d3564e4b867 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:21.174177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8889ad98-4bc4-41e5-9867-4d3564e4b867 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:21.174648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8889ad98-4bc4-41e5-9867-4d3564e4b867 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:21.175404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8889ad98-4bc4-41e5-9867-4d3564e4b867 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:21.175833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8889ad98-4bc4-41e5-9867-4d3564e4b867 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:21.208439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8889ad98-4bc4-41e5-9867-4d3564e4b867 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047704 Jun 02 19:11:21.208921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 716/1454] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:21.524996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-407211b4-24dc-4ef7-bac5-fb9016cf62e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:21.525993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-407211b4-24dc-4ef7-bac5-fb9016cf62e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:21.533432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-407211b4-24dc-4ef7-bac5-fb9016cf62e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:21.533957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-407211b4-24dc-4ef7-bac5-fb9016cf62e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:21.534745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-407211b4-24dc-4ef7-bac5-fb9016cf62e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:21.535209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-407211b4-24dc-4ef7-bac5-fb9016cf62e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:21.573525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-407211b4-24dc-4ef7-bac5-fb9016cf62e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052915 Jun 02 19:11:21.574258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 739/1455] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:22.051552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a7103b14-76ed-4acf-88b3-3410c780637e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:22.052333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a7103b14-76ed-4acf-88b3-3410c780637e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:22.061816 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a7103b14-76ed-4acf-88b3-3410c780637e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:22.062327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a7103b14-76ed-4acf-88b3-3410c780637e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:22.063088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a7103b14-76ed-4acf-88b3-3410c780637e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:22.063518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a7103b14-76ed-4acf-88b3-3410c780637e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:22.128000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a7103b14-76ed-4acf-88b3-3410c780637e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:22.136586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a7103b14-76ed-4acf-88b3-3410c780637e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.089141 Jun 02 19:11:22.137192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 717/1456] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:22 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:22.221168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-185c4a0d-bfb7-4c27-895b-41cce2e4489e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:22.222049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-185c4a0d-bfb7-4c27-895b-41cce2e4489e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:22.229117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-185c4a0d-bfb7-4c27-895b-41cce2e4489e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:22.229656 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-185c4a0d-bfb7-4c27-895b-41cce2e4489e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:22.230515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-185c4a0d-bfb7-4c27-895b-41cce2e4489e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:22.231120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-185c4a0d-bfb7-4c27-895b-41cce2e4489e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:22.262118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-185c4a0d-bfb7-4c27-895b-41cce2e4489e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045563 Jun 02 19:11:22.262721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 740/1457] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:22.587509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81a96137-4a5f-494b-a651-eb6d398fe6dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:22.588440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81a96137-4a5f-494b-a651-eb6d398fe6dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:22.596408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81a96137-4a5f-494b-a651-eb6d398fe6dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:22.596901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81a96137-4a5f-494b-a651-eb6d398fe6dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:22.597686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81a96137-4a5f-494b-a651-eb6d398fe6dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:22.598260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81a96137-4a5f-494b-a651-eb6d398fe6dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:22.629100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81a96137-4a5f-494b-a651-eb6d398fe6dc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Jun 02 19:11:22.630338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 718/1458] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:23.154895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e93284ad-e49f-4dfe-bf18-325c5617f7f2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:23.155505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e93284ad-e49f-4dfe-bf18-325c5617f7f2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:23.162199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e93284ad-e49f-4dfe-bf18-325c5617f7f2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:23.162658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e93284ad-e49f-4dfe-bf18-325c5617f7f2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:23.163429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e93284ad-e49f-4dfe-bf18-325c5617f7f2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:23.163876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e93284ad-e49f-4dfe-bf18-325c5617f7f2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:23.234742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e93284ad-e49f-4dfe-bf18-325c5617f7f2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:23.244515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e93284ad-e49f-4dfe-bf18-325c5617f7f2 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093615 Jun 02 19:11:23.245095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 741/1459] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:23 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:23.278740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3755f537-780d-4c8a-9d10-d11c7fe13cba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:23.279866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3755f537-780d-4c8a-9d10-d11c7fe13cba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:23.288355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3755f537-780d-4c8a-9d10-d11c7fe13cba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:23.288833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3755f537-780d-4c8a-9d10-d11c7fe13cba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:23.289617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3755f537-780d-4c8a-9d10-d11c7fe13cba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:23.290081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3755f537-780d-4c8a-9d10-d11c7fe13cba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:23.320505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3755f537-780d-4c8a-9d10-d11c7fe13cba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048312 Jun 02 19:11:23.321068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 719/1460] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:23.641677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-42e771c0-6254-4e94-8d4a-00546fb7ddad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:23.642642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-42e771c0-6254-4e94-8d4a-00546fb7ddad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:23.655777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42e771c0-6254-4e94-8d4a-00546fb7ddad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:23.656199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42e771c0-6254-4e94-8d4a-00546fb7ddad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:23.656978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42e771c0-6254-4e94-8d4a-00546fb7ddad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:23.657435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42e771c0-6254-4e94-8d4a-00546fb7ddad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:23.688235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-42e771c0-6254-4e94-8d4a-00546fb7ddad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050583 Jun 02 19:11:23.688797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 742/1461] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:24.273080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b4671b9b-b41c-4fbd-83aa-696e3495b8c6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:24.273848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b4671b9b-b41c-4fbd-83aa-696e3495b8c6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:24.282049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4671b9b-b41c-4fbd-83aa-696e3495b8c6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:24.282648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4671b9b-b41c-4fbd-83aa-696e3495b8c6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:24.283243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4671b9b-b41c-4fbd-83aa-696e3495b8c6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:24.283674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4671b9b-b41c-4fbd-83aa-696e3495b8c6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:24.335954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-63269481-1396-4621-a900-3e712ee78b23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:24.336825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-63269481-1396-4621-a900-3e712ee78b23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:24.343538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63269481-1396-4621-a900-3e712ee78b23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:24.343985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63269481-1396-4621-a900-3e712ee78b23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:24.344746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63269481-1396-4621-a900-3e712ee78b23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:24.345178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63269481-1396-4621-a900-3e712ee78b23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:24.355122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b4671b9b-b41c-4fbd-83aa-696e3495b8c6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:24.357330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:24.370251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b4671b9b-b41c-4fbd-83aa-696e3495b8c6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.104286 Jun 02 19:11:24.371079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 720/1462] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:24 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:24.386680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-63269481-1396-4621-a900-3e712ee78b23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055755 Jun 02 19:11:24.387246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 743/1463] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:24.704888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81f127e6-f187-42ec-bbdf-acfc1c480e48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:24.706537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81f127e6-f187-42ec-bbdf-acfc1c480e48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:24.714846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81f127e6-f187-42ec-bbdf-acfc1c480e48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:24.715297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81f127e6-f187-42ec-bbdf-acfc1c480e48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:24.716069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81f127e6-f187-42ec-bbdf-acfc1c480e48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:24.716506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81f127e6-f187-42ec-bbdf-acfc1c480e48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:24.748123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81f127e6-f187-42ec-bbdf-acfc1c480e48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050096 Jun 02 19:11:24.748676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 721/1464] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:25.389909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bf977cc8-66b6-430c-80c0-01cf6b0bfd8e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:25.390535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bf977cc8-66b6-430c-80c0-01cf6b0bfd8e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:25.398534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf977cc8-66b6-430c-80c0-01cf6b0bfd8e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:25.398989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf977cc8-66b6-430c-80c0-01cf6b0bfd8e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:25.399459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-17c0f028-78e3-4ddc-ba9b-ab514e7ebcd9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:25.399909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf977cc8-66b6-430c-80c0-01cf6b0bfd8e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:25.400188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf977cc8-66b6-430c-80c0-01cf6b0bfd8e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:25.400349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-17c0f028-78e3-4ddc-ba9b-ab514e7ebcd9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:25.407346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17c0f028-78e3-4ddc-ba9b-ab514e7ebcd9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:25.407791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17c0f028-78e3-4ddc-ba9b-ab514e7ebcd9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:25.408552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17c0f028-78e3-4ddc-ba9b-ab514e7ebcd9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:25.408978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17c0f028-78e3-4ddc-ba9b-ab514e7ebcd9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:25.416942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:11:25.417154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:11:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 (ip 10.222.0.15) !!! Jun 02 19:11:25.442362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-17c0f028-78e3-4ddc-ba9b-ab514e7ebcd9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047107 Jun 02 19:11:25.443068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 722/1465] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:25.467289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bf977cc8-66b6-430c-80c0-01cf6b0bfd8e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:25.475520 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bf977cc8-66b6-430c-80c0-01cf6b0bfd8e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091694 Jun 02 19:11:25.476280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 744/1466] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:25 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:25.770387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4f4d7b72-c3ea-4408-bdfb-790a9532a8bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:25.771689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4f4d7b72-c3ea-4408-bdfb-790a9532a8bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:25.779930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f4d7b72-c3ea-4408-bdfb-790a9532a8bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:25.780375 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f4d7b72-c3ea-4408-bdfb-790a9532a8bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:25.781137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f4d7b72-c3ea-4408-bdfb-790a9532a8bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:25.781569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f4d7b72-c3ea-4408-bdfb-790a9532a8bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:25.811473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4f4d7b72-c3ea-4408-bdfb-790a9532a8bb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054453 Jun 02 19:11:25.812046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 723/1467] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:26.459169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8ed0c36c-e42b-409c-a0c3-9bca343fa1a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:26.460294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8ed0c36c-e42b-409c-a0c3-9bca343fa1a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:26.470412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ed0c36c-e42b-409c-a0c3-9bca343fa1a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:26.471094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ed0c36c-e42b-409c-a0c3-9bca343fa1a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:26.472324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ed0c36c-e42b-409c-a0c3-9bca343fa1a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:26.473000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ed0c36c-e42b-409c-a0c3-9bca343fa1a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:26.493040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b172b813-7432-448e-a727-6c7fd77f6d57 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:26.493781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b172b813-7432-448e-a727-6c7fd77f6d57 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:26.500515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b172b813-7432-448e-a727-6c7fd77f6d57 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:26.500978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b172b813-7432-448e-a727-6c7fd77f6d57 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:26.501745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b172b813-7432-448e-a727-6c7fd77f6d57 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:26.502219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b172b813-7432-448e-a727-6c7fd77f6d57 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:26.508408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8ed0c36c-e42b-409c-a0c3-9bca343fa1a7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055554 Jun 02 19:11:26.508919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 745/1468] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:26.564143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b172b813-7432-448e-a727-6c7fd77f6d57 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:26.572521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b172b813-7432-448e-a727-6c7fd77f6d57 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.083746 Jun 02 19:11:26.573093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 724/1469] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:26 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:26.825694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a7059391-43bd-4b32-aa76-8aa42ab96061 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:26.826662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a7059391-43bd-4b32-aa76-8aa42ab96061 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:26.833613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7059391-43bd-4b32-aa76-8aa42ab96061 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:26.834141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7059391-43bd-4b32-aa76-8aa42ab96061 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:26.834997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7059391-43bd-4b32-aa76-8aa42ab96061 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:26.836139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7059391-43bd-4b32-aa76-8aa42ab96061 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:26.865913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a7059391-43bd-4b32-aa76-8aa42ab96061 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Jun 02 19:11:26.866512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 746/1470] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:27.523112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-28ee0fa3-c36b-494e-a1c0-76caddba46bf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:27.524044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-28ee0fa3-c36b-494e-a1c0-76caddba46bf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:27.531443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28ee0fa3-c36b-494e-a1c0-76caddba46bf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:27.531882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28ee0fa3-c36b-494e-a1c0-76caddba46bf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:27.532657 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28ee0fa3-c36b-494e-a1c0-76caddba46bf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:27.533086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28ee0fa3-c36b-494e-a1c0-76caddba46bf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:27.564174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-28ee0fa3-c36b-494e-a1c0-76caddba46bf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046282 Jun 02 19:11:27.564722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 725/1471] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:27.589304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f515bf90-58c3-4cea-81e2-d033fffa0368 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:27.589939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f515bf90-58c3-4cea-81e2-d033fffa0368 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:27.596661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f515bf90-58c3-4cea-81e2-d033fffa0368 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:27.597122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f515bf90-58c3-4cea-81e2-d033fffa0368 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:27.597916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f515bf90-58c3-4cea-81e2-d033fffa0368 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:27.598355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f515bf90-58c3-4cea-81e2-d033fffa0368 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:27.666027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f515bf90-58c3-4cea-81e2-d033fffa0368 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:27.673820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f515bf90-58c3-4cea-81e2-d033fffa0368 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088497 Jun 02 19:11:27.674394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 747/1472] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:27 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:27.883245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0f7334f8-33c1-4883-b0ea-aecfeb8ae146 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:27.884181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0f7334f8-33c1-4883-b0ea-aecfeb8ae146 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:27.890684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f7334f8-33c1-4883-b0ea-aecfeb8ae146 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:27.891150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f7334f8-33c1-4883-b0ea-aecfeb8ae146 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:27.891889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f7334f8-33c1-4883-b0ea-aecfeb8ae146 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:27.892318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f7334f8-33c1-4883-b0ea-aecfeb8ae146 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:27.922499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0f7334f8-33c1-4883-b0ea-aecfeb8ae146 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Jun 02 19:11:27.923049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 726/1473] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:28.579107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1d6a961c-bad9-4b0c-88e9-7da04dcae84f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:28.580233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1d6a961c-bad9-4b0c-88e9-7da04dcae84f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:28.588809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d6a961c-bad9-4b0c-88e9-7da04dcae84f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:28.589414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d6a961c-bad9-4b0c-88e9-7da04dcae84f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:28.590496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d6a961c-bad9-4b0c-88e9-7da04dcae84f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:28.591085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d6a961c-bad9-4b0c-88e9-7da04dcae84f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:28.625504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1d6a961c-bad9-4b0c-88e9-7da04dcae84f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051960 Jun 02 19:11:28.626216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 748/1474] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:28.691093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-61f427e2-6eb5-4f5f-81b7-1d2a8ac3ac99 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:28.691705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-61f427e2-6eb5-4f5f-81b7-1d2a8ac3ac99 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:28.699122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61f427e2-6eb5-4f5f-81b7-1d2a8ac3ac99 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:28.699581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61f427e2-6eb5-4f5f-81b7-1d2a8ac3ac99 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:28.700347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61f427e2-6eb5-4f5f-81b7-1d2a8ac3ac99 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:28.700788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61f427e2-6eb5-4f5f-81b7-1d2a8ac3ac99 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:28.773010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-61f427e2-6eb5-4f5f-81b7-1d2a8ac3ac99 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:28.781507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-61f427e2-6eb5-4f5f-81b7-1d2a8ac3ac99 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094449 Jun 02 19:11:28.782082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 727/1475] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:28 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:28.940670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b3099950-979c-4550-9204-1541be007dc9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:28.942327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b3099950-979c-4550-9204-1541be007dc9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:28.952884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b3099950-979c-4550-9204-1541be007dc9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:28.953630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b3099950-979c-4550-9204-1541be007dc9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:28.954927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b3099950-979c-4550-9204-1541be007dc9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:28.955650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b3099950-979c-4550-9204-1541be007dc9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:28.983416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:28.988175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b3099950-979c-4550-9204-1541be007dc9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054368 Jun 02 19:11:28.988734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 749/1476] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:29.640243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-89e16a28-dd90-4430-a467-2d54297705a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:29.641447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-89e16a28-dd90-4430-a467-2d54297705a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:29.651312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e16a28-dd90-4430-a467-2d54297705a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:29.651764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e16a28-dd90-4430-a467-2d54297705a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:29.652516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e16a28-dd90-4430-a467-2d54297705a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:29.652944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e16a28-dd90-4430-a467-2d54297705a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:29.683482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-89e16a28-dd90-4430-a467-2d54297705a9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048651 Jun 02 19:11:29.684025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 728/1477] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:29.802752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5eb4fa47-a6e2-4477-b872-f2dcbbb1a3ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:29.803607 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5eb4fa47-a6e2-4477-b872-f2dcbbb1a3ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:29.811612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5eb4fa47-a6e2-4477-b872-f2dcbbb1a3ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:29.812059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5eb4fa47-a6e2-4477-b872-f2dcbbb1a3ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:29.812841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5eb4fa47-a6e2-4477-b872-f2dcbbb1a3ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:29.813270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5eb4fa47-a6e2-4477-b872-f2dcbbb1a3ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:29.886793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5eb4fa47-a6e2-4477-b872-f2dcbbb1a3ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:29.898676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5eb4fa47-a6e2-4477-b872-f2dcbbb1a3ee tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.102036 Jun 02 19:11:29.899987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 750/1478] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:29 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:29.919056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:11:29.919540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:11:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:11:30.004941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-71bc7704-c979-484b-bc59-e849a18858f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:30.006975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-71bc7704-c979-484b-bc59-e849a18858f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:30.014805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-71bc7704-c979-484b-bc59-e849a18858f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:30.015256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-71bc7704-c979-484b-bc59-e849a18858f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:30.016006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-71bc7704-c979-484b-bc59-e849a18858f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:30.016431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-71bc7704-c979-484b-bc59-e849a18858f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:30.045100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-71bc7704-c979-484b-bc59-e849a18858f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047155 Jun 02 19:11:30.045740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 729/1479] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:30.769846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bc78bc2b-ac86-4825-b830-f947c6310322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:30.770790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bc78bc2b-ac86-4825-b830-f947c6310322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:30.777573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc78bc2b-ac86-4825-b830-f947c6310322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:30.778062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc78bc2b-ac86-4825-b830-f947c6310322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:30.778843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc78bc2b-ac86-4825-b830-f947c6310322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:30.779284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc78bc2b-ac86-4825-b830-f947c6310322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:30.812098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bc78bc2b-ac86-4825-b830-f947c6310322 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119026 Jun 02 19:11:30.812847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 751/1480] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:30.919430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-737de1bb-156e-41f7-bf55-6b8cb3201dcd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:30.920179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-737de1bb-156e-41f7-bf55-6b8cb3201dcd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:30.930047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-737de1bb-156e-41f7-bf55-6b8cb3201dcd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:30.930571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-737de1bb-156e-41f7-bf55-6b8cb3201dcd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:30.931865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-737de1bb-156e-41f7-bf55-6b8cb3201dcd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:30.932448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-737de1bb-156e-41f7-bf55-6b8cb3201dcd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:31.005234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-737de1bb-156e-41f7-bf55-6b8cb3201dcd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:31.015105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-737de1bb-156e-41f7-bf55-6b8cb3201dcd tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.101202 Jun 02 19:11:31.015790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 730/1481] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:30 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:31.058671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-097096cc-f5d4-4a94-b02e-f4352e365ffb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:31.059612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-097096cc-f5d4-4a94-b02e-f4352e365ffb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:31.066430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-097096cc-f5d4-4a94-b02e-f4352e365ffb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:31.066962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-097096cc-f5d4-4a94-b02e-f4352e365ffb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:31.067738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-097096cc-f5d4-4a94-b02e-f4352e365ffb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:31.068182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-097096cc-f5d4-4a94-b02e-f4352e365ffb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:31.098209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-097096cc-f5d4-4a94-b02e-f4352e365ffb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Jun 02 19:11:31.098760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 752/1482] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:31.835015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-11e6375a-8a78-4e86-a6f1-8769aa091718 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:31.836399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-11e6375a-8a78-4e86-a6f1-8769aa091718 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:31.843826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11e6375a-8a78-4e86-a6f1-8769aa091718 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:31.844268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11e6375a-8a78-4e86-a6f1-8769aa091718 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:31.845033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11e6375a-8a78-4e86-a6f1-8769aa091718 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:31.845458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11e6375a-8a78-4e86-a6f1-8769aa091718 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:31.878283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-11e6375a-8a78-4e86-a6f1-8769aa091718 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053901 Jun 02 19:11:31.878832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 731/1483] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:32.035400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cbacb07a-e73d-47a7-8b76-d2e6feed9930 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:32.036179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cbacb07a-e73d-47a7-8b76-d2e6feed9930 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:32.045947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbacb07a-e73d-47a7-8b76-d2e6feed9930 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:32.046568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbacb07a-e73d-47a7-8b76-d2e6feed9930 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:32.047588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbacb07a-e73d-47a7-8b76-d2e6feed9930 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:32.048179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbacb07a-e73d-47a7-8b76-d2e6feed9930 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:32.110354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f23fa3be-67c6-469e-a69e-ec7a4916166e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:32.111196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f23fa3be-67c6-469e-a69e-ec7a4916166e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:32.116917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cbacb07a-e73d-47a7-8b76-d2e6feed9930 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:32.118660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f23fa3be-67c6-469e-a69e-ec7a4916166e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:32.119121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f23fa3be-67c6-469e-a69e-ec7a4916166e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:32.119870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f23fa3be-67c6-469e-a69e-ec7a4916166e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:32.120373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f23fa3be-67c6-469e-a69e-ec7a4916166e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:32.125378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cbacb07a-e73d-47a7-8b76-d2e6feed9930 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095210 Jun 02 19:11:32.125971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 753/1484] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:32 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:32.150198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f23fa3be-67c6-469e-a69e-ec7a4916166e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Jun 02 19:11:32.150713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 732/1485] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:32.891664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15719d67-76cf-4807-9c70-d0d63249f5ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:32.892621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-15719d67-76cf-4807-9c70-d0d63249f5ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:32.899147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15719d67-76cf-4807-9c70-d0d63249f5ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:32.899626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15719d67-76cf-4807-9c70-d0d63249f5ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:32.900397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15719d67-76cf-4807-9c70-d0d63249f5ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:32.900838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15719d67-76cf-4807-9c70-d0d63249f5ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:32.931642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15719d67-76cf-4807-9c70-d0d63249f5ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044071 Jun 02 19:11:32.932194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 754/1486] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:33.145162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-70734c2a-81c9-42b2-a252-92a9d0f8dab8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:33.145780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-70734c2a-81c9-42b2-a252-92a9d0f8dab8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:33.159722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70734c2a-81c9-42b2-a252-92a9d0f8dab8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:33.160548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70734c2a-81c9-42b2-a252-92a9d0f8dab8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:33.162525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70734c2a-81c9-42b2-a252-92a9d0f8dab8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:33.162525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70734c2a-81c9-42b2-a252-92a9d0f8dab8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:33.162742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7b5e4f47-b6e9-456f-a693-8b913ed599a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:33.163689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7b5e4f47-b6e9-456f-a693-8b913ed599a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:33.171912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b5e4f47-b6e9-456f-a693-8b913ed599a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:33.172365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b5e4f47-b6e9-456f-a693-8b913ed599a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:33.173420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b5e4f47-b6e9-456f-a693-8b913ed599a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:33.173895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7b5e4f47-b6e9-456f-a693-8b913ed599a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:33.208192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7b5e4f47-b6e9-456f-a693-8b913ed599a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049902 Jun 02 19:11:33.208791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 755/1487] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:33.233712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-70734c2a-81c9-42b2-a252-92a9d0f8dab8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:33.241638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-70734c2a-81c9-42b2-a252-92a9d0f8dab8 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.103000 Jun 02 19:11:33.242244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 733/1488] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:33 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:33.948762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e373f00f-31f6-4b16-80c7-b426274325da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:33.949852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e373f00f-31f6-4b16-80c7-b426274325da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:33.956574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e373f00f-31f6-4b16-80c7-b426274325da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:33.957029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e373f00f-31f6-4b16-80c7-b426274325da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:33.957825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e373f00f-31f6-4b16-80c7-b426274325da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:33.958265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e373f00f-31f6-4b16-80c7-b426274325da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:33.988218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e373f00f-31f6-4b16-80c7-b426274325da tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046740 Jun 02 19:11:33.988760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 756/1489] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:34.229066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-06bbf7d7-8371-430b-a52a-81e1468da71b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:34.229066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-06bbf7d7-8371-430b-a52a-81e1468da71b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:34.229066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06bbf7d7-8371-430b-a52a-81e1468da71b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:34.230015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06bbf7d7-8371-430b-a52a-81e1468da71b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:34.230861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06bbf7d7-8371-430b-a52a-81e1468da71b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:34.231292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06bbf7d7-8371-430b-a52a-81e1468da71b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:34.261914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-570c7127-536b-4d24-837c-e77edeb9121e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:34.262593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-570c7127-536b-4d24-837c-e77edeb9121e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:34.270047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-06bbf7d7-8371-430b-a52a-81e1468da71b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052967 Jun 02 19:11:34.270649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 734/1490] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:34.271023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-570c7127-536b-4d24-837c-e77edeb9121e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:34.271677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-570c7127-536b-4d24-837c-e77edeb9121e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:34.273316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-570c7127-536b-4d24-837c-e77edeb9121e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:34.273789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-570c7127-536b-4d24-837c-e77edeb9121e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:34.340332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-570c7127-536b-4d24-837c-e77edeb9121e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:34.348219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-570c7127-536b-4d24-837c-e77edeb9121e tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093304 Jun 02 19:11:34.348782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 757/1491] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:34 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:35.004564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-441dee9d-d8f8-4239-9f9e-7283ffb363ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:35.006092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-441dee9d-d8f8-4239-9f9e-7283ffb363ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:35.017021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-441dee9d-d8f8-4239-9f9e-7283ffb363ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:35.017753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-441dee9d-d8f8-4239-9f9e-7283ffb363ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:35.019158 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-441dee9d-d8f8-4239-9f9e-7283ffb363ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:35.019868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-441dee9d-d8f8-4239-9f9e-7283ffb363ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:35.052728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-441dee9d-d8f8-4239-9f9e-7283ffb363ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054957 Jun 02 19:11:35.053249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 735/1492] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:35.232270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:11:35.232610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:11:35.282906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8f559461-d735-482c-844e-238675045588 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:35.283768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8f559461-d735-482c-844e-238675045588 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:35.291156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f559461-d735-482c-844e-238675045588 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:35.291612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f559461-d735-482c-844e-238675045588 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:35.292527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f559461-d735-482c-844e-238675045588 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:35.293334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f559461-d735-482c-844e-238675045588 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:35.323266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8f559461-d735-482c-844e-238675045588 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Jun 02 19:11:35.323987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 758/1493] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:35.365009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ff220700-0dc3-4d37-abbd-f5ab3950807f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:35.365601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ff220700-0dc3-4d37-abbd-f5ab3950807f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:35.372687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff220700-0dc3-4d37-abbd-f5ab3950807f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:35.373146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff220700-0dc3-4d37-abbd-f5ab3950807f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:35.374032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff220700-0dc3-4d37-abbd-f5ab3950807f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:35.374486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff220700-0dc3-4d37-abbd-f5ab3950807f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:35.440983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ff220700-0dc3-4d37-abbd-f5ab3950807f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:35.449777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ff220700-0dc3-4d37-abbd-f5ab3950807f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088819 Jun 02 19:11:35.450381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 736/1494] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:35 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:36.070287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-93b74f47-9042-4eef-af31-e7bdbbbe49a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:36.071900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-93b74f47-9042-4eef-af31-e7bdbbbe49a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:36.079548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93b74f47-9042-4eef-af31-e7bdbbbe49a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:36.080011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93b74f47-9042-4eef-af31-e7bdbbbe49a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:36.080789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93b74f47-9042-4eef-af31-e7bdbbbe49a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:36.081240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93b74f47-9042-4eef-af31-e7bdbbbe49a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:36.113957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-93b74f47-9042-4eef-af31-e7bdbbbe49a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051073 Jun 02 19:11:36.114604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 759/1495] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:36.338302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-47067916-c21c-45cf-9315-5f49449c7cb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:36.339646 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-47067916-c21c-45cf-9315-5f49449c7cb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:36.346111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47067916-c21c-45cf-9315-5f49449c7cb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:36.346583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47067916-c21c-45cf-9315-5f49449c7cb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:36.347353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47067916-c21c-45cf-9315-5f49449c7cb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:36.347789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47067916-c21c-45cf-9315-5f49449c7cb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:36.362017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:36.378278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-47067916-c21c-45cf-9315-5f49449c7cb0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046379 Jun 02 19:11:36.378848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 737/1496] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:36.468510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-975515fa-2e5a-4de2-a786-3563f136c163 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:36.469096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-975515fa-2e5a-4de2-a786-3563f136c163 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:36.476218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-975515fa-2e5a-4de2-a786-3563f136c163 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:36.476668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-975515fa-2e5a-4de2-a786-3563f136c163 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:36.477425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-975515fa-2e5a-4de2-a786-3563f136c163 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:36.477884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-975515fa-2e5a-4de2-a786-3563f136c163 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:36.544833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-975515fa-2e5a-4de2-a786-3563f136c163 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:36.552623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-975515fa-2e5a-4de2-a786-3563f136c163 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088624 Jun 02 19:11:36.553161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 760/1497] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:36 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:37.127482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-09962c26-61af-4a55-a130-8564d90e5776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:37.128412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-09962c26-61af-4a55-a130-8564d90e5776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:37.134563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09962c26-61af-4a55-a130-8564d90e5776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:37.135008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09962c26-61af-4a55-a130-8564d90e5776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:37.135768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09962c26-61af-4a55-a130-8564d90e5776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:37.136559 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09962c26-61af-4a55-a130-8564d90e5776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:37.173687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-09962c26-61af-4a55-a130-8564d90e5776 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050276 Jun 02 19:11:37.174271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 738/1498] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:37.391373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e4b1dccb-2bbd-4107-84ef-528267beb51c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:37.392317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e4b1dccb-2bbd-4107-84ef-528267beb51c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:37.398750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4b1dccb-2bbd-4107-84ef-528267beb51c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:37.399195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4b1dccb-2bbd-4107-84ef-528267beb51c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:37.399957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4b1dccb-2bbd-4107-84ef-528267beb51c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:37.400388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4b1dccb-2bbd-4107-84ef-528267beb51c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:37.430938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e4b1dccb-2bbd-4107-84ef-528267beb51c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043449 Jun 02 19:11:37.431486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 761/1499] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:37.573210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-58d3203c-aa81-442a-8261-e8112d74c2c1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:37.573915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-58d3203c-aa81-442a-8261-e8112d74c2c1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:37.581063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58d3203c-aa81-442a-8261-e8112d74c2c1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:37.581509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58d3203c-aa81-442a-8261-e8112d74c2c1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:37.582299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58d3203c-aa81-442a-8261-e8112d74c2c1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:37.582777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58d3203c-aa81-442a-8261-e8112d74c2c1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:37.659345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-58d3203c-aa81-442a-8261-e8112d74c2c1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:37.668612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-58d3203c-aa81-442a-8261-e8112d74c2c1 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.101420 Jun 02 19:11:37.669159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 739/1500] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:37 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:38.190742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cf14c858-fae8-4539-917f-a1f9e77a5db5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:38.192217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cf14c858-fae8-4539-917f-a1f9e77a5db5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:38.201467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf14c858-fae8-4539-917f-a1f9e77a5db5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:38.201949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf14c858-fae8-4539-917f-a1f9e77a5db5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:38.202713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf14c858-fae8-4539-917f-a1f9e77a5db5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:38.203149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf14c858-fae8-4539-917f-a1f9e77a5db5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:38.232417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cf14c858-fae8-4539-917f-a1f9e77a5db5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049786 Jun 02 19:11:38.232995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 762/1501] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:38.449823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9f6e8b91-ff2e-4b61-8898-393a49b85f2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:38.450762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9f6e8b91-ff2e-4b61-8898-393a49b85f2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:38.457194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f6e8b91-ff2e-4b61-8898-393a49b85f2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:38.457639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f6e8b91-ff2e-4b61-8898-393a49b85f2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:38.458430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f6e8b91-ff2e-4b61-8898-393a49b85f2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:38.458859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f6e8b91-ff2e-4b61-8898-393a49b85f2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:38.488006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9f6e8b91-ff2e-4b61-8898-393a49b85f2e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Jun 02 19:11:38.488548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 740/1502] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:38.687974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bed53606-05c7-4cf8-a814-82794008614c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:38.688675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bed53606-05c7-4cf8-a814-82794008614c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:38.697093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bed53606-05c7-4cf8-a814-82794008614c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:38.697664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bed53606-05c7-4cf8-a814-82794008614c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:38.698625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bed53606-05c7-4cf8-a814-82794008614c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:38.699231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bed53606-05c7-4cf8-a814-82794008614c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:38.765118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bed53606-05c7-4cf8-a814-82794008614c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:38.775451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bed53606-05c7-4cf8-a814-82794008614c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092185 Jun 02 19:11:38.776027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 763/1503] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:38 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:39.249067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-89d6f2c6-a91d-44d3-a446-c2e6d241ae95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:39.250025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-89d6f2c6-a91d-44d3-a446-c2e6d241ae95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:39.257105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89d6f2c6-a91d-44d3-a446-c2e6d241ae95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:39.257556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89d6f2c6-a91d-44d3-a446-c2e6d241ae95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:39.258383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89d6f2c6-a91d-44d3-a446-c2e6d241ae95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:39.258816 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89d6f2c6-a91d-44d3-a446-c2e6d241ae95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:39.288394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-89d6f2c6-a91d-44d3-a446-c2e6d241ae95 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044552 Jun 02 19:11:39.288946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 741/1504] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Jun 2 19:11:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:11:39.501500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d891425f-4573-4948-ac4b-dcbd5cd79a65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:39.502385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d891425f-4573-4948-ac4b-dcbd5cd79a65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:39.509556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d891425f-4573-4948-ac4b-dcbd5cd79a65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:39.510044 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d891425f-4573-4948-ac4b-dcbd5cd79a65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:39.510844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d891425f-4573-4948-ac4b-dcbd5cd79a65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:39.511285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d891425f-4573-4948-ac4b-dcbd5cd79a65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:39.547861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d891425f-4573-4948-ac4b-dcbd5cd79a65 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051559 Jun 02 19:11:39.548394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 764/1505] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:39.796784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-434ff466-ed23-46ed-9584-155bb9c8c18a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:39.797299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-434ff466-ed23-46ed-9584-155bb9c8c18a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:39.803820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-434ff466-ed23-46ed-9584-155bb9c8c18a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:39.804275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-434ff466-ed23-46ed-9584-155bb9c8c18a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:39.805035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-434ff466-ed23-46ed-9584-155bb9c8c18a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:39.805471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-434ff466-ed23-46ed-9584-155bb9c8c18a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:39.871934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-434ff466-ed23-46ed-9584-155bb9c8c18a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:39.884230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-434ff466-ed23-46ed-9584-155bb9c8c18a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093269 Jun 02 19:11:39.885098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 742/1506] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:39 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:40.302729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6f4e6c3f-8d80-4a4b-b61d-c05e953a1f35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:11:40.303659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6f4e6c3f-8d80-4a4b-b61d-c05e953a1f35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:40.309938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6f4e6c3f-8d80-4a4b-b61d-c05e953a1f35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:40.310491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6f4e6c3f-8d80-4a4b-b61d-c05e953a1f35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:40.311311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6f4e6c3f-8d80-4a4b-b61d-c05e953a1f35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:40.311754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6f4e6c3f-8d80-4a4b-b61d-c05e953a1f35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:40.395536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6f4e6c3f-8d80-4a4b-b61d-c05e953a1f35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "POST /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/action" status: 200 len: 37831 microversion: 2.20 time: 0.096550 Jun 02 19:11:40.396191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 765/1507] 10.222.0.15 () {62 vars in 1318 bytes} [Thu Jun 2 19:11:40 2022] POST /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788/action => generated 37831 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:11:40.561116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aede21af-a3a3-441a-a25a-5168a728486a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:40.562100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aede21af-a3a3-441a-a25a-5168a728486a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:40.569197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aede21af-a3a3-441a-a25a-5168a728486a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:40.569975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aede21af-a3a3-441a-a25a-5168a728486a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:40.570769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aede21af-a3a3-441a-a25a-5168a728486a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:40.571191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aede21af-a3a3-441a-a25a-5168a728486a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:40.612321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aede21af-a3a3-441a-a25a-5168a728486a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055259 Jun 02 19:11:40.612878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 743/1508] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:40.906769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8e64ad0f-2741-4963-9ab1-d20b3b78b31c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:40.907470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8e64ad0f-2741-4963-9ab1-d20b3b78b31c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:40.915015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e64ad0f-2741-4963-9ab1-d20b3b78b31c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:40.915467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e64ad0f-2741-4963-9ab1-d20b3b78b31c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:40.916234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e64ad0f-2741-4963-9ab1-d20b3b78b31c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:40.916669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e64ad0f-2741-4963-9ab1-d20b3b78b31c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:40.981635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8e64ad0f-2741-4963-9ab1-d20b3b78b31c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:40.984627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:40.991496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8e64ad0f-2741-4963-9ab1-d20b3b78b31c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091300 Jun 02 19:11:40.992060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 766/1509] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:40 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:41.626647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2f3acbaa-9eea-447b-adf1-84f0982c1c2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:41.627614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2f3acbaa-9eea-447b-adf1-84f0982c1c2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:41.634553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f3acbaa-9eea-447b-adf1-84f0982c1c2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:41.635004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f3acbaa-9eea-447b-adf1-84f0982c1c2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:41.635776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f3acbaa-9eea-447b-adf1-84f0982c1c2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:41.636220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f3acbaa-9eea-447b-adf1-84f0982c1c2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:41.667983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2f3acbaa-9eea-447b-adf1-84f0982c1c2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Jun 02 19:11:41.668696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 744/1510] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:42.012706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-05887fcc-cccf-4885-8863-2c58bb2cc11a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:42.014262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-05887fcc-cccf-4885-8863-2c58bb2cc11a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:42.021527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05887fcc-cccf-4885-8863-2c58bb2cc11a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:42.022024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05887fcc-cccf-4885-8863-2c58bb2cc11a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:42.022789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05887fcc-cccf-4885-8863-2c58bb2cc11a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:42.023227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05887fcc-cccf-4885-8863-2c58bb2cc11a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:42.096277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-05887fcc-cccf-4885-8863-2c58bb2cc11a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:42.107688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-05887fcc-cccf-4885-8863-2c58bb2cc11a tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.101220 Jun 02 19:11:42.108257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 767/1511] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:42 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:42.687231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0b81bf29-17a7-4eed-8541-60137444d2f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:42.688724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0b81bf29-17a7-4eed-8541-60137444d2f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:42.699994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b81bf29-17a7-4eed-8541-60137444d2f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:42.700725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b81bf29-17a7-4eed-8541-60137444d2f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:42.702005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b81bf29-17a7-4eed-8541-60137444d2f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:42.702460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b81bf29-17a7-4eed-8541-60137444d2f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:42.732729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0b81bf29-17a7-4eed-8541-60137444d2f9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052930 Jun 02 19:11:42.733276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 745/1512] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:43.134457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-71a2daf2-55a5-42b5-a735-1f2a60667993 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:43.135451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-71a2daf2-55a5-42b5-a735-1f2a60667993 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:43.146910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71a2daf2-55a5-42b5-a735-1f2a60667993 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:43.147664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71a2daf2-55a5-42b5-a735-1f2a60667993 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:43.148936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71a2daf2-55a5-42b5-a735-1f2a60667993 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:43.149664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71a2daf2-55a5-42b5-a735-1f2a60667993 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:43.221218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-71a2daf2-55a5-42b5-a735-1f2a60667993 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:43.233125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-71a2daf2-55a5-42b5-a735-1f2a60667993 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.104692 Jun 02 19:11:43.234068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 768/1513] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:43 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:43.748763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d0ba05b7-6e96-48ba-af1e-039dfa773e47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:43.749860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d0ba05b7-6e96-48ba-af1e-039dfa773e47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:43.757217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d0ba05b7-6e96-48ba-af1e-039dfa773e47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:43.757666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d0ba05b7-6e96-48ba-af1e-039dfa773e47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:43.758450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d0ba05b7-6e96-48ba-af1e-039dfa773e47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:43.758880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d0ba05b7-6e96-48ba-af1e-039dfa773e47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:43.789002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d0ba05b7-6e96-48ba-af1e-039dfa773e47 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046813 Jun 02 19:11:43.789462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 746/1514] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:44.257501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6ae991d8-3ccf-4bbd-ad13-f6f5a1012374 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:44.258317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6ae991d8-3ccf-4bbd-ad13-f6f5a1012374 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:44.266612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6ae991d8-3ccf-4bbd-ad13-f6f5a1012374 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:44.267074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6ae991d8-3ccf-4bbd-ad13-f6f5a1012374 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:44.267851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6ae991d8-3ccf-4bbd-ad13-f6f5a1012374 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:44.268303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6ae991d8-3ccf-4bbd-ad13-f6f5a1012374 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:44.332633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6ae991d8-3ccf-4bbd-ad13-f6f5a1012374 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:44.343724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6ae991d8-3ccf-4bbd-ad13-f6f5a1012374 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.091005 Jun 02 19:11:44.344493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 769/1515] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:44 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:44.804748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-890b68eb-c209-4efe-8ffa-cc645b854ffe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:44.805873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-890b68eb-c209-4efe-8ffa-cc645b854ffe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:44.817094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-890b68eb-c209-4efe-8ffa-cc645b854ffe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:44.817830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-890b68eb-c209-4efe-8ffa-cc645b854ffe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:44.819094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-890b68eb-c209-4efe-8ffa-cc645b854ffe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:44.820165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-890b68eb-c209-4efe-8ffa-cc645b854ffe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:44.852063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-890b68eb-c209-4efe-8ffa-cc645b854ffe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054054 Jun 02 19:11:44.852622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 747/1516] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:45.097680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1f3cd12-f600-4886-b5b2-67c485dcb190 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:45.098345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d1f3cd12-f600-4886-b5b2-67c485dcb190 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:45.104961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd12-f600-4886-b5b2-67c485dcb190 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:45.105486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd12-f600-4886-b5b2-67c485dcb190 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:45.106376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd12-f600-4886-b5b2-67c485dcb190 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:45.106814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1f3cd12-f600-4886-b5b2-67c485dcb190 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:45.365431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4fa8fb44-7c2e-4ca1-b880-f4ebffd095a5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:45.366012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4fa8fb44-7c2e-4ca1-b880-f4ebffd095a5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:45.368088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=82 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:45.374531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fa8fb44-7c2e-4ca1-b880-f4ebffd095a5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:45.375005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fa8fb44-7c2e-4ca1-b880-f4ebffd095a5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:45.375764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fa8fb44-7c2e-4ca1-b880-f4ebffd095a5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:45.376199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fa8fb44-7c2e-4ca1-b880-f4ebffd095a5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:45.446578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4fa8fb44-7c2e-4ca1-b880-f4ebffd095a5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:45.455106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4fa8fb44-7c2e-4ca1-b880-f4ebffd095a5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094229 Jun 02 19:11:45.455661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 748/1517] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:45 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:45.866482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-84c6e60f-3823-44f6-afb3-cb7929a6d254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:45.867620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84c6e60f-3823-44f6-afb3-cb7929a6d254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:45.876436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84c6e60f-3823-44f6-afb3-cb7929a6d254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:45.877041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84c6e60f-3823-44f6-afb3-cb7929a6d254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:45.878095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84c6e60f-3823-44f6-afb3-cb7929a6d254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:45.878661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84c6e60f-3823-44f6-afb3-cb7929a6d254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:45.910466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-84c6e60f-3823-44f6-afb3-cb7929a6d254 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049400 Jun 02 19:11:45.911010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 749/1518] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:46.480679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8496370a-d318-46b1-a50e-ba4514ea98de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:46.481691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8496370a-d318-46b1-a50e-ba4514ea98de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:46.489142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8496370a-d318-46b1-a50e-ba4514ea98de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:46.489590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8496370a-d318-46b1-a50e-ba4514ea98de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:46.490391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8496370a-d318-46b1-a50e-ba4514ea98de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:46.490832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8496370a-d318-46b1-a50e-ba4514ea98de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:46.563035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8496370a-d318-46b1-a50e-ba4514ea98de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:46.571673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8496370a-d318-46b1-a50e-ba4514ea98de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097572 Jun 02 19:11:46.572238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 750/1519] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:46 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:46.927265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-720fe00f-5ed6-4583-a856-f20a627e20a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:46.928761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-720fe00f-5ed6-4583-a856-f20a627e20a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:46.939118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720fe00f-5ed6-4583-a856-f20a627e20a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:46.939568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720fe00f-5ed6-4583-a856-f20a627e20a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:46.940326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720fe00f-5ed6-4583-a856-f20a627e20a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:46.940785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720fe00f-5ed6-4583-a856-f20a627e20a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:46.974089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-720fe00f-5ed6-4583-a856-f20a627e20a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054110 Jun 02 19:11:46.974643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 751/1520] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:47.590985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5199a453-9844-4d2f-85ca-bc2581f07100 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:47.591591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5199a453-9844-4d2f-85ca-bc2581f07100 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:47.598523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5199a453-9844-4d2f-85ca-bc2581f07100 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:47.598977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5199a453-9844-4d2f-85ca-bc2581f07100 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:47.599742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5199a453-9844-4d2f-85ca-bc2581f07100 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:47.600174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5199a453-9844-4d2f-85ca-bc2581f07100 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:47.663739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5199a453-9844-4d2f-85ca-bc2581f07100 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:47.672154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5199a453-9844-4d2f-85ca-bc2581f07100 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.085150 Jun 02 19:11:47.672712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 752/1521] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:47 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:11:47.987452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-709086e8-1a0b-476f-8ca6-da229868b2e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:47.988377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-709086e8-1a0b-476f-8ca6-da229868b2e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:47.995316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-709086e8-1a0b-476f-8ca6-da229868b2e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:47.995760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-709086e8-1a0b-476f-8ca6-da229868b2e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:47.996509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-709086e8-1a0b-476f-8ca6-da229868b2e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:47.996941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-709086e8-1a0b-476f-8ca6-da229868b2e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:48.026058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-709086e8-1a0b-476f-8ca6-da229868b2e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Jun 02 19:11:48.026577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 753/1522] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:48.690923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-719a685a-41b9-4b8d-aa47-3791b8c73a45 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:48.691569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-719a685a-41b9-4b8d-aa47-3791b8c73a45 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:48.699917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-719a685a-41b9-4b8d-aa47-3791b8c73a45 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:48.700487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-719a685a-41b9-4b8d-aa47-3791b8c73a45 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:48.701438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-719a685a-41b9-4b8d-aa47-3791b8c73a45 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:48.702709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-719a685a-41b9-4b8d-aa47-3791b8c73a45 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:48.704737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:48.765917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-719a685a-41b9-4b8d-aa47-3791b8c73a45 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:48.774472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-719a685a-41b9-4b8d-aa47-3791b8c73a45 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.088660 Jun 02 19:11:48.775012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 754/1523] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:48 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:49.042423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5946e965-8e91-4325-ab7e-8c10882ef835 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:49.043910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5946e965-8e91-4325-ab7e-8c10882ef835 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:49.055604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5946e965-8e91-4325-ab7e-8c10882ef835 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:49.056344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5946e965-8e91-4325-ab7e-8c10882ef835 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:49.057606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5946e965-8e91-4325-ab7e-8c10882ef835 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:49.058374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5946e965-8e91-4325-ab7e-8c10882ef835 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:49.089521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5946e965-8e91-4325-ab7e-8c10882ef835 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053936 Jun 02 19:11:49.090104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 755/1524] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:49.795310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b149e8d8-8d37-4c8c-8185-da4417ac729d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:49.795883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b149e8d8-8d37-4c8c-8185-da4417ac729d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:49.806206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b149e8d8-8d37-4c8c-8185-da4417ac729d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:49.806852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b149e8d8-8d37-4c8c-8185-da4417ac729d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:49.808002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b149e8d8-8d37-4c8c-8185-da4417ac729d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:49.808611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b149e8d8-8d37-4c8c-8185-da4417ac729d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:49.873881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b149e8d8-8d37-4c8c-8185-da4417ac729d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:49.881690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b149e8d8-8d37-4c8c-8185-da4417ac729d tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092922 Jun 02 19:11:49.882282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 756/1525] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:49 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:50.101720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-28f7c63d-50f8-44d3-8f41-311f76e10adf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:50.102709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-28f7c63d-50f8-44d3-8f41-311f76e10adf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:50.109770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28f7c63d-50f8-44d3-8f41-311f76e10adf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:50.110245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28f7c63d-50f8-44d3-8f41-311f76e10adf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:50.110982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28f7c63d-50f8-44d3-8f41-311f76e10adf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:50.111427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28f7c63d-50f8-44d3-8f41-311f76e10adf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:50.141348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-28f7c63d-50f8-44d3-8f41-311f76e10adf tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043559 Jun 02 19:11:50.141924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 757/1526] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:50.901176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-178a7d33-3235-42fe-b2e9-eed8eaa488df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:50.902031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-178a7d33-3235-42fe-b2e9-eed8eaa488df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:50.910709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-178a7d33-3235-42fe-b2e9-eed8eaa488df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:50.911305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-178a7d33-3235-42fe-b2e9-eed8eaa488df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:50.912301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-178a7d33-3235-42fe-b2e9-eed8eaa488df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:50.912866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-178a7d33-3235-42fe-b2e9-eed8eaa488df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:50.930466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:11:50.930642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:11:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 (ip 10.222.0.15) !!! Jun 02 19:11:50.992087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-178a7d33-3235-42fe-b2e9-eed8eaa488df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:51.001399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-178a7d33-3235-42fe-b2e9-eed8eaa488df tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.105413 Jun 02 19:11:51.003089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 758/1527] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:50 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:51.155946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ee2ea75d-8fa1-45c6-a37e-67e8de859423 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:51.156821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ee2ea75d-8fa1-45c6-a37e-67e8de859423 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:51.164099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee2ea75d-8fa1-45c6-a37e-67e8de859423 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:51.164585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee2ea75d-8fa1-45c6-a37e-67e8de859423 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:51.165362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee2ea75d-8fa1-45c6-a37e-67e8de859423 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:51.165827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee2ea75d-8fa1-45c6-a37e-67e8de859423 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:51.195383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ee2ea75d-8fa1-45c6-a37e-67e8de859423 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Jun 02 19:11:51.195943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 759/1528] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:52.023910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-22b37418-fa1a-4474-a763-779d9f8b4cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:52.024912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-22b37418-fa1a-4474-a763-779d9f8b4cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:52.033729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22b37418-fa1a-4474-a763-779d9f8b4cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:52.034217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22b37418-fa1a-4474-a763-779d9f8b4cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:52.034979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22b37418-fa1a-4474-a763-779d9f8b4cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:52.035411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-22b37418-fa1a-4474-a763-779d9f8b4cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:52.104503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-22b37418-fa1a-4474-a763-779d9f8b4cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:52.112091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-22b37418-fa1a-4474-a763-779d9f8b4cf9 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095251 Jun 02 19:11:52.112643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 760/1529] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:52 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:52.207495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f666b88c-848f-451d-ad6f-f5c5a76bde5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:52.208429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f666b88c-848f-451d-ad6f-f5c5a76bde5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:52.215501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f666b88c-848f-451d-ad6f-f5c5a76bde5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:52.215954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f666b88c-848f-451d-ad6f-f5c5a76bde5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:52.216719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f666b88c-848f-451d-ad6f-f5c5a76bde5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:52.217168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f666b88c-848f-451d-ad6f-f5c5a76bde5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:52.246680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f666b88c-848f-451d-ad6f-f5c5a76bde5a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Jun 02 19:11:52.247243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 761/1530] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:11:53.131561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f9abc35f-6401-4f05-9c09-b5fd47f79937 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:53.132439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f9abc35f-6401-4f05-9c09-b5fd47f79937 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:53.142005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9abc35f-6401-4f05-9c09-b5fd47f79937 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:53.142463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9abc35f-6401-4f05-9c09-b5fd47f79937 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:53.143228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9abc35f-6401-4f05-9c09-b5fd47f79937 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:53.143661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9abc35f-6401-4f05-9c09-b5fd47f79937 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:53.215876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f9abc35f-6401-4f05-9c09-b5fd47f79937 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:53.227150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f9abc35f-6401-4f05-9c09-b5fd47f79937 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.101477 Jun 02 19:11:53.227892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 762/1531] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:53 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:53.258504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9ff589a4-13e9-4381-a1e5-8283501cb887 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:53.259421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9ff589a4-13e9-4381-a1e5-8283501cb887 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:53.267045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ff589a4-13e9-4381-a1e5-8283501cb887 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:53.267635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ff589a4-13e9-4381-a1e5-8283501cb887 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:53.269316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ff589a4-13e9-4381-a1e5-8283501cb887 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:53.269850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ff589a4-13e9-4381-a1e5-8283501cb887 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:53.309455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9ff589a4-13e9-4381-a1e5-8283501cb887 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054682 Jun 02 19:11:53.310038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 763/1532] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:54.248838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-592cd917-bd09-44a3-a1e2-25b3ff6f2f70 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:54.249720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-592cd917-bd09-44a3-a1e2-25b3ff6f2f70 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:54.258059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-592cd917-bd09-44a3-a1e2-25b3ff6f2f70 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:54.258483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-592cd917-bd09-44a3-a1e2-25b3ff6f2f70 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:54.259270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-592cd917-bd09-44a3-a1e2-25b3ff6f2f70 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:54.259701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-592cd917-bd09-44a3-a1e2-25b3ff6f2f70 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:54.322956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-592cd917-bd09-44a3-a1e2-25b3ff6f2f70 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:54.330670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-592cd917-bd09-44a3-a1e2-25b3ff6f2f70 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.087059 Jun 02 19:11:54.331802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 764/1533] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:54 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:54.340131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-89e0fbb9-7db0-4100-8e98-050bb91a3c2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:54.340131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-89e0fbb9-7db0-4100-8e98-050bb91a3c2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:54.345270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e0fbb9-7db0-4100-8e98-050bb91a3c2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:54.345947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e0fbb9-7db0-4100-8e98-050bb91a3c2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:54.347011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e0fbb9-7db0-4100-8e98-050bb91a3c2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:54.347550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89e0fbb9-7db0-4100-8e98-050bb91a3c2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:54.378933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-89e0fbb9-7db0-4100-8e98-050bb91a3c2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Jun 02 19:11:54.379715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 765/1534] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:55.104869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=79 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:55.126652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=23 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:55.352339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4d0c7582-7c39-48ef-913f-15e763a030de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:55.353309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4d0c7582-7c39-48ef-913f-15e763a030de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:55.363661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d0c7582-7c39-48ef-913f-15e763a030de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:55.364037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d0c7582-7c39-48ef-913f-15e763a030de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:55.364797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d0c7582-7c39-48ef-913f-15e763a030de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:55.365221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d0c7582-7c39-48ef-913f-15e763a030de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:55.437396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4d0c7582-7c39-48ef-913f-15e763a030de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:55.446177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4d0c7582-7c39-48ef-913f-15e763a030de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.099961 Jun 02 19:11:55.446737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 766/1535] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:55 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:55.451889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dea69268-b832-4550-8601-4a3eccb15e17 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:55.452823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dea69268-b832-4550-8601-4a3eccb15e17 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:55.460060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dea69268-b832-4550-8601-4a3eccb15e17 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:55.460515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dea69268-b832-4550-8601-4a3eccb15e17 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:55.461295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dea69268-b832-4550-8601-4a3eccb15e17 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:55.461726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dea69268-b832-4550-8601-4a3eccb15e17 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:55.491714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dea69268-b832-4550-8601-4a3eccb15e17 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Jun 02 19:11:55.492267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 767/1536] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:56.465207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8b04d5a2-d83a-4ddb-b8bb-5013e9845576 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:56.466106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8b04d5a2-d83a-4ddb-b8bb-5013e9845576 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:56.474985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b04d5a2-d83a-4ddb-b8bb-5013e9845576 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:56.475432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b04d5a2-d83a-4ddb-b8bb-5013e9845576 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:56.476188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b04d5a2-d83a-4ddb-b8bb-5013e9845576 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:56.476613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b04d5a2-d83a-4ddb-b8bb-5013e9845576 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:56.549680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8b04d5a2-d83a-4ddb-b8bb-5013e9845576 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:56.566428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8b04d5a2-d83a-4ddb-b8bb-5013e9845576 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097656 Jun 02 19:11:56.567378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 768/1537] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:56 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:56.572570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16898dbf-6207-4c25-8e4f-66e14d564bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:56.573493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-16898dbf-6207-4c25-8e4f-66e14d564bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:56.579993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16898dbf-6207-4c25-8e4f-66e14d564bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:56.580441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16898dbf-6207-4c25-8e4f-66e14d564bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:56.581231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16898dbf-6207-4c25-8e4f-66e14d564bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:56.581779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16898dbf-6207-4c25-8e4f-66e14d564bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:56.613076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16898dbf-6207-4c25-8e4f-66e14d564bce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044534 Jun 02 19:11:56.613598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 769/1538] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:57.586529 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f558767d-5c26-4917-9146-d7b4eec69b3c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:57.587436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f558767d-5c26-4917-9146-d7b4eec69b3c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:57.596847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f558767d-5c26-4917-9146-d7b4eec69b3c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:57.597485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f558767d-5c26-4917-9146-d7b4eec69b3c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:57.598581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f558767d-5c26-4917-9146-d7b4eec69b3c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:57.599196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f558767d-5c26-4917-9146-d7b4eec69b3c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:57.664288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f558767d-5c26-4917-9146-d7b4eec69b3c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:57.666538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:57.673285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f558767d-5c26-4917-9146-d7b4eec69b3c tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092389 Jun 02 19:11:57.673854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 770/1539] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:57 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:57.678561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4282597a-cc9f-4d0b-9791-193e5a00e822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:57.679515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4282597a-cc9f-4d0b-9791-193e5a00e822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:57.685441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4282597a-cc9f-4d0b-9791-193e5a00e822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:57.685914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4282597a-cc9f-4d0b-9791-193e5a00e822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:57.686673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4282597a-cc9f-4d0b-9791-193e5a00e822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:57.687102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4282597a-cc9f-4d0b-9791-193e5a00e822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:57.717259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4282597a-cc9f-4d0b-9791-193e5a00e822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042374 Jun 02 19:11:57.718104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 771/1540] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:58.693141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fb071007-f7d4-4a7f-84ad-52bafe557dd3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:58.693901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fb071007-f7d4-4a7f-84ad-52bafe557dd3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:58.701703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb071007-f7d4-4a7f-84ad-52bafe557dd3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:58.702227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb071007-f7d4-4a7f-84ad-52bafe557dd3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:58.703053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb071007-f7d4-4a7f-84ad-52bafe557dd3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:58.703494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb071007-f7d4-4a7f-84ad-52bafe557dd3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:58.773125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fb071007-f7d4-4a7f-84ad-52bafe557dd3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:58.780861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fb071007-f7d4-4a7f-84ad-52bafe557dd3 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093409 Jun 02 19:11:58.781426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 772/1541] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:58 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:58.786236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-557c0a75-9b7a-4f79-acfe-386e5d0c218a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:58.787142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-557c0a75-9b7a-4f79-acfe-386e5d0c218a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:58.792853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-557c0a75-9b7a-4f79-acfe-386e5d0c218a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:58.793299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-557c0a75-9b7a-4f79-acfe-386e5d0c218a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:58.794090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-557c0a75-9b7a-4f79-acfe-386e5d0c218a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:58.794522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-557c0a75-9b7a-4f79-acfe-386e5d0c218a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:58.823305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-557c0a75-9b7a-4f79-acfe-386e5d0c218a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040864 Jun 02 19:11:58.823874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 773/1542] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:11:59.801890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef0ce9b2-43cf-46b1-82b4-007508de2f02 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:59.802551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef0ce9b2-43cf-46b1-82b4-007508de2f02 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:59.809002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef0ce9b2-43cf-46b1-82b4-007508de2f02 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:59.809455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef0ce9b2-43cf-46b1-82b4-007508de2f02 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:59.810287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef0ce9b2-43cf-46b1-82b4-007508de2f02 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:59.810716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef0ce9b2-43cf-46b1-82b4-007508de2f02 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:59.883106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef0ce9b2-43cf-46b1-82b4-007508de2f02 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:11:59.891033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef0ce9b2-43cf-46b1-82b4-007508de2f02 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.095441 Jun 02 19:11:59.891574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 774/1543] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:11:59 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:11:59.896393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cb33bb9c-447f-4f46-9a97-8efced4b53c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:11:59.897302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cb33bb9c-447f-4f46-9a97-8efced4b53c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:11:59.903332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb33bb9c-447f-4f46-9a97-8efced4b53c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:59.903726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb33bb9c-447f-4f46-9a97-8efced4b53c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:59.904485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb33bb9c-447f-4f46-9a97-8efced4b53c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:11:59.904918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb33bb9c-447f-4f46-9a97-8efced4b53c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:11:59.935699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cb33bb9c-447f-4f46-9a97-8efced4b53c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043108 Jun 02 19:11:59.936248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 775/1544] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:11:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:12:00.912054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3e665b8f-a365-4ecd-bfbe-85d59ac798f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:12:00.912788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3e665b8f-a365-4ecd-bfbe-85d59ac798f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:12:00.919823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e665b8f-a365-4ecd-bfbe-85d59ac798f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:00.920273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e665b8f-a365-4ecd-bfbe-85d59ac798f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:00.921015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e665b8f-a365-4ecd-bfbe-85d59ac798f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:00.921441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e665b8f-a365-4ecd-bfbe-85d59ac798f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:00.991044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3e665b8f-a365-4ecd-bfbe-85d59ac798f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:12:00.999353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3e665b8f-a365-4ecd-bfbe-85d59ac798f5 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.093874 Jun 02 19:12:00.999909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 776/1545] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:12:00 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:12:01.004624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ce169b2-a320-43cf-b708-412ca5124070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:12:01.005533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ce169b2-a320-43cf-b708-412ca5124070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:12:01.011685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ce169b2-a320-43cf-b708-412ca5124070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:01.012126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ce169b2-a320-43cf-b708-412ca5124070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:01.012875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ce169b2-a320-43cf-b708-412ca5124070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:01.013310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ce169b2-a320-43cf-b708-412ca5124070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:01.042910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ce169b2-a320-43cf-b708-412ca5124070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 Jun 02 19:12:01.043453 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 777/1546] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:12:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:12:02.017449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-043a8b38-54a6-4834-b00b-aea99bc55528 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:12:02.018199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-043a8b38-54a6-4834-b00b-aea99bc55528 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:12:02.026397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-043a8b38-54a6-4834-b00b-aea99bc55528 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:02.026850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-043a8b38-54a6-4834-b00b-aea99bc55528 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:02.027614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-043a8b38-54a6-4834-b00b-aea99bc55528 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:02.028050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-043a8b38-54a6-4834-b00b-aea99bc55528 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:02.098800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-043a8b38-54a6-4834-b00b-aea99bc55528 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:12:02.106952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-043a8b38-54a6-4834-b00b-aea99bc55528 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.094220 Jun 02 19:12:02.107493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 778/1547] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:12:02 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:12:02.112138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a29715c3-b935-4ae0-aa5b-aa297ffcca9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:12:02.113053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a29715c3-b935-4ae0-aa5b-aa297ffcca9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:12:02.119149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a29715c3-b935-4ae0-aa5b-aa297ffcca9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:02.119601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a29715c3-b935-4ae0-aa5b-aa297ffcca9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:02.120360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a29715c3-b935-4ae0-aa5b-aa297ffcca9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:02.120797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a29715c3-b935-4ae0-aa5b-aa297ffcca9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:02.196218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a29715c3-b935-4ae0-aa5b-aa297ffcca9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/action" status: 200 len: 82695 microversion: 2.1 time: 0.087269 Jun 02 19:12:02.196879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 779/1548] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:12:02 2022] POST /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/action => generated 82695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:12:02.213055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:12:02.213668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:12:02.221185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:02.221630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:02.222429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:12:02.222860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:12:12.218412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=65 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:12:12.242612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=57 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:34.471820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-d1f3cd12-f600-4886-b5b2-67c485dcb190 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lazy-loading 'services' on Instance uuid 423ad810-dacf-4ac6-9fa1-68964373fa1a {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:13:34.832607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lazy-loading 'services' on Instance uuid 721b511d-9547-41f5-a72c-47179f69b6af {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:13:44.476523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:44.837990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:45.289329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d1f3cd12-f600-4886-b5b2-67c485dcb190 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f" status: 202 len: 0 microversion: 2.1 time: 120.195456 Jun 02 19:13:45.290602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 770/1549] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:11:45 2022] DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f => generated 0 bytes in 120198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:13:45.298512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-af95d83b-0811-4801-b90f-7263906fa2de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:13:45.299523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-af95d83b-0811-4801-b90f-7263906fa2de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:13:45.307731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af95d83b-0811-4801-b90f-7263906fa2de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:13:45.308545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af95d83b-0811-4801-b90f-7263906fa2de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:13:45.309617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af95d83b-0811-4801-b90f-7263906fa2de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:13:45.310084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af95d83b-0811-4801-b90f-7263906fa2de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:13:45.313611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ccd092c1-d32a-4b25-b2ae-04c10fd2e4f9) Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Request method failure captured: Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c HTTP/1.1 Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQlZqEUvl2Itva5Yb1jfTiWTuApMrinh8_RTPww7LiNVwTyhbN9nVBbNNw5slpit47efPZ3lR6S6UBt3ypISiztKV0gndsjyN6ECfpBmHA8cubxt0m9UV3keBn6qqaGWObJeKJUFyaZ_KdxJ4tu_ZRxrgyoxLSCHV_4WfQEN7REv49g Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:13:45.316310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 9791fd04ff4045578041a3c7f613f495 Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:13:45.317724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ccd092c1-d32a-4b25-b2ae-04c10fd2e4f9) Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '721b511d-9547-41f5-a72c-47179f69b6af', 'id': '4dda9684-67c6-4469-a214-dc543be1470c'} Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:13:45.318443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ccd092c1-d32a-4b25-b2ae-04c10fd2e4f9) Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:13:45.320160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ccd092c1-d32a-4b25-b2ae-04c10fd2e4f9) Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:13:45.321301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ccd092c1-d32a-4b25-b2ae-04c10fd2e4f9) Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:13:45.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ccd092c1-d32a-4b25-b2ae-04c10fd2e4f9) Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ccd092c1-d32a-4b25-b2ae-04c10fd2e4f9) Jun 02 19:13:45.323558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:13:45.327089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ccd092c1-d32a-4b25-b2ae-04c10fd2e4f9) {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:13:45.328215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f1161f67-c659-41e0-a6ab-bd4581e90cd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c" status: 400 len: 269 microversion: 2.1 time: 103.119761 Jun 02 19:13:45.329389 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 780/1550] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:12:02 2022] DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c => generated 269 bytes in 103122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:13:45.336932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:13:45.337741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:13:45.344598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:13:45.345316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:13:45.347030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:13:45.347510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:13:45.383133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-af95d83b-0811-4801-b90f-7263906fa2de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:13:45.391438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-af95d83b-0811-4801-b90f-7263906fa2de tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.097847 Jun 02 19:13:45.392080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 771/1551] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:13:45 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:13:45.398351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:13:45.398846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:13:45.405298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:13:45.405915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:13:45.406676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:13:45.407119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:13:55.344724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:55.377789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:55.402989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:55.427153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:45.438699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:14:45.439735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c (ip 10.222.0.15) !!! Jun 02 19:14:49.929088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:14:49.930054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:14:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f (ip 10.222.0.15) !!! Jun 02 19:14:55.245931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:14:55.246833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:14:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c (ip 10.222.0.15) !!! Jun 02 19:15:10.951968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:15:10.952933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:15:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f (ip 10.222.0.15) !!! Jun 02 19:15:20.821416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:15:20.822527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f (ip 10.222.0.15) !!! Jun 02 19:15:35.180339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lazy-loading 'services' on Instance uuid 423ad810-dacf-4ac6-9fa1-68964373fa1a {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:15:35.224158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lazy-loading 'services' on Instance uuid 721b511d-9547-41f5-a72c-47179f69b6af {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:15:45.184916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:45.228366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:45.485320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15136b1a-8c5e-4fe1-8c96-f29eee2944f8) Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Request method failure captured: Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f HTTP/1.1 Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQmJCntEs0UlPtC_rP0kiTT0FDR3FEvaC7SuHwz5mcMRJwuXnEHFwYhKuXzJpygudeuIe988fO3d8tnjGSXIAyysJ1Uw50mO6bi-QvZR42ofapozonBIAeXVYtWs3a-z6SF4ukCpoa0WH_kOov-bCFEqmwJdNRqmjw1ZN7udTwvt3Ho Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:15:45.487582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 5c5875c5cba841a28560a475bb18d595 Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:15:45.489227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15136b1a-8c5e-4fe1-8c96-f29eee2944f8) Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '423ad810-dacf-4ac6-9fa1-68964373fa1a', 'id': '34a74491-2a21-466f-ba26-5d931a14891f'} Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:45.491031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15136b1a-8c5e-4fe1-8c96-f29eee2944f8) Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:45.494876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15136b1a-8c5e-4fe1-8c96-f29eee2944f8) Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.497499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15136b1a-8c5e-4fe1-8c96-f29eee2944f8) Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:45.499758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15136b1a-8c5e-4fe1-8c96-f29eee2944f8) Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15136b1a-8c5e-4fe1-8c96-f29eee2944f8) Jun 02 19:15:45.503177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.506280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15136b1a-8c5e-4fe1-8c96-f29eee2944f8) {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:15:45.506280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6237565a-fd06-48fa-b29e-2996dc969d98 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f" status: 400 len: 269 microversion: 2.1 time: 120.157762 Jun 02 19:15:45.506280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 781/1552] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:13:45 2022] DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f => generated 269 bytes in 120161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:15:45.506280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a444afcb-4897-4d2c-825e-6b1bb45c6328 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.507114 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a444afcb-4897-4d2c-825e-6b1bb45c6328 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.507114 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a444afcb-4897-4d2c-825e-6b1bb45c6328 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.507114 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a444afcb-4897-4d2c-825e-6b1bb45c6328 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.507781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a444afcb-4897-4d2c-825e-6b1bb45c6328 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.508400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a444afcb-4897-4d2c-825e-6b1bb45c6328 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18734b34-c7ff-4602-b8ee-a3a84726d139) Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Request method failure captured: Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c HTTP/1.1 Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQlZqEUvl2Itva5Yb1jfTiWTuApMrinh8_RTPww7LiNVwTyhbN9nVBbNNw5slpit47efPZ3lR6S6UBt3ypISiztKV0gndsjyN6ECfpBmHA8cubxt0m9UV3keBn6qqaGWObJeKJUFyaZ_KdxJ4tu_ZRxrgyoxLSCHV_4WfQEN7REv49g Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:15:45.525856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 9791fd04ff4045578041a3c7f613f495 Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:15:45.527768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18734b34-c7ff-4602-b8ee-a3a84726d139) Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '721b511d-9547-41f5-a72c-47179f69b6af', 'id': '4dda9684-67c6-4469-a214-dc543be1470c'} Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:45.528529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18734b34-c7ff-4602-b8ee-a3a84726d139) Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:45.529737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18734b34-c7ff-4602-b8ee-a3a84726d139) Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.531156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18734b34-c7ff-4602-b8ee-a3a84726d139) Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:45.532354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18734b34-c7ff-4602-b8ee-a3a84726d139) Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18734b34-c7ff-4602-b8ee-a3a84726d139) Jun 02 19:15:45.533569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.534768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18734b34-c7ff-4602-b8ee-a3a84726d139) {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:15:45.534768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-63f50041-7e5f-4961-86e8-ee9a6f29b9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c" status: 400 len: 269 microversion: 2.1 time: 120.134268 Jun 02 19:15:45.534768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 772/1553] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:13:45 2022] DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c => generated 269 bytes in 120136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:15:45.536323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-48ead759-d83d-4056-a51a-29b61f7e7fa2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.536323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-48ead759-d83d-4056-a51a-29b61f7e7fa2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.543121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48ead759-d83d-4056-a51a-29b61f7e7fa2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.543584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48ead759-d83d-4056-a51a-29b61f7e7fa2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.544812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48ead759-d83d-4056-a51a-29b61f7e7fa2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.544812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48ead759-d83d-4056-a51a-29b61f7e7fa2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.575715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-48ead759-d83d-4056-a51a-29b61f7e7fa2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:15:45.589013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a444afcb-4897-4d2c-825e-6b1bb45c6328 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:15:45.596702 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a444afcb-4897-4d2c-825e-6b1bb45c6328 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.104795 Jun 02 19:15:45.597342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 782/1554] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:15:45 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:15:45.602486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-706747ec-bcee-4a3c-b9c1-114c8654d695 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.602980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-706747ec-bcee-4a3c-b9c1-114c8654d695 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.608846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-706747ec-bcee-4a3c-b9c1-114c8654d695 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.609314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-706747ec-bcee-4a3c-b9c1-114c8654d695 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.610217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-706747ec-bcee-4a3c-b9c1-114c8654d695 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.610655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-706747ec-bcee-4a3c-b9c1-114c8654d695 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.636052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-706747ec-bcee-4a3c-b9c1-114c8654d695 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:15:45.660519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-48ead759-d83d-4056-a51a-29b61f7e7fa2 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 204 len: 0 microversion: 2.1 time: 0.130989 Jun 02 19:15:45.661132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 773/1555] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:15:45 2022] DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:15:45.666937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.667559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.674002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.674700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.675812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.676522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.720514 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-706747ec-bcee-4a3c-b9c1-114c8654d695 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 204 len: 0 microversion: 2.1 time: 0.121781 Jun 02 19:15:45.721162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 783/1556] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:15:45 2022] DELETE /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:15:45.726608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.727331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.733122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.733575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.734346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.734767 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.762413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lazy-loading 'services' on Instance uuid 423ad810-dacf-4ac6-9fa1-68964373fa1a {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:15:45.820198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lazy-loading 'services' on Instance uuid 721b511d-9547-41f5-a72c-47179f69b6af {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:15:45.855196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d6ed9272-1a1a-43d2-974c-2ebdfdc32d16) Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Request method failure captured: Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f HTTP/1.1 Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQmJCntEs0UlPtC_rP0kiTT0FDR3FEvaC7SuHwz5mcMRJwuXnEHFwYhKuXzJpygudeuIe988fO3d8tnjGSXIAyysJ1Uw50mO6bi-QvZR42ofapozonBIAeXVYtWs3a-z6SF4ukCpoa0WH_kOov-bCFEqmwJdNRqmjw1ZN7udTwvt3Ho Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:15:45.857578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 5c5875c5cba841a28560a475bb18d595 Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:15:45.859148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d6ed9272-1a1a-43d2-974c-2ebdfdc32d16) Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '423ad810-dacf-4ac6-9fa1-68964373fa1a', 'id': '34a74491-2a21-466f-ba26-5d931a14891f'} Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:45.860164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d6ed9272-1a1a-43d2-974c-2ebdfdc32d16) Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:45.861425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d6ed9272-1a1a-43d2-974c-2ebdfdc32d16) Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.862773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d6ed9272-1a1a-43d2-974c-2ebdfdc32d16) Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:45.863959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d6ed9272-1a1a-43d2-974c-2ebdfdc32d16) Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d6ed9272-1a1a-43d2-974c-2ebdfdc32d16) Jun 02 19:15:45.865275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.866848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d6ed9272-1a1a-43d2-974c-2ebdfdc32d16) {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:15:45.866848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f4d8a4b1-f552-4b6d-9a8f-ac2ef1164276 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f" status: 400 len: 269 microversion: 2.1 time: 0.198209 Jun 02 19:15:45.866848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 774/1557] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:15:45 2022] DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f => generated 269 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:15:45.868626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89e3c4ac-7bc0-451f-8ad3-1790107b803b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.869248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-89e3c4ac-7bc0-451f-8ad3-1790107b803b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.875355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89e3c4ac-7bc0-451f-8ad3-1790107b803b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.875815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89e3c4ac-7bc0-451f-8ad3-1790107b803b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.876585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89e3c4ac-7bc0-451f-8ad3-1790107b803b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.877161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89e3c4ac-7bc0-451f-8ad3-1790107b803b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.890385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09f00f15-cb19-4d7e-96e9-569c7294387a) Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Request method failure captured: Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c HTTP/1.1 Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQlZqEUvl2Itva5Yb1jfTiWTuApMrinh8_RTPww7LiNVwTyhbN9nVBbNNw5slpit47efPZ3lR6S6UBt3ypISiztKV0gndsjyN6ECfpBmHA8cubxt0m9UV3keBn6qqaGWObJeKJUFyaZ_KdxJ4tu_ZRxrgyoxLSCHV_4WfQEN7REv49g Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:15:45.892821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 9791fd04ff4045578041a3c7f613f495 Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:15:45.894339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09f00f15-cb19-4d7e-96e9-569c7294387a) Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '721b511d-9547-41f5-a72c-47179f69b6af', 'id': '4dda9684-67c6-4469-a214-dc543be1470c'} Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:45.895061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09f00f15-cb19-4d7e-96e9-569c7294387a) Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:45.896229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09f00f15-cb19-4d7e-96e9-569c7294387a) Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.897873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09f00f15-cb19-4d7e-96e9-569c7294387a) Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:45.899841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09f00f15-cb19-4d7e-96e9-569c7294387a) Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09f00f15-cb19-4d7e-96e9-569c7294387a) Jun 02 19:15:45.902051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:45.903667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09f00f15-cb19-4d7e-96e9-569c7294387a) {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:15:45.903667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-88615c76-ea07-43d6-bcf8-bcd62480dada tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c" status: 400 len: 269 microversion: 2.1 time: 0.173288 Jun 02 19:15:45.903667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 784/1558] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:15:45 2022] DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c => generated 269 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:15:45.903667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.904105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.908045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.908504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.909367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.909828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.935156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:15:45.940075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-89e3c4ac-7bc0-451f-8ad3-1790107b803b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:15:45.949003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-89e3c4ac-7bc0-451f-8ad3-1790107b803b tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.083964 Jun 02 19:15:45.949557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 775/1559] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:15:45 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:15:45.954144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.954645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.961232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.961982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.962761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.963409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.981815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.compute.api [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Instance is already in deleting state, ignoring this request Jun 02 19:15:45.982645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f3d5952c-906d-486c-b363-e56aad4cf812 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 204 len: 0 microversion: 2.1 time: 0.085196 Jun 02 19:15:45.983324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 785/1560] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:15:45 2022] DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:15:45.987970 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:45.988450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:45.992176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:15:45.994253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.994699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:45.995613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:45.995963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.038908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.compute.api [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Instance is already in deleting state, ignoring this request Jun 02 19:15:46.040240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9df39cbe-3ac5-4c53-b90e-21310f7ffcab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 204 len: 0 microversion: 2.1 time: 0.089242 Jun 02 19:15:46.040374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 776/1561] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:15:45 2022] DELETE /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:15:46.045307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:46.045887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:46.052726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.053182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.053977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.054429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.081120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lazy-loading 'services' on Instance uuid 423ad810-dacf-4ac6-9fa1-68964373fa1a {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:15:46.134914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lazy-loading 'services' on Instance uuid 721b511d-9547-41f5-a72c-47179f69b6af {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:15:46.164517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e2d4c59-8eeb-48b1-bf4c-a486debf400a) Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Request method failure captured: Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f HTTP/1.1 Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQmJCntEs0UlPtC_rP0kiTT0FDR3FEvaC7SuHwz5mcMRJwuXnEHFwYhKuXzJpygudeuIe988fO3d8tnjGSXIAyysJ1Uw50mO6bi-QvZR42ofapozonBIAeXVYtWs3a-z6SF4ukCpoa0WH_kOov-bCFEqmwJdNRqmjw1ZN7udTwvt3Ho Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:15:46.166661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 5c5875c5cba841a28560a475bb18d595 Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:15:46.168201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e2d4c59-8eeb-48b1-bf4c-a486debf400a) Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '423ad810-dacf-4ac6-9fa1-68964373fa1a', 'id': '34a74491-2a21-466f-ba26-5d931a14891f'} Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:46.169208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e2d4c59-8eeb-48b1-bf4c-a486debf400a) Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:15:46.171104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e2d4c59-8eeb-48b1-bf4c-a486debf400a) Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:46.174033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e2d4c59-8eeb-48b1-bf4c-a486debf400a) Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:46.175573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e2d4c59-8eeb-48b1-bf4c-a486debf400a) Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e2d4c59-8eeb-48b1-bf4c-a486debf400a) Jun 02 19:15:46.177128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:15:46.179481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e2d4c59-8eeb-48b1-bf4c-a486debf400a) {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:15:46.179481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-54a9cee5-3615-4694-9612-3bc39a453b52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f" status: 400 len: 269 microversion: 2.1 time: 0.183815 Jun 02 19:15:46.179481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 786/1562] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:15:45 2022] DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f => generated 269 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:15:46.179481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-26641bdc-ca32-478d-9905-c18bcc8cae95 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:46.179904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-26641bdc-ca32-478d-9905-c18bcc8cae95 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:46.179999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26641bdc-ca32-478d-9905-c18bcc8cae95 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.180384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26641bdc-ca32-478d-9905-c18bcc8cae95 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.181137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26641bdc-ca32-478d-9905-c18bcc8cae95 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.181564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26641bdc-ca32-478d-9905-c18bcc8cae95 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.254029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-26641bdc-ca32-478d-9905-c18bcc8cae95 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54c975b432a4678a5624ad5c9f54b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f30f060e2444f9a2238c4c447c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:15:46.262061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-26641bdc-ca32-478d-9905-c18bcc8cae95 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 200 len: 1226 microversion: 2.1 time: 0.092456 Jun 02 19:15:46.262610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 787/1563] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:15:46 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:15:46.267089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:46.267555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:46.274490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.274804 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.275582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.275997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.302944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:15:46.352569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.compute.api [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Instance is already in deleting state, ignoring this request Jun 02 19:15:46.353389 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-be91b54d-3a47-41cf-9185-778603074926 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 204 len: 0 microversion: 2.1 time: 0.089904 Jun 02 19:15:46.354331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 788/1564] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:15:46 2022] DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:15:46.359239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:46.359727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:46.365673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.366147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.366904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.367329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.392647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:15:46.440067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.compute.api [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Instance is already in deleting state, ignoring this request Jun 02 19:15:46.440904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-77334932-5ad0-4335-9ed5-b3cad700b238 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 204 len: 0 microversion: 2.1 time: 0.085599 Jun 02 19:15:46.441895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 789/1565] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:15:46 2022] DELETE /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:15:46.447409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:15:46.447597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:15:46.453892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.454673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:46.455631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:15:46.456215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:15:56.050648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:56.139132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:56.451396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:56.474819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:35.508083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40fa39c3-41ae-4a8c-8d8f-35634db157cb) Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Request method failure captured: Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c HTTP/1.1 Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQlZqEUvl2Itva5Yb1jfTiWTuApMrinh8_RTPww7LiNVwTyhbN9nVBbNNw5slpit47efPZ3lR6S6UBt3ypISiztKV0gndsjyN6ECfpBmHA8cubxt0m9UV3keBn6qqaGWObJeKJUFyaZ_KdxJ4tu_ZRxrgyoxLSCHV_4WfQEN7REv49g Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:17:35.510740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 9791fd04ff4045578041a3c7f613f495 Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:17:35.513980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40fa39c3-41ae-4a8c-8d8f-35634db157cb) Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '721b511d-9547-41f5-a72c-47179f69b6af', 'id': '4dda9684-67c6-4469-a214-dc543be1470c'} Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:35.514664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40fa39c3-41ae-4a8c-8d8f-35634db157cb) Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:35.515821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40fa39c3-41ae-4a8c-8d8f-35634db157cb) Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.517304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40fa39c3-41ae-4a8c-8d8f-35634db157cb) Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:35.519569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40fa39c3-41ae-4a8c-8d8f-35634db157cb) Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40fa39c3-41ae-4a8c-8d8f-35634db157cb) Jun 02 19:17:35.523971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.526768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40fa39c3-41ae-4a8c-8d8f-35634db157cb) {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:35.526768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2dceb2b4-9660-449b-9de8-db6d3e3e95c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c" status: 400 len: 269 microversion: 2.1 time: 109.470474 Jun 02 19:17:35.526768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 777/1566] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:15:46 2022] DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c => generated 269 bytes in 109471 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:17:35.591008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lazy-loading 'services' on Instance uuid 423ad810-dacf-4ac6-9fa1-68964373fa1a {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:17:35.753097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:35.753726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:35.761019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:35.761634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:35.762581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:35.763033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:35.777581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 HTTP/1.1 Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:17:35.779192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:35.780636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd285abbb-bcf6-43c7-be53-6b909c9bcce1'} Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:35.781398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:35.782657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.783883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:35.783883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-57dd0c0f-9e26-4c65-acda-273432ebb5b8 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 404 len: 111 microversion: 2.1 time: 0.267276 Jun 02 19:17:35.783883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 778/1567] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:35 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:17:35.786139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0df4d418-e68b-4aca-89ad-fface58ccbd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:35.786758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0df4d418-e68b-4aca-89ad-fface58ccbd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:35.793328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0df4d418-e68b-4aca-89ad-fface58ccbd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:35.793783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0df4d418-e68b-4aca-89ad-fface58ccbd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:35.794654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0df4d418-e68b-4aca-89ad-fface58ccbd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:35.795081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0df4d418-e68b-4aca-89ad-fface58ccbd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:35.908060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f17f6b7-5982-43a8-8e1b-2ac2ddd748b4) Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Request method failure captured: Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f HTTP/1.1 Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQmJCntEs0UlPtC_rP0kiTT0FDR3FEvaC7SuHwz5mcMRJwuXnEHFwYhKuXzJpygudeuIe988fO3d8tnjGSXIAyysJ1Uw50mO6bi-QvZR42ofapozonBIAeXVYtWs3a-z6SF4ukCpoa0WH_kOov-bCFEqmwJdNRqmjw1ZN7udTwvt3Ho Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:17:35.910343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 5c5875c5cba841a28560a475bb18d595 Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:17:35.911699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f17f6b7-5982-43a8-8e1b-2ac2ddd748b4) Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '423ad810-dacf-4ac6-9fa1-68964373fa1a', 'id': '34a74491-2a21-466f-ba26-5d931a14891f'} Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:35.912346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f17f6b7-5982-43a8-8e1b-2ac2ddd748b4) Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:35.913402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f17f6b7-5982-43a8-8e1b-2ac2ddd748b4) Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.914774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f17f6b7-5982-43a8-8e1b-2ac2ddd748b4) Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:35.917076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f17f6b7-5982-43a8-8e1b-2ac2ddd748b4) Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f17f6b7-5982-43a8-8e1b-2ac2ddd748b4) Jun 02 19:17:35.918782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:17:35.921042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f17f6b7-5982-43a8-8e1b-2ac2ddd748b4) {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:35.921042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1f315265-59b2-4821-b757-762cc218a6d0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f" status: 400 len: 269 microversion: 2.1 time: 109.469141 Jun 02 19:17:35.921042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 790/1568] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:15:46 2022] DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f => generated 269 bytes in 109470 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:17:35.921042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:35.921583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:35.926672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:35.927119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:35.927893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:35.928578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:35.944769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0df4d418-e68b-4aca-89ad-fface58ccbd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:35.953760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0df4d418-e68b-4aca-89ad-fface58ccbd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171597 Jun 02 19:17:35.954498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 779/1569] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:35 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:35.961782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:17:36.008867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.api [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Performing DB retry for function nova.db.main.api.instance_update_and_get_original {{(pid=117777) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jun 02 19:17:36.015549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-ea76fcc9-f9a4-4781-b664-2e45ace5ca77 req-80a4ad89-9899-4725-bfc9-57b9c74ea7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d285abbb-bcf6-43c7-be53-6b909c9bcce1", "name": "network-vif-deleted", "tag": "45ad7fdf-8670-45bd-9a90-0be0f9bd7366"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:17:36.023934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ea76fcc9-f9a4-4781-b664-2e45ace5ca77 req-80a4ad89-9899-4725-bfc9-57b9c74ea7a2 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.024383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ea76fcc9-f9a4-4781-b664-2e45ace5ca77 req-80a4ad89-9899-4725-bfc9-57b9c74ea7a2 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.035871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-ea76fcc9-f9a4-4781-b664-2e45ace5ca77 req-80a4ad89-9899-4725-bfc9-57b9c74ea7a2 service nova] Creating event network-vif-deleted:45ad7fdf-8670-45bd-9a90-0be0f9bd7366 for instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 on hv-cinder-79760 Jun 02 19:17:36.041078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-ea76fcc9-f9a4-4781-b664-2e45ace5ca77 req-80a4ad89-9899-4725-bfc9-57b9c74ea7a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085188 Jun 02 19:17:36.041668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 780/1570] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:17:36.049142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:36.049734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:36.057173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.057631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.058537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.059174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.145295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lazy-loading 'services' on Instance uuid 721b511d-9547-41f5-a72c-47179f69b6af {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:17:36.204358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c39fd287-8135-474d-8a96-f620556f7cbc) Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Request method failure captured: Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c HTTP/1.1 Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQlZqEUvl2Itva5Yb1jfTiWTuApMrinh8_RTPww7LiNVwTyhbN9nVBbNNw5slpit47efPZ3lR6S6UBt3ypISiztKV0gndsjyN6ECfpBmHA8cubxt0m9UV3keBn6qqaGWObJeKJUFyaZ_KdxJ4tu_ZRxrgyoxLSCHV_4WfQEN7REv49g Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:17:36.206688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 9791fd04ff4045578041a3c7f613f495 Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:17:36.208160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c39fd287-8135-474d-8a96-f620556f7cbc) Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '721b511d-9547-41f5-a72c-47179f69b6af', 'id': '4dda9684-67c6-4469-a214-dc543be1470c'} Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:36.209035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c39fd287-8135-474d-8a96-f620556f7cbc) Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:36.210859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c39fd287-8135-474d-8a96-f620556f7cbc) Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.212217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c39fd287-8135-474d-8a96-f620556f7cbc) Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.213409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c39fd287-8135-474d-8a96-f620556f7cbc) Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c39fd287-8135-474d-8a96-f620556f7cbc) Jun 02 19:17:36.214747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.216093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c39fd287-8135-474d-8a96-f620556f7cbc) {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:36.216093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7ec8d011-ec24-41e8-896b-380cda040f06 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c" status: 400 len: 269 microversion: 2.1 time: 0.163809 Jun 02 19:17:36.216093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 781/1571] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:17:36 2022] DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:17:36.216093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:36.216439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:36.220826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.221287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.222093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.222532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.305244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lazy-loading 'services' on Instance uuid 423ad810-dacf-4ac6-9fa1-68964373fa1a {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:17:36.364958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-705bd10e-8583-4f1a-bae1-30a7b42a72cb) Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Request method failure captured: Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f HTTP/1.1 Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQmJCntEs0UlPtC_rP0kiTT0FDR3FEvaC7SuHwz5mcMRJwuXnEHFwYhKuXzJpygudeuIe988fO3d8tnjGSXIAyysJ1Uw50mO6bi-QvZR42ofapozonBIAeXVYtWs3a-z6SF4ukCpoa0WH_kOov-bCFEqmwJdNRqmjw1ZN7udTwvt3Ho Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:17:36.367186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6ad466a7fdbb4ef18dddf54fb200971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 6ad466a7fdbb4ef18dddf54fb200971d Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-453344377 Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 5c5875c5cba841a28560a475bb18d595 Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesSnapshotTestJSON-453344377-project Jun 02 19:17:36.368666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-705bd10e-8583-4f1a-bae1-30a7b42a72cb) Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '423ad810-dacf-4ac6-9fa1-68964373fa1a', 'id': '34a74491-2a21-466f-ba26-5d931a14891f'} Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:36.369374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-705bd10e-8583-4f1a-bae1-30a7b42a72cb) Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:36.370847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-705bd10e-8583-4f1a-bae1-30a7b42a72cb) Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.371972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-705bd10e-8583-4f1a-bae1-30a7b42a72cb) Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.372973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-705bd10e-8583-4f1a-bae1-30a7b42a72cb) Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-705bd10e-8583-4f1a-bae1-30a7b42a72cb) Jun 02 19:17:36.374094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.375122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-705bd10e-8583-4f1a-bae1-30a7b42a72cb) {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:36.375122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8aded96d-7c4e-4703-84de-aa3bff8cba30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f" status: 400 len: 269 microversion: 2.1 time: 0.158804 Jun 02 19:17:36.375122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 782/1572] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:17:36 2022] DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a/os-volume_attachments/34a74491-2a21-466f-ba26-5d931a14891f => generated 269 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:17:36.375122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:36.375766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:36.382585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.383034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.383835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.384270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.399496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 HTTP/1.1 Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:17:36.401073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:36.402945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd285abbb-bcf6-43c7-be53-6b909c9bcce1'} Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:36.403767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:17:36.405831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.407402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:36.407402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-27ce0c2f-09ad-4302-8377-df2d8a2933d4 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 404 len: 111 microversion: 2.1 time: 0.033401 Jun 02 19:17:36.407402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 783/1573] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:36 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:17:36.408866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fb79f118-08f0-4e66-b2b6-c2652d8753aa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:36.409481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fb79f118-08f0-4e66-b2b6-c2652d8753aa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:36.415869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb79f118-08f0-4e66-b2b6-c2652d8753aa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.416247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb79f118-08f0-4e66-b2b6-c2652d8753aa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.417054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb79f118-08f0-4e66-b2b6-c2652d8753aa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.417491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fb79f118-08f0-4e66-b2b6-c2652d8753aa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.564637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fb79f118-08f0-4e66-b2b6-c2652d8753aa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:36.573818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fb79f118-08f0-4e66-b2b6-c2652d8753aa tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168592 Jun 02 19:17:36.575004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 784/1574] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:36 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:36.579622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:36.580108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:36.586624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.587085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.587862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.588302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.603510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] HTTP exception thrown: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Request method failure captured: Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 HTTP/1.1 Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQmv9aOl-8wFvCx8BadTFhsmHDmLygumLx4wtMIPPyJl6pJY5kQNv-_MGNaDYG2jYqh7g9q88Af-DbS9U9kL0J6eaeWE3aXwUNAXXABsv1xPHp_6bfZbmcNKORMvfvzZS0bdECqjn_E9Pb061G-eQvxK_C3TVbaYzrJaJK2uBVgs9Uk Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 01f30f060e2444f9a2238c4c447c7dbd Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestVolumeBootPattern-78835927 Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:17:36.605391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_01f30f060e2444f9a2238c4c447c7dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/01f30f060e2444f9a2238c4c447c7dbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/01f30f060e2444f9a2238c4c447c7dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/01f30f060e2444f9a2238c4c447c7dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestVolumeBootPattern-78835927 Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 01f30f060e2444f9a2238c4c447c7dbd Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestVolumeBootPattern-78835927 Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-TestVolumeBootPattern-78835927-project Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: f54c975b432a4678a5624ad5c9f54b74 Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestVolumeBootPattern-78835927-project Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.606943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '9a0a9be2-f2c0-4fa4-919b-44afcbdbae67'} Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:36.607894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.609505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.611077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Returning 404 to user: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:36.611077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1df5cdc0-b9a2-4651-83ce-5d22bb4d735f tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 404 len: 111 microversion: 2.1 time: 0.030930 Jun 02 19:17:36.611077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 785/1575] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:17:36 2022] DELETE /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:17:36.614925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:36.615428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:36.622603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.623089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.623872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.624315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.709182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lazy-loading 'services' on Instance uuid 721b511d-9547-41f5-a72c-47179f69b6af {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:17:36.770754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c025e5cb-c2a9-4901-9ae5-f681d4da3168) Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Request method failure captured: Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c HTTP/1.1 Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQlZqEUvl2Itva5Yb1jfTiWTuApMrinh8_RTPww7LiNVwTyhbN9nVBbNNw5slpit47efPZ3lR6S6UBt3ypISiztKV0gndsjyN6ECfpBmHA8cubxt0m9UV3keBn6qqaGWObJeKJUFyaZ_KdxJ4tu_ZRxrgyoxLSCHV_4WfQEN7REv49g Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:17:36.773163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3cefe0d5fbae4b6ca7578bf08f275bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 3cefe0d5fbae4b6ca7578bf08f275bac Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-27484978 Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 9791fd04ff4045578041a3c7f613f495 Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestMinimumBasicScenario-27484978-project Jun 02 19:17:36.774697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c025e5cb-c2a9-4901-9ae5-f681d4da3168) Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '721b511d-9547-41f5-a72c-47179f69b6af', 'id': '4dda9684-67c6-4469-a214-dc543be1470c'} Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:36.775526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c025e5cb-c2a9-4901-9ae5-f681d4da3168) Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 19:17:36.776723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c025e5cb-c2a9-4901-9ae5-f681d4da3168) Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.778226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c025e5cb-c2a9-4901-9ae5-f681d4da3168) Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.779429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c025e5cb-c2a9-4901-9ae5-f681d4da3168) Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c025e5cb-c2a9-4901-9ae5-f681d4da3168) Jun 02 19:17:36.780696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.781935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c025e5cb-c2a9-4901-9ae5-f681d4da3168) {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:36.781935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-066123bc-c997-4de5-b2a0-a49c184a4189 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c" status: 400 len: 269 microversion: 2.1 time: 0.165827 Jun 02 19:17:36.781935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 786/1576] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:17:36 2022] DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af/os-volume_attachments/4dda9684-67c6-4469-a214-dc543be1470c => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:17:36.781935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-67272e10-d228-4852-ba6f-968869920eff tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '.version_select at 0x7f5b78d811f0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:36.802858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-67272e10-d228-4852-ba6f-968869920eff tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-452202010" status: 202 len: 0 microversion: 2.1 time: 0.026586 Jun 02 19:17:36.803454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 787/1577] 10.222.0.15 () {58 vars in 1217 bytes} [Thu Jun 2 19:17:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-452202010 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:17:36.827090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:36.828333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] [instance: 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:36.835448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.835888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.836888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:36.837333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:36.860256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] HTTP exception thrown: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Request method failure captured: Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 HTTP/1.1 Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQmv9aOl-8wFvCx8BadTFhsmHDmLygumLx4wtMIPPyJl6pJY5kQNv-_MGNaDYG2jYqh7g9q88Af-DbS9U9kL0J6eaeWE3aXwUNAXXABsv1xPHp_6bfZbmcNKORMvfvzZS0bdECqjn_E9Pb061G-eQvxK_C3TVbaYzrJaJK2uBVgs9Uk Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 01f30f060e2444f9a2238c4c447c7dbd Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestVolumeBootPattern-78835927 Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:17:36.862674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_01f30f060e2444f9a2238c4c447c7dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/01f30f060e2444f9a2238c4c447c7dbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/01f30f060e2444f9a2238c4c447c7dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/01f30f060e2444f9a2238c4c447c7dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestVolumeBootPattern-78835927 Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 01f30f060e2444f9a2238c4c447c7dbd Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestVolumeBootPattern-78835927 Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-TestVolumeBootPattern-78835927-project Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: f54c975b432a4678a5624ad5c9f54b74 Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestVolumeBootPattern-78835927-project Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.864338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '9a0a9be2-f2c0-4fa4-919b-44afcbdbae67'} Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:17:36.865325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. Jun 02 19:17:36.866722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:17:36.867820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Returning 404 to user: Instance 9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:17:36.867820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bc0a0841-50fe-46d4-91d7-92e078baafd6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 404 len: 111 microversion: 2.1 time: 0.060418 Jun 02 19:17:36.867820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 788/1578] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:36 2022] GET /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:17:37.025556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-934bc930-d3c0-41fa-92cb-858f8c7244db tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67" status: 204 len: 0 microversion: 2.1 time: 1.111858 Jun 02 19:17:37.026471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 791/1579] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:17:35 2022] DELETE /compute/v2.1/servers/9a0a9be2-f2c0-4fa4-919b-44afcbdbae67 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:17:37.509352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4551cfa1-772d-4239-8ae6-2b84fbd92d7d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: .version_select at 0x7f5b7e0d9280>, body: {"keypair": {"name": "tempest-keypair-1459166918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/wffqII53p+/549s6gSN7aYISyo2X40RAhJ+4frNPhqGx/7itMq/Rz/dq0SdYIllT/bRdrnKLYKs/7/+I7fG8DpoHhZNC9rH2SSsq37MvL2GFZqkYiJDdV/ULRMqcdMw=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:17:37.535194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-4551cfa1-772d-4239-8ae6-2b84fbd92d7d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for project 5a66e7666ca24a079738eea09c470cdd. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:17:37.540726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-4551cfa1-772d-4239-8ae6-2b84fbd92d7d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for user 4a660a47927140d6b4d0543de5e281a1 and project 5a66e7666ca24a079738eea09c470cdd. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:17:37.566598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4551cfa1-772d-4239-8ae6-2b84fbd92d7d tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061269 Jun 02 19:17:37.567323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 789/1580] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:17:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:17:37.591221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-668375ab-05cd-4c81-9217-58e86a8219d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:37.591931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-668375ab-05cd-4c81-9217-58e86a8219d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:37.599832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-668375ab-05cd-4c81-9217-58e86a8219d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:37.600280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-668375ab-05cd-4c81-9217-58e86a8219d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:37.601067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-668375ab-05cd-4c81-9217-58e86a8219d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:37.601752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-668375ab-05cd-4c81-9217-58e86a8219d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:37.741234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-668375ab-05cd-4c81-9217-58e86a8219d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:37.750142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-668375ab-05cd-4c81-9217-58e86a8219d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162861 Jun 02 19:17:37.750732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 792/1581] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:37 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:38.769541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-76491910-af57-44ae-9ed7-3d490f779dd2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:38.770206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-76491910-af57-44ae-9ed7-3d490f779dd2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:38.777223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76491910-af57-44ae-9ed7-3d490f779dd2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:38.778383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76491910-af57-44ae-9ed7-3d490f779dd2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:38.779188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76491910-af57-44ae-9ed7-3d490f779dd2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:38.779618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76491910-af57-44ae-9ed7-3d490f779dd2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:39.025829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76491910-af57-44ae-9ed7-3d490f779dd2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:39.036379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-76491910-af57-44ae-9ed7-3d490f779dd2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.271657 Jun 02 19:17:39.037392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 790/1582] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:38 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:17:39.304029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-499250206", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60bdcf03-2f93-4152-823f-c85a0a62a5ae"}], "security_groups": [{"name": "tempest-securitygroup--1209004816"}], "key_name": "tempest-keypair-1459166918", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:17:39.427636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] validate_networks() for [('60bdcf03-2f93-4152-823f-c85a0a62a5ae', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:17:39.859140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:17:39.859563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:17:39.860034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:17:39.860435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:17:39.860841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:17:39.870323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:39.870841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:39.871635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:39.872058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:39.888979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for project 5a66e7666ca24a079738eea09c470cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:17:39.893339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Getting quotas for user 4a660a47927140d6b4d0543de5e281a1 and project 5a66e7666ca24a079738eea09c470cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:17:39.905374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:17:39.907869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:17:39.968708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b4390d8-a919-4c04-9cde-469e39987a91 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.669066 Jun 02 19:17:39.969328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 793/1583] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:17:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:17:39.979811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ae1322e1-db38-458a-a4b7-98c8cd917815 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:39.981032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ae1322e1-db38-458a-a4b7-98c8cd917815 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:40.037684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ae1322e1-db38-458a-a4b7-98c8cd917815 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:40.045521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ae1322e1-db38-458a-a4b7-98c8cd917815 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1241 microversion: 2.1 time: 0.069673 Jun 02 19:17:40.046282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 791/1584] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:39 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:40.053664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-068a0bee-4484-417c-b7b5-b714adbd609b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:40.054526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-068a0bee-4484-417c-b7b5-b714adbd609b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:40.064033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-068a0bee-4484-417c-b7b5-b714adbd609b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:40.064481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-068a0bee-4484-417c-b7b5-b714adbd609b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:40.065255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-068a0bee-4484-417c-b7b5-b714adbd609b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:40.065654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-068a0bee-4484-417c-b7b5-b714adbd609b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:40.216196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-068a0bee-4484-417c-b7b5-b714adbd609b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:40.225638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-068a0bee-4484-417c-b7b5-b714adbd609b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175728 Jun 02 19:17:40.226446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 794/1585] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:40 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:41.065564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f6ce1fc0-1778-4972-aac4-d14c4d89fdfd tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:41.066737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f6ce1fc0-1778-4972-aac4-d14c4d89fdfd tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:41.079115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6ce1fc0-1778-4972-aac4-d14c4d89fdfd tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:41.079808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6ce1fc0-1778-4972-aac4-d14c4d89fdfd tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:41.081019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6ce1fc0-1778-4972-aac4-d14c4d89fdfd tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:41.081689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6ce1fc0-1778-4972-aac4-d14c4d89fdfd tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:41.155953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f6ce1fc0-1778-4972-aac4-d14c4d89fdfd tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:41.164296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f6ce1fc0-1778-4972-aac4-d14c4d89fdfd tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1299 microversion: 2.1 time: 0.105634 Jun 02 19:17:41.165925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 792/1586] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:41 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:41.243895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad5fb38e-b3b9-4522-adb5-6a033ebf4c57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:41.244494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad5fb38e-b3b9-4522-adb5-6a033ebf4c57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:41.251017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad5fb38e-b3b9-4522-adb5-6a033ebf4c57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:41.251736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad5fb38e-b3b9-4522-adb5-6a033ebf4c57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:41.252625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad5fb38e-b3b9-4522-adb5-6a033ebf4c57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:41.253116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad5fb38e-b3b9-4522-adb5-6a033ebf4c57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:41.393706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad5fb38e-b3b9-4522-adb5-6a033ebf4c57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:41.402015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad5fb38e-b3b9-4522-adb5-6a033ebf4c57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162441 Jun 02 19:17:41.402629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 795/1587] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:41 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:42.181547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-21bfacff-9ea2-462c-bd38-4b8de7803450 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:42.182162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-21bfacff-9ea2-462c-bd38-4b8de7803450 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:42.189631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21bfacff-9ea2-462c-bd38-4b8de7803450 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:42.190122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21bfacff-9ea2-462c-bd38-4b8de7803450 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:42.190888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21bfacff-9ea2-462c-bd38-4b8de7803450 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:42.191330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21bfacff-9ea2-462c-bd38-4b8de7803450 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:42.359966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-21bfacff-9ea2-462c-bd38-4b8de7803450 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:42.368030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-21bfacff-9ea2-462c-bd38-4b8de7803450 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1367 microversion: 2.1 time: 0.190063 Jun 02 19:17:42.378307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 793/1588] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:42 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:42.419121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6b345818-8ffc-4215-b946-c9ca371c447f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:42.419969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6b345818-8ffc-4215-b946-c9ca371c447f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:42.428031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b345818-8ffc-4215-b946-c9ca371c447f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:42.428589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b345818-8ffc-4215-b946-c9ca371c447f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:42.429470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b345818-8ffc-4215-b946-c9ca371c447f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:42.430157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b345818-8ffc-4215-b946-c9ca371c447f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:42.579191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-c060f9e2-faea-4383-ab4c-6fbf9ff9c1bb req-409b1df2-7715-428b-a372-1faa9588414a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086880e0-e0d9-43ab-ae0b-1af70fab62b2", "tag": "041757c0-ba75-4107-87a3-4d045aa06995"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:17:42.609900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-c060f9e2-faea-4383-ab4c-6fbf9ff9c1bb req-409b1df2-7715-428b-a372-1faa9588414a service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:42.610086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6b345818-8ffc-4215-b946-c9ca371c447f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:42.614351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-c060f9e2-faea-4383-ab4c-6fbf9ff9c1bb req-409b1df2-7715-428b-a372-1faa9588414a service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:42.620177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6b345818-8ffc-4215-b946-c9ca371c447f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.205281 Jun 02 19:17:42.622975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 796/1589] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:42 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:42.640442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-c060f9e2-faea-4383-ab4c-6fbf9ff9c1bb req-409b1df2-7715-428b-a372-1faa9588414a service nova] Creating event network-changed:041757c0-ba75-4107-87a3-4d045aa06995 for instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 on hv-cinder-79760 Jun 02 19:17:42.646173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-c060f9e2-faea-4383-ab4c-6fbf9ff9c1bb req-409b1df2-7715-428b-a372-1faa9588414a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071362 Jun 02 19:17:42.647612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 794/1590] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:17:43.386120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6703eddc-3840-4917-bb59-09d7947d3abc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:43.386924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6703eddc-3840-4917-bb59-09d7947d3abc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:43.393262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6703eddc-3840-4917-bb59-09d7947d3abc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:43.393714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6703eddc-3840-4917-bb59-09d7947d3abc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:43.394508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6703eddc-3840-4917-bb59-09d7947d3abc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:43.394942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6703eddc-3840-4917-bb59-09d7947d3abc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:43.545297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6703eddc-3840-4917-bb59-09d7947d3abc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:43.553021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6703eddc-3840-4917-bb59-09d7947d3abc tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1367 microversion: 2.1 time: 0.170890 Jun 02 19:17:43.553554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 797/1591] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:43 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:43.641467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-79c9c5ce-b69f-46d0-aed6-5fec1fef7e80 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:43.642179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-79c9c5ce-b69f-46d0-aed6-5fec1fef7e80 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:43.649468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79c9c5ce-b69f-46d0-aed6-5fec1fef7e80 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:43.649953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79c9c5ce-b69f-46d0-aed6-5fec1fef7e80 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:43.650713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79c9c5ce-b69f-46d0-aed6-5fec1fef7e80 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:43.651148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79c9c5ce-b69f-46d0-aed6-5fec1fef7e80 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:43.790605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-79c9c5ce-b69f-46d0-aed6-5fec1fef7e80 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:43.799000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-79c9c5ce-b69f-46d0-aed6-5fec1fef7e80 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162053 Jun 02 19:17:43.799564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 795/1592] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:43 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:44.571182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4f17e1e0-e52b-4941-bb76-f2878a36234c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:44.571738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4f17e1e0-e52b-4941-bb76-f2878a36234c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:44.579312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f17e1e0-e52b-4941-bb76-f2878a36234c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:44.579731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f17e1e0-e52b-4941-bb76-f2878a36234c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:44.580521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f17e1e0-e52b-4941-bb76-f2878a36234c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:44.580950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f17e1e0-e52b-4941-bb76-f2878a36234c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:44.716652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4f17e1e0-e52b-4941-bb76-f2878a36234c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:44.724790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4f17e1e0-e52b-4941-bb76-f2878a36234c tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1367 microversion: 2.1 time: 0.158100 Jun 02 19:17:44.725363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 798/1593] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:44 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:44.818419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-394d2f5e-040b-44e9-9841-dd78cc1e8610 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:44.819123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-394d2f5e-040b-44e9-9841-dd78cc1e8610 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:44.827737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-394d2f5e-040b-44e9-9841-dd78cc1e8610 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:44.828131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-394d2f5e-040b-44e9-9841-dd78cc1e8610 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:44.828900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-394d2f5e-040b-44e9-9841-dd78cc1e8610 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:44.829344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-394d2f5e-040b-44e9-9841-dd78cc1e8610 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:44.965469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-394d2f5e-040b-44e9-9841-dd78cc1e8610 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:44.973914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-394d2f5e-040b-44e9-9841-dd78cc1e8610 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160836 Jun 02 19:17:44.974510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 796/1594] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:44 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:45.500320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-48ef98c0-f848-4325-bcc2-18ba47ce515f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:45.501145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-48ef98c0-f848-4325-bcc2-18ba47ce515f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:45.510237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48ef98c0-f848-4325-bcc2-18ba47ce515f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:45.510674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48ef98c0-f848-4325-bcc2-18ba47ce515f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:45.511386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48ef98c0-f848-4325-bcc2-18ba47ce515f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:45.512012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48ef98c0-f848-4325-bcc2-18ba47ce515f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:45.539542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-48ef98c0-f848-4325-bcc2-18ba47ce515f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:17:45.628927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-48ef98c0-f848-4325-bcc2-18ba47ce515f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 204 len: 0 microversion: 2.20 time: 0.133125 Jun 02 19:17:45.629673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 799/1595] 10.222.0.15 () {60 vars in 1279 bytes} [Thu Jun 2 19:17:45 2022] DELETE /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 19:17:45.638190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:45.638732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:45.644946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:45.645605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:45.646415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:45.646860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:45.742590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd6aa5a2-830d-4894-80f8-079eb68d67c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:45.743293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fd6aa5a2-830d-4894-80f8-079eb68d67c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:45.749676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd6aa5a2-830d-4894-80f8-079eb68d67c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:45.750162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd6aa5a2-830d-4894-80f8-079eb68d67c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:45.750922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd6aa5a2-830d-4894-80f8-079eb68d67c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:45.751349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd6aa5a2-830d-4894-80f8-079eb68d67c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:45.799632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:45.808529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:45.810982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:45.812476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78168b3d-409c-42f2-93f8-349d88b00c1d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1801 microversion: 2.20 time: 0.178126 Jun 02 19:17:45.812839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 797/1596] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:17:45.888600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fd6aa5a2-830d-4894-80f8-079eb68d67c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:45.896412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd6aa5a2-830d-4894-80f8-079eb68d67c9 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1367 microversion: 2.1 time: 0.158187 Jun 02 19:17:45.896976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 800/1597] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:45 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:17:45.991720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-62cee784-7b76-4292-9f4a-eff60f41b853 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:45.992315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-62cee784-7b76-4292-9f4a-eff60f41b853 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:46.000412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62cee784-7b76-4292-9f4a-eff60f41b853 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:46.001084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62cee784-7b76-4292-9f4a-eff60f41b853 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:46.002037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62cee784-7b76-4292-9f4a-eff60f41b853 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:46.002506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62cee784-7b76-4292-9f4a-eff60f41b853 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:46.148431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-62cee784-7b76-4292-9f4a-eff60f41b853 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:46.157462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-62cee784-7b76-4292-9f4a-eff60f41b853 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169589 Jun 02 19:17:46.158064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 798/1598] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:45 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:46.840461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:46.840461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:46.842166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:46.842624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:46.843383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:46.843823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:46.916257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0f5806f6-f2d2-4a33-b105-9e5236b0b7cb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:46.918116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0f5806f6-f2d2-4a33-b105-9e5236b0b7cb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:46.928423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f5806f6-f2d2-4a33-b105-9e5236b0b7cb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:46.928973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f5806f6-f2d2-4a33-b105-9e5236b0b7cb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:46.929923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f5806f6-f2d2-4a33-b105-9e5236b0b7cb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:46.930446 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f5806f6-f2d2-4a33-b105-9e5236b0b7cb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:47.039277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:47.051520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:47.053030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:47.054238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-83508835-8e6a-48a9-ab26-b706a608f09e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1801 microversion: 2.20 time: 0.224462 Jun 02 19:17:47.065606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 801/1599] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1801 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:47.128205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0f5806f6-f2d2-4a33-b105-9e5236b0b7cb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:47.135874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0f5806f6-f2d2-4a33-b105-9e5236b0b7cb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1367 microversion: 2.1 time: 0.226168 Jun 02 19:17:47.136443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 799/1600] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:46 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:47.179230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3cb8c471-4d31-425b-8d2f-27b03bc45dba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:47.179845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3cb8c471-4d31-425b-8d2f-27b03bc45dba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:47.186456 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cb8c471-4d31-425b-8d2f-27b03bc45dba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:47.186901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cb8c471-4d31-425b-8d2f-27b03bc45dba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:47.187696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cb8c471-4d31-425b-8d2f-27b03bc45dba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:47.188121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cb8c471-4d31-425b-8d2f-27b03bc45dba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:47.280862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-ae93f48c-012b-4190-b98e-f80a2e7e1d0d req-c3d58fac-44af-443a-b2ba-c8c1b58c50a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2f3bad-3acd-4fe8-87bb-29f1424ea788", "name": "network-vif-deleted", "tag": "907b11e3-1dc7-4e4c-9786-5e63f5dd0812"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:17:47.316857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ae93f48c-012b-4190-b98e-f80a2e7e1d0d req-c3d58fac-44af-443a-b2ba-c8c1b58c50a2 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:47.325724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ae93f48c-012b-4190-b98e-f80a2e7e1d0d req-c3d58fac-44af-443a-b2ba-c8c1b58c50a2 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:47.346557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3cb8c471-4d31-425b-8d2f-27b03bc45dba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:47.360281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3cb8c471-4d31-425b-8d2f-27b03bc45dba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.184067 Jun 02 19:17:47.362850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 802/1601] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:47 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:47.379972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-ae93f48c-012b-4190-b98e-f80a2e7e1d0d req-c3d58fac-44af-443a-b2ba-c8c1b58c50a2 service nova] Creating event network-vif-deleted:907b11e3-1dc7-4e4c-9786-5e63f5dd0812 for instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 on hv-cinder-79760 Jun 02 19:17:47.398130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-ae93f48c-012b-4190-b98e-f80a2e7e1d0d req-c3d58fac-44af-443a-b2ba-c8c1b58c50a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121756 Jun 02 19:17:47.398988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 800/1602] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:17:48.073070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:48.073634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:48.081490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:48.082099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:48.082872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:48.083275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:48.153378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0bdd0f99-6d48-496d-a487-9b791666e843 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:48.154166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0bdd0f99-6d48-496d-a487-9b791666e843 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:48.154785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:48.161721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0bdd0f99-6d48-496d-a487-9b791666e843 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:48.162214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0bdd0f99-6d48-496d-a487-9b791666e843 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:48.163049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0bdd0f99-6d48-496d-a487-9b791666e843 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:48.163461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0bdd0f99-6d48-496d-a487-9b791666e843 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:48.163616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:48.165033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:48.166214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef9aaa55-79a1-4a45-b9cc-23a84d39f01a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097198 Jun 02 19:17:48.166737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 803/1603] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:48.168573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:48.302192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0bdd0f99-6d48-496d-a487-9b791666e843 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:48.310163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0bdd0f99-6d48-496d-a487-9b791666e843 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1367 microversion: 2.1 time: 0.161163 Jun 02 19:17:48.316193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 801/1604] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:48 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:48.379446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6b8357cf-065d-48b1-ad0f-176611f50e04 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:48.380057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6b8357cf-065d-48b1-ad0f-176611f50e04 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:48.387154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b8357cf-065d-48b1-ad0f-176611f50e04 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:48.387610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b8357cf-065d-48b1-ad0f-176611f50e04 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:48.388664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b8357cf-065d-48b1-ad0f-176611f50e04 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:48.389119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b8357cf-065d-48b1-ad0f-176611f50e04 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:48.404925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:48.543975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6b8357cf-065d-48b1-ad0f-176611f50e04 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:48.549999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6b8357cf-065d-48b1-ad0f-176611f50e04 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174409 Jun 02 19:17:48.550573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 804/1605] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:48 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:49.005592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-9428ca89-cf5d-48d8-ae2d-79d02598cae0 req-428c499b-1ff1-4469-85a2-eac9a6d66865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086880e0-e0d9-43ab-ae0b-1af70fab62b2", "name": "network-vif-plugged", "status": "completed", "tag": "041757c0-ba75-4107-87a3-4d045aa06995"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:17:49.013902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-9428ca89-cf5d-48d8-ae2d-79d02598cae0 req-428c499b-1ff1-4469-85a2-eac9a6d66865 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:49.014349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-9428ca89-cf5d-48d8-ae2d-79d02598cae0 req-428c499b-1ff1-4469-85a2-eac9a6d66865 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:49.028068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-9428ca89-cf5d-48d8-ae2d-79d02598cae0 req-428c499b-1ff1-4469-85a2-eac9a6d66865 service nova] Creating event network-vif-plugged:041757c0-ba75-4107-87a3-4d045aa06995 for instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 on hv-cinder-79760 Jun 02 19:17:49.033075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-9428ca89-cf5d-48d8-ae2d-79d02598cae0 req-428c499b-1ff1-4469-85a2-eac9a6d66865 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105125 Jun 02 19:17:49.033685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 802/1606] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:17:49.185056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:49.185651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:49.192480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:49.193348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:49.194126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:49.194561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:49.264277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:49.277508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:49.279544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:49.280710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-44fb8a13-e8dd-453d-bcb8-b8d323a1eda9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099924 Jun 02 19:17:49.281267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 805/1607] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:49.330776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-efa8e701-1e56-4873-89b8-7c5a3a1e8b56 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:49.331467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-efa8e701-1e56-4873-89b8-7c5a3a1e8b56 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:49.338614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efa8e701-1e56-4873-89b8-7c5a3a1e8b56 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:49.339064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efa8e701-1e56-4873-89b8-7c5a3a1e8b56 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:49.339832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efa8e701-1e56-4873-89b8-7c5a3a1e8b56 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:49.340310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efa8e701-1e56-4873-89b8-7c5a3a1e8b56 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:49.495660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-efa8e701-1e56-4873-89b8-7c5a3a1e8b56 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:49.508315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-efa8e701-1e56-4873-89b8-7c5a3a1e8b56 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1367 microversion: 2.1 time: 0.182328 Jun 02 19:17:49.509672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 803/1608] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:49 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:49.570222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bbaba1c3-889e-4b05-9a73-9a614b7e523d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:49.571131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bbaba1c3-889e-4b05-9a73-9a614b7e523d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:49.579423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbaba1c3-889e-4b05-9a73-9a614b7e523d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:49.579875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbaba1c3-889e-4b05-9a73-9a614b7e523d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:49.580623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbaba1c3-889e-4b05-9a73-9a614b7e523d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:49.581053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbaba1c3-889e-4b05-9a73-9a614b7e523d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:49.715792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bbaba1c3-889e-4b05-9a73-9a614b7e523d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:49.724348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bbaba1c3-889e-4b05-9a73-9a614b7e523d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160978 Jun 02 19:17:49.724916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 806/1609] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:49 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:50.299347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:50.300648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:50.302748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:50.308311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:50.308694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:50.309726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:50.310377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:50.379118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:50.388986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:50.390543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:50.391741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-76bb2296-ffd0-4e5f-978b-b0b94b2ba59b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096497 Jun 02 19:17:50.392307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 804/1610] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:50.530540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-98781b49-cb49-4b70-9469-1bab8059d6ec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:50.531149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-98781b49-cb49-4b70-9469-1bab8059d6ec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:50.533069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:50.533758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:50.540114 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98781b49-cb49-4b70-9469-1bab8059d6ec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:50.540583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98781b49-cb49-4b70-9469-1bab8059d6ec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:50.541342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98781b49-cb49-4b70-9469-1bab8059d6ec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:50.541768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98781b49-cb49-4b70-9469-1bab8059d6ec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:50.684585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-98781b49-cb49-4b70-9469-1bab8059d6ec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:50.692726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-98781b49-cb49-4b70-9469-1bab8059d6ec tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1557 microversion: 2.1 time: 0.167444 Jun 02 19:17:50.693747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 807/1611] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:50 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:50.715467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a4de7268-693f-4a11-8f7e-2f400f884f34 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:50.716023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a4de7268-693f-4a11-8f7e-2f400f884f34 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:50.722415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4de7268-693f-4a11-8f7e-2f400f884f34 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:50.722873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4de7268-693f-4a11-8f7e-2f400f884f34 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:50.723658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4de7268-693f-4a11-8f7e-2f400f884f34 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:50.724092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4de7268-693f-4a11-8f7e-2f400f884f34 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:50.741118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81ac2c69-b6c6-47f6-8866-59bcf0daddbd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:50.741883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81ac2c69-b6c6-47f6-8866-59bcf0daddbd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:50.748557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ac2c69-b6c6-47f6-8866-59bcf0daddbd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:50.749000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ac2c69-b6c6-47f6-8866-59bcf0daddbd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:50.749782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ac2c69-b6c6-47f6-8866-59bcf0daddbd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:50.750275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ac2c69-b6c6-47f6-8866-59bcf0daddbd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:50.837081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a4de7268-693f-4a11-8f7e-2f400f884f34 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125510 Jun 02 19:17:50.837652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 805/1612] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Jun 2 19:17:50 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:17:50.907378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81ac2c69-b6c6-47f6-8866-59bcf0daddbd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:50.915835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81ac2c69-b6c6-47f6-8866-59bcf0daddbd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.178545 Jun 02 19:17:50.916428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 808/1613] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:50 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:17:51.410629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:51.411440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:51.417912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:51.418387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:51.419174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:51.419620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:51.487463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:51.496854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:51.498495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:51.499684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-521ff4cf-c671-4baf-b020-c8a97c350b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093602 Jun 02 19:17:51.500246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 806/1614] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:51.934359 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16d2a9da-a8f5-4bb5-884d-8504e36249ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:51.934976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-16d2a9da-a8f5-4bb5-884d-8504e36249ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:51.942012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16d2a9da-a8f5-4bb5-884d-8504e36249ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:51.942386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16d2a9da-a8f5-4bb5-884d-8504e36249ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:51.943674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16d2a9da-a8f5-4bb5-884d-8504e36249ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:51.944096 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16d2a9da-a8f5-4bb5-884d-8504e36249ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:52.060656 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-5afe5b95-7b8a-42cc-8bb2-5bc99d01a259 req-15b43226-7c80-46aa-b822-5366551d3dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086880e0-e0d9-43ab-ae0b-1af70fab62b2", "tag": "041757c0-ba75-4107-87a3-4d045aa06995"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:17:52.069581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-5afe5b95-7b8a-42cc-8bb2-5bc99d01a259 req-15b43226-7c80-46aa-b822-5366551d3dee service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:52.070660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-5afe5b95-7b8a-42cc-8bb2-5bc99d01a259 req-15b43226-7c80-46aa-b822-5366551d3dee service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:52.082732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-5afe5b95-7b8a-42cc-8bb2-5bc99d01a259 req-15b43226-7c80-46aa-b822-5366551d3dee service nova] Creating event network-changed:041757c0-ba75-4107-87a3-4d045aa06995 for instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 on hv-cinder-79760 Jun 02 19:17:52.088840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-5afe5b95-7b8a-42cc-8bb2-5bc99d01a259 req-15b43226-7c80-46aa-b822-5366551d3dee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033043 Jun 02 19:17:52.089450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 807/1615] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:17:52.092304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-16d2a9da-a8f5-4bb5-884d-8504e36249ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:52.101355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16d2a9da-a8f5-4bb5-884d-8504e36249ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171317 Jun 02 19:17:52.101969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 809/1616] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:51 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:52.519037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:52.520674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:52.528797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:52.529690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:52.530651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:52.531312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:52.605682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:52.620703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:52.623443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:52.625550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a5758338-0a1e-4f5f-92f8-409c978b1a62 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110466 Jun 02 19:17:52.627991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 808/1617] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:53.118773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef788665-cc17-45cc-b78d-b8438a6b30a5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:53.119368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef788665-cc17-45cc-b78d-b8438a6b30a5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:53.126939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef788665-cc17-45cc-b78d-b8438a6b30a5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:53.127400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef788665-cc17-45cc-b78d-b8438a6b30a5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:53.128207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef788665-cc17-45cc-b78d-b8438a6b30a5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:53.128838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef788665-cc17-45cc-b78d-b8438a6b30a5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:53.275854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef788665-cc17-45cc-b78d-b8438a6b30a5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:53.289730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef788665-cc17-45cc-b78d-b8438a6b30a5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174659 Jun 02 19:17:53.290704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 810/1618] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:53 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:53.648767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:53.649666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:53.657952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:53.658408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:53.659176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:53.659616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:53.731512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:53.740385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:53.741909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:53.743053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9216616c-d0f8-4e6a-abcc-792a817b6ead tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101319 Jun 02 19:17:53.743606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 809/1619] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:54.310871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5605896c-1c84-4237-8847-1ac43139eb0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:54.311458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5605896c-1c84-4237-8847-1ac43139eb0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:54.318591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5605896c-1c84-4237-8847-1ac43139eb0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:54.319059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5605896c-1c84-4237-8847-1ac43139eb0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:54.319817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5605896c-1c84-4237-8847-1ac43139eb0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:54.320250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5605896c-1c84-4237-8847-1ac43139eb0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:54.453175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5605896c-1c84-4237-8847-1ac43139eb0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:54.461535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5605896c-1c84-4237-8847-1ac43139eb0f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.155788 Jun 02 19:17:54.462177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 811/1620] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:54 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:54.764912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:54.765490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:54.772661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:54.773116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:54.773910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:54.774351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:54.845211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:54.854355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:54.855858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:54.857004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e8ecaedf-40c2-44d6-aebf-7af66f7ae9b2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098767 Jun 02 19:17:54.858135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 810/1621] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:55.482906 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e3974edb-6aa7-4435-8a80-e06599fc2fac tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:55.483514 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e3974edb-6aa7-4435-8a80-e06599fc2fac tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:55.490358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3974edb-6aa7-4435-8a80-e06599fc2fac tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:55.490814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3974edb-6aa7-4435-8a80-e06599fc2fac tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:55.491585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3974edb-6aa7-4435-8a80-e06599fc2fac tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:55.492023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3974edb-6aa7-4435-8a80-e06599fc2fac tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:55.636759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e3974edb-6aa7-4435-8a80-e06599fc2fac tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:55.645639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e3974edb-6aa7-4435-8a80-e06599fc2fac tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169188 Jun 02 19:17:55.646233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 812/1622] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:55 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:55.876349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:55.876910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:55.883799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:55.884215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:55.885008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:55.885438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:55.958150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:55.970360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:55.971874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:55.973041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bd58039f-e041-439b-995c-d5a72f14dd3e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100936 Jun 02 19:17:55.973602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 811/1623] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:56.663293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-09e427a0-a1e5-45be-9fea-9c54627061d2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:56.663905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-09e427a0-a1e5-45be-9fea-9c54627061d2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:56.666286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:56.672089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09e427a0-a1e5-45be-9fea-9c54627061d2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:56.672540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09e427a0-a1e5-45be-9fea-9c54627061d2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:56.673303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09e427a0-a1e5-45be-9fea-9c54627061d2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:56.673737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09e427a0-a1e5-45be-9fea-9c54627061d2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:56.820035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-09e427a0-a1e5-45be-9fea-9c54627061d2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:56.830389 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-09e427a0-a1e5-45be-9fea-9c54627061d2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171076 Jun 02 19:17:56.830960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 813/1624] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:56 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:56.995298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:56.996164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:57.000905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:57.009685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:57.010477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:57.011752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:57.012481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:57.078308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:57.087202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:57.088696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:57.089839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-17850508-6207-41a4-b8de-95469b7d7200 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101298 Jun 02 19:17:57.090425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 812/1625] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:57.851766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1838299c-0b05-4ae4-a7bb-0dd4d6140af7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:57.852633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1838299c-0b05-4ae4-a7bb-0dd4d6140af7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:57.861515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1838299c-0b05-4ae4-a7bb-0dd4d6140af7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:57.862006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1838299c-0b05-4ae4-a7bb-0dd4d6140af7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:57.862771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1838299c-0b05-4ae4-a7bb-0dd4d6140af7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:57.863198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1838299c-0b05-4ae4-a7bb-0dd4d6140af7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:58.015800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1838299c-0b05-4ae4-a7bb-0dd4d6140af7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:58.028160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1838299c-0b05-4ae4-a7bb-0dd4d6140af7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.182842 Jun 02 19:17:58.028944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 814/1626] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:57 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:58.116305 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:58.117025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:58.126233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:58.126840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:58.128045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:58.129316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:58.210029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:58.222094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:58.223595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:58.224773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-19aaca81-56d6-493f-bd50-101ee3177810 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.113311 Jun 02 19:17:58.225286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 813/1627] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:17:59.046329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e5ce0e3d-178c-4a90-989f-0a916ec11fd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:59.046894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e5ce0e3d-178c-4a90-989f-0a916ec11fd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:59.054194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e5ce0e3d-178c-4a90-989f-0a916ec11fd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:59.054645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e5ce0e3d-178c-4a90-989f-0a916ec11fd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:59.055407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e5ce0e3d-178c-4a90-989f-0a916ec11fd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:59.055837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e5ce0e3d-178c-4a90-989f-0a916ec11fd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:59.193337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e5ce0e3d-178c-4a90-989f-0a916ec11fd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:59.201633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e5ce0e3d-178c-4a90-989f-0a916ec11fd9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.159251 Jun 02 19:17:59.202210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 815/1628] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:17:59 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:17:59.243594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:17:59.244170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:17:59.251540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:59.251917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:59.252676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:17:59.253110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:17:59.326340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:59.336215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:59.337717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:17:59.338918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e3d8204a-4114-4558-b943-ecb1278ce5c5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099380 Jun 02 19:17:59.339472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 814/1629] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:17:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:00.219628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad06473a-c01b-471f-b277-a279217e5c8e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:00.220288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad06473a-c01b-471f-b277-a279217e5c8e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:00.226806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad06473a-c01b-471f-b277-a279217e5c8e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:00.227258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad06473a-c01b-471f-b277-a279217e5c8e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:00.228035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad06473a-c01b-471f-b277-a279217e5c8e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:00.228463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad06473a-c01b-471f-b277-a279217e5c8e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:00.359203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:00.359813 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:00.367010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:00.367465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:00.368241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:00.368676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:00.377710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad06473a-c01b-471f-b277-a279217e5c8e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:00.387029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad06473a-c01b-471f-b277-a279217e5c8e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171495 Jun 02 19:18:00.387728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 816/1630] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:00 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:00.436150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:00.445499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:00.447062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:00.448246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-440528e7-9f18-4b8a-a2f2-f47432b8f901 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093026 Jun 02 19:18:00.448794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 815/1631] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:01.405018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9263a5ec-1351-439d-b2d5-b02132d5bcb7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:01.405680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9263a5ec-1351-439d-b2d5-b02132d5bcb7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:01.413222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9263a5ec-1351-439d-b2d5-b02132d5bcb7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:01.413687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9263a5ec-1351-439d-b2d5-b02132d5bcb7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:01.414528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9263a5ec-1351-439d-b2d5-b02132d5bcb7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:01.415072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9263a5ec-1351-439d-b2d5-b02132d5bcb7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:01.466625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:01.467375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:01.475570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:01.476029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:01.476820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:01.477273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:01.561832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:01.572071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:01.573573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:01.577176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7483f978-3ef6-49fe-8fac-0fab01db3bc9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.112135 Jun 02 19:18:01.577176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 816/1632] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:01.594733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9263a5ec-1351-439d-b2d5-b02132d5bcb7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:01.603286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9263a5ec-1351-439d-b2d5-b02132d5bcb7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.202198 Jun 02 19:18:01.603902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 817/1633] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:01 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:02.597215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:02.597827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:02.604918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:02.605379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:02.606192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:02.606634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:02.621052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8086599b-0ec0-4c9c-b09e-2a83f36950fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:02.622440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8086599b-0ec0-4c9c-b09e-2a83f36950fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:02.629590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8086599b-0ec0-4c9c-b09e-2a83f36950fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:02.630525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8086599b-0ec0-4c9c-b09e-2a83f36950fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:02.631307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8086599b-0ec0-4c9c-b09e-2a83f36950fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:02.631801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8086599b-0ec0-4c9c-b09e-2a83f36950fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:02.679968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:02.689109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:02.690617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:02.691791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f56e6e4f-7db0-4a2a-9356-9fd5612ed466 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100386 Jun 02 19:18:02.692550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 817/1634] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:02.763639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8086599b-0ec0-4c9c-b09e-2a83f36950fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:02.772421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8086599b-0ec0-4c9c-b09e-2a83f36950fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.155445 Jun 02 19:18:02.772995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 818/1635] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:02 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:03.714567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:03.715577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:03.726423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:03.727181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:03.728432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:03.729153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:03.789872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7cb14bf6-162c-418a-ad5e-7a53ccbf585f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:03.790430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7cb14bf6-162c-418a-ad5e-7a53ccbf585f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:03.797521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7cb14bf6-162c-418a-ad5e-7a53ccbf585f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:03.798073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7cb14bf6-162c-418a-ad5e-7a53ccbf585f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:03.798408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:03.799245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7cb14bf6-162c-418a-ad5e-7a53ccbf585f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:03.799407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7cb14bf6-162c-418a-ad5e-7a53ccbf585f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:03.807465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:03.808969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:03.810111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fbd02049-e679-494b-a4ef-3a41c8f91452 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102106 Jun 02 19:18:03.810653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 818/1636] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:03.938925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7cb14bf6-162c-418a-ad5e-7a53ccbf585f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:03.947995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7cb14bf6-162c-418a-ad5e-7a53ccbf585f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162234 Jun 02 19:18:03.948566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 819/1637] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:03 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:04.831244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:04.832155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:04.842424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:04.843183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:04.844384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:04.845048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:04.864368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:04.910878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:04.924106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:04.925971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:04.927244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d13a27c-9d95-48de-9c85-1dd032004b31 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102222 Jun 02 19:18:04.927799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 819/1638] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:04.964448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4bd0715a-832f-4989-b713-29621810ff5b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:04.965067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4bd0715a-832f-4989-b713-29621810ff5b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:04.972271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4bd0715a-832f-4989-b713-29621810ff5b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:04.972731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4bd0715a-832f-4989-b713-29621810ff5b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:04.973519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4bd0715a-832f-4989-b713-29621810ff5b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:04.973945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4bd0715a-832f-4989-b713-29621810ff5b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:05.123564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4bd0715a-832f-4989-b713-29621810ff5b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:05.136621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4bd0715a-832f-4989-b713-29621810ff5b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175836 Jun 02 19:18:05.137467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 820/1639] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:04 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:05.450638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:18:05.450920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:18:05.956566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:05.957485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:05.964942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:05.965437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:05.966312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:05.966792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:06.032006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:06.041375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:06.042897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:06.044050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a19c26ee-ee4f-49e9-b503-481a5993a550 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093991 Jun 02 19:18:06.044615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 820/1640] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:06.155656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-240cc4bd-59d4-4807-816c-5870e494db5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:06.156296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-240cc4bd-59d4-4807-816c-5870e494db5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:06.164262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-240cc4bd-59d4-4807-816c-5870e494db5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:06.164709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-240cc4bd-59d4-4807-816c-5870e494db5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:06.165471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-240cc4bd-59d4-4807-816c-5870e494db5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:06.165937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-240cc4bd-59d4-4807-816c-5870e494db5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:06.168477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:06.320228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-240cc4bd-59d4-4807-816c-5870e494db5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:06.328424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-240cc4bd-59d4-4807-816c-5870e494db5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.176748 Jun 02 19:18:06.329003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 821/1641] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:06 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:07.065827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:07.066405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:07.073675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:07.074160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:07.074917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:07.075379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:07.145944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:07.154876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:07.156352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:07.157488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-51d28086-5e64-49a5-93f7-b3c204f42d00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097925 Jun 02 19:18:07.158069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 821/1642] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:07.348943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-55ee75e8-deee-40f9-b75b-5bb015e44f48 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:07.349857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-55ee75e8-deee-40f9-b75b-5bb015e44f48 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:07.359656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-55ee75e8-deee-40f9-b75b-5bb015e44f48 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:07.360355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-55ee75e8-deee-40f9-b75b-5bb015e44f48 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:07.361434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-55ee75e8-deee-40f9-b75b-5bb015e44f48 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:07.362228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-55ee75e8-deee-40f9-b75b-5bb015e44f48 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:07.513251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-55ee75e8-deee-40f9-b75b-5bb015e44f48 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:07.522287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-55ee75e8-deee-40f9-b75b-5bb015e44f48 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179269 Jun 02 19:18:07.523074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 822/1643] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:07 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:08.189095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:08.190256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:08.202216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:08.202972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:08.204263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:08.205099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:08.268982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:08.278152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:08.279660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:08.280809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d4046c26-8dc3-4de6-a7e0-b6e134ce1383 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098704 Jun 02 19:18:08.281368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 822/1644] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:08.539799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e8f5847a-e90c-4c50-aff9-bbd11d694262 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:08.540405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e8f5847a-e90c-4c50-aff9-bbd11d694262 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:08.547535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8f5847a-e90c-4c50-aff9-bbd11d694262 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:08.548002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8f5847a-e90c-4c50-aff9-bbd11d694262 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:08.548750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8f5847a-e90c-4c50-aff9-bbd11d694262 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:08.549519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8f5847a-e90c-4c50-aff9-bbd11d694262 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:08.719508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e8f5847a-e90c-4c50-aff9-bbd11d694262 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:08.727984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e8f5847a-e90c-4c50-aff9-bbd11d694262 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.192112 Jun 02 19:18:08.728542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 823/1645] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:08 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:09.302600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:09.303393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:09.313100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:09.313715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:09.314856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:09.315431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:09.380670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:09.395815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:09.397320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:09.398525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-347cd482-b6e3-40ed-8fe7-2511e123afcc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102411 Jun 02 19:18:09.399054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 823/1646] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:09.749020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6bec55f8-445f-4a3e-a953-8a2d9d887ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:09.749988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6bec55f8-445f-4a3e-a953-8a2d9d887ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:09.758379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bec55f8-445f-4a3e-a953-8a2d9d887ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:09.758826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bec55f8-445f-4a3e-a953-8a2d9d887ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:09.759580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bec55f8-445f-4a3e-a953-8a2d9d887ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:09.760006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6bec55f8-445f-4a3e-a953-8a2d9d887ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:09.910484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6bec55f8-445f-4a3e-a953-8a2d9d887ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:09.923486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6bec55f8-445f-4a3e-a953-8a2d9d887ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.180521 Jun 02 19:18:09.924313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 824/1647] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:09 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:09.942336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:18:09.942494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:18:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:18:10.417496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:10.418125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:10.425514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:10.426064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:10.426842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:10.427289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:10.506285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:10.515217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:10.516729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:10.517905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-45d2d500-1281-4296-b2b4-b925d649d7e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104456 Jun 02 19:18:10.518468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 824/1648] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:10.952579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-57f7ee6f-3e19-45ac-8212-7b453155be09 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:10.953187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-57f7ee6f-3e19-45ac-8212-7b453155be09 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:10.961448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57f7ee6f-3e19-45ac-8212-7b453155be09 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:10.961930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57f7ee6f-3e19-45ac-8212-7b453155be09 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:10.962694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57f7ee6f-3e19-45ac-8212-7b453155be09 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:10.963119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57f7ee6f-3e19-45ac-8212-7b453155be09 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:11.098476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-57f7ee6f-3e19-45ac-8212-7b453155be09 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:11.111569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-57f7ee6f-3e19-45ac-8212-7b453155be09 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162560 Jun 02 19:18:11.112343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 825/1649] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:10 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:11.540183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:11.540792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:11.547789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:11.548239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:11.549002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:11.549439 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:11.611987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:11.621002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:11.622522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:11.623650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5f9f0058-5786-4003-8dc4-1875890b8059 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.087488 Jun 02 19:18:11.624200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 825/1650] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:12.131265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e19ad6d5-3180-48db-8d02-dc5920625698 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:12.131899 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e19ad6d5-3180-48db-8d02-dc5920625698 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:12.138959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e19ad6d5-3180-48db-8d02-dc5920625698 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:12.139404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e19ad6d5-3180-48db-8d02-dc5920625698 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:12.140156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e19ad6d5-3180-48db-8d02-dc5920625698 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:12.140588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e19ad6d5-3180-48db-8d02-dc5920625698 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:12.294031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e19ad6d5-3180-48db-8d02-dc5920625698 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:12.305855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e19ad6d5-3180-48db-8d02-dc5920625698 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179163 Jun 02 19:18:12.306715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 826/1651] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:12 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:12.642279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:12.642991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:12.650632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:12.651125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:12.651934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:12.652374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:12.715381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:12.724418 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:12.725961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:12.727100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9e7e3fdf-852b-4da2-ba8f-bbe15dafa62d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088994 Jun 02 19:18:12.727651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 826/1652] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:13.331155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a65ae34d-04dd-45e3-ab14-43e694af742b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:13.331914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a65ae34d-04dd-45e3-ab14-43e694af742b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:13.342810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a65ae34d-04dd-45e3-ab14-43e694af742b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:13.343508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a65ae34d-04dd-45e3-ab14-43e694af742b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:13.344741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a65ae34d-04dd-45e3-ab14-43e694af742b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:13.345436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a65ae34d-04dd-45e3-ab14-43e694af742b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:13.507750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a65ae34d-04dd-45e3-ab14-43e694af742b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:13.516029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a65ae34d-04dd-45e3-ab14-43e694af742b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.191351 Jun 02 19:18:13.516595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 827/1653] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:13 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:13.748666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:13.749484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:13.760981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:13.761710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:13.763000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:13.763780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:13.837701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:13.849910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:13.851476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:13.852635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-81b1bcec-f995-41c2-bc2f-abff45cf3ef1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110683 Jun 02 19:18:13.853189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 827/1654] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:14.533121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cf73d9c6-2451-4c9d-96a6-ede796cf14ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:14.533711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cf73d9c6-2451-4c9d-96a6-ede796cf14ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:14.541384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf73d9c6-2451-4c9d-96a6-ede796cf14ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:14.541856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf73d9c6-2451-4c9d-96a6-ede796cf14ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:14.542656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf73d9c6-2451-4c9d-96a6-ede796cf14ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:14.543089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf73d9c6-2451-4c9d-96a6-ede796cf14ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:14.694833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cf73d9c6-2451-4c9d-96a6-ede796cf14ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:14.703980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cf73d9c6-2451-4c9d-96a6-ede796cf14ab tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174839 Jun 02 19:18:14.704546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 828/1655] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:14 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:14.874110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:14.875515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:14.884428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:14.884876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:14.885642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:14.886114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:14.954684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:14.964006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:14.965501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:14.966677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4033d0d7-484e-4fb7-a0e4-0cb6917a795a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099174 Jun 02 19:18:14.967221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 828/1656] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:15.721560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5c14306b-7c92-4179-84f2-20e0775d9ed5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:15.722290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5c14306b-7c92-4179-84f2-20e0775d9ed5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:15.729650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5c14306b-7c92-4179-84f2-20e0775d9ed5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:15.730122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5c14306b-7c92-4179-84f2-20e0775d9ed5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:15.730879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5c14306b-7c92-4179-84f2-20e0775d9ed5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:15.731308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5c14306b-7c92-4179-84f2-20e0775d9ed5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:15.867662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5c14306b-7c92-4179-84f2-20e0775d9ed5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:15.876069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5c14306b-7c92-4179-84f2-20e0775d9ed5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.158406 Jun 02 19:18:15.876629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 829/1657] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:15 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:15.986720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:15.987512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:15.995575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:15.996029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:15.996793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:15.997224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:16.063995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:16.073961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:16.075484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:16.076651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8ebd9e7a-e233-44a7-b40b-2d91e8f8992a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095194 Jun 02 19:18:16.077232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 829/1658] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:16.901832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-de00b72e-486c-4334-9950-2c9322c3da2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:16.902769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-de00b72e-486c-4334-9950-2c9322c3da2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:16.909501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de00b72e-486c-4334-9950-2c9322c3da2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:16.909994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de00b72e-486c-4334-9950-2c9322c3da2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:16.910757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de00b72e-486c-4334-9950-2c9322c3da2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:16.911192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de00b72e-486c-4334-9950-2c9322c3da2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:17.045402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-de00b72e-486c-4334-9950-2c9322c3da2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:17.057094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-de00b72e-486c-4334-9950-2c9322c3da2a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161792 Jun 02 19:18:17.057691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 830/1659] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:16 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:17.095729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:17.096476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:17.103044 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:17.103565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:17.104331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:17.104745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:17.178977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:17.188746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:17.190270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:17.191689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-69610ea5-f7fc-43a4-9b7b-19a927b208be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099757 Jun 02 19:18:17.192240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 830/1660] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:18:18.085020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1a21080a-1b2c-4c37-8fd7-0e0927695670 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:18.085982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1a21080a-1b2c-4c37-8fd7-0e0927695670 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:18.096883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a21080a-1b2c-4c37-8fd7-0e0927695670 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:18.097640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a21080a-1b2c-4c37-8fd7-0e0927695670 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:18.098970 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a21080a-1b2c-4c37-8fd7-0e0927695670 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:18.099716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a21080a-1b2c-4c37-8fd7-0e0927695670 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:18.211486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:18.212080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:18.219441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:18.219895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:18.220666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:18.221097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:18.243844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1a21080a-1b2c-4c37-8fd7-0e0927695670 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:18.251996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1a21080a-1b2c-4c37-8fd7-0e0927695670 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173439 Jun 02 19:18:18.252599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 831/1661] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:18 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:18.286582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:18.299448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:18.301377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:18.302571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4379f1f2-9530-4dc7-a453-e5a77daa7c54 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095115 Jun 02 19:18:18.303128 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 831/1662] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:19.269849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-24bbebfd-6e2a-46fc-a668-4e05c9ca43af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:19.270553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-24bbebfd-6e2a-46fc-a668-4e05c9ca43af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:19.277757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24bbebfd-6e2a-46fc-a668-4e05c9ca43af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:19.278250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24bbebfd-6e2a-46fc-a668-4e05c9ca43af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:19.279032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24bbebfd-6e2a-46fc-a668-4e05c9ca43af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:19.279476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24bbebfd-6e2a-46fc-a668-4e05c9ca43af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:19.322053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:19.322753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:19.330915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:19.331377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:19.332366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:19.332812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:19.412559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:19.422495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:19.424314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:19.425628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e4f25135-28cb-4cd4-bb9d-1a1113725e10 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.108806 Jun 02 19:18:19.426490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 832/1663] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:19.447861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-24bbebfd-6e2a-46fc-a668-4e05c9ca43af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:19.459499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-24bbebfd-6e2a-46fc-a668-4e05c9ca43af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.193737 Jun 02 19:18:19.460125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 832/1664] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:19 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:20.449290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:20.449957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:20.458039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:20.458707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:20.459880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:20.460615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:20.477652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a323ea0a-5592-4dff-9129-7b388f1ab718 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:20.478462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a323ea0a-5592-4dff-9129-7b388f1ab718 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:20.485278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a323ea0a-5592-4dff-9129-7b388f1ab718 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:20.485740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a323ea0a-5592-4dff-9129-7b388f1ab718 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:20.486534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a323ea0a-5592-4dff-9129-7b388f1ab718 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:20.486967 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a323ea0a-5592-4dff-9129-7b388f1ab718 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:20.538990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:20.548288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:20.549783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:20.550951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fccaf7b6-8afd-44f2-83c2-a2449700790a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.109347 Jun 02 19:18:20.551508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 833/1665] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:20.625290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a323ea0a-5592-4dff-9129-7b388f1ab718 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:20.633765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a323ea0a-5592-4dff-9129-7b388f1ab718 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160551 Jun 02 19:18:20.634366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 833/1666] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:20 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:21.569709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:21.570399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:21.577818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:21.578369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:21.579145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:21.579581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:21.651140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-024f0722-36c5-45b6-8b50-6002c9d3f3b7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:21.651866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-024f0722-36c5-45b6-8b50-6002c9d3f3b7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:21.659857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-024f0722-36c5-45b6-8b50-6002c9d3f3b7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:21.660280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-024f0722-36c5-45b6-8b50-6002c9d3f3b7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:21.661307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-024f0722-36c5-45b6-8b50-6002c9d3f3b7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:21.661743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-024f0722-36c5-45b6-8b50-6002c9d3f3b7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:21.868926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:21.878322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:21.879811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:21.880952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-81f105ec-d0f5-4913-ba55-2aef2150a0aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.315673 Jun 02 19:18:21.881511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 834/1667] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:21.965921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-024f0722-36c5-45b6-8b50-6002c9d3f3b7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:21.974815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-024f0722-36c5-45b6-8b50-6002c9d3f3b7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.327666 Jun 02 19:18:21.975423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 834/1668] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:21 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:22.899826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:22.900638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:22.908759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:22.909246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:22.910197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:22.910665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:22.979937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:22.989370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:22.990912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:22.992068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7f517073-cb51-40ef-af55-2f0afb3acd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096627 Jun 02 19:18:22.992624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 835/1669] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:22.992870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c7be9bb8-7b62-4b2c-850e-4da1d0421449 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:22.993630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c7be9bb8-7b62-4b2c-850e-4da1d0421449 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:23.000830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c7be9bb8-7b62-4b2c-850e-4da1d0421449 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:23.001303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c7be9bb8-7b62-4b2c-850e-4da1d0421449 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:23.002105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c7be9bb8-7b62-4b2c-850e-4da1d0421449 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:23.002552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c7be9bb8-7b62-4b2c-850e-4da1d0421449 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:23.140543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c7be9bb8-7b62-4b2c-850e-4da1d0421449 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:23.148842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c7be9bb8-7b62-4b2c-850e-4da1d0421449 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160180 Jun 02 19:18:23.149406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 835/1670] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:22 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:23.406646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-362fc7c6-cd5d-4856-9a4e-88bae43700b6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:23.407149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-362fc7c6-cd5d-4856-9a4e-88bae43700b6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:23.414735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-362fc7c6-cd5d-4856-9a4e-88bae43700b6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:23.415195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-362fc7c6-cd5d-4856-9a4e-88bae43700b6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:23.415957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-362fc7c6-cd5d-4856-9a4e-88bae43700b6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:23.416396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-362fc7c6-cd5d-4856-9a4e-88bae43700b6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:23.420081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:23.443607 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-362fc7c6-cd5d-4856-9a4e-88bae43700b6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2/ips" status: 200 len: 149 microversion: 2.1 time: 0.040876 Jun 02 19:18:23.444208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 836/1671] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:18:23 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:18:24.016235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:24.017249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:24.029046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:24.030255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:24.030819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:24.031271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:24.096960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:24.105892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:24.107324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:24.108462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-79da795d-ce42-4d7b-ab1f-518c3252afa4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099297 Jun 02 19:18:24.109011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 836/1672] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:24.170444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5cca0149-85af-4066-91a6-564588b63a99 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:24.171597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5cca0149-85af-4066-91a6-564588b63a99 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:24.179093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5cca0149-85af-4066-91a6-564588b63a99 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:24.179547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5cca0149-85af-4066-91a6-564588b63a99 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:24.180309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5cca0149-85af-4066-91a6-564588b63a99 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:24.180742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5cca0149-85af-4066-91a6-564588b63a99 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:24.327747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5cca0149-85af-4066-91a6-564588b63a99 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:24.335934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5cca0149-85af-4066-91a6-564588b63a99 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172791 Jun 02 19:18:24.336532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 837/1673] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:24 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:25.128904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:25.129666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:25.138287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:25.138887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:25.139888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:25.140486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:25.212570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:25.217036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:25.226325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:25.227810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:25.228955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81ce9d1d-8d22-4232-a9ef-1d2fb305712d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.106017 Jun 02 19:18:25.229499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 837/1674] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:25.356567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57d8a745-c4e4-4e55-adb4-e3107580eb3d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:25.357387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-57d8a745-c4e4-4e55-adb4-e3107580eb3d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:25.367250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57d8a745-c4e4-4e55-adb4-e3107580eb3d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:25.367907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57d8a745-c4e4-4e55-adb4-e3107580eb3d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:25.369018 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57d8a745-c4e4-4e55-adb4-e3107580eb3d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:25.369651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57d8a745-c4e4-4e55-adb4-e3107580eb3d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:25.518492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57d8a745-c4e4-4e55-adb4-e3107580eb3d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:25.528402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-57d8a745-c4e4-4e55-adb4-e3107580eb3d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.177248 Jun 02 19:18:25.528985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 838/1675] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:25 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:26.247780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:26.248451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:26.255758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:26.256208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:26.256980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:26.257416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:26.324976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:26.333739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:26.335269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:26.336428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8dfd4b26-c57d-45e1-8a17-6425687d38f8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092972 Jun 02 19:18:26.336985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 838/1676] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:26.545299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5543f137-cd54-4f0f-9636-405fefcc939a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:26.545943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5543f137-cd54-4f0f-9636-405fefcc939a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:26.553236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5543f137-cd54-4f0f-9636-405fefcc939a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:26.553687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5543f137-cd54-4f0f-9636-405fefcc939a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:26.554511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5543f137-cd54-4f0f-9636-405fefcc939a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:26.554943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5543f137-cd54-4f0f-9636-405fefcc939a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:26.700382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5543f137-cd54-4f0f-9636-405fefcc939a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:26.708767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5543f137-cd54-4f0f-9636-405fefcc939a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167437 Jun 02 19:18:26.709313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 839/1677] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:26 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:27.357397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:27.358294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:27.361971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:27.367889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:27.368361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:27.369107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:27.369541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:27.435877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:27.444919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:27.446406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:27.447562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b1291329-7a5f-43b9-8ec5-2f0e65adca00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096652 Jun 02 19:18:27.448108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 839/1678] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:27.730009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-051f3267-268d-4cd9-b809-c012f6de678b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:27.730979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-051f3267-268d-4cd9-b809-c012f6de678b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:27.734671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=56 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:27.743507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-051f3267-268d-4cd9-b809-c012f6de678b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:27.744251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-051f3267-268d-4cd9-b809-c012f6de678b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:27.745519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-051f3267-268d-4cd9-b809-c012f6de678b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:27.746292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-051f3267-268d-4cd9-b809-c012f6de678b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:27.895253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-051f3267-268d-4cd9-b809-c012f6de678b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:27.903890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-051f3267-268d-4cd9-b809-c012f6de678b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.180423 Jun 02 19:18:27.904461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 840/1679] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:27 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:28.466687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:28.467306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:28.475920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:28.476525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:28.477678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:28.478208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:28.551712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:28.560918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:28.562472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:28.563623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7d89de56-2fb8-4f17-8f3e-841c2891dd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100935 Jun 02 19:18:28.564181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 840/1680] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:28.925597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9d88def4-3bdd-457d-8139-82c85781ff5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:28.926913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9d88def4-3bdd-457d-8139-82c85781ff5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:28.938400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d88def4-3bdd-457d-8139-82c85781ff5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:28.939159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d88def4-3bdd-457d-8139-82c85781ff5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:28.940430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d88def4-3bdd-457d-8139-82c85781ff5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:28.941664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d88def4-3bdd-457d-8139-82c85781ff5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:29.099084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9d88def4-3bdd-457d-8139-82c85781ff5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:29.107605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9d88def4-3bdd-457d-8139-82c85781ff5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.188850 Jun 02 19:18:29.108144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 841/1681] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:28 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:29.590725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:29.591845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:29.602475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:29.603226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:29.604475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:29.605197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:29.675530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:29.685346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:29.686896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:29.688049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-63edeecf-355f-497c-8a4d-4ca2e47483a0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103975 Jun 02 19:18:29.688599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 841/1682] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:30.131615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2072ea75-2282-4572-bc28-27fff97aca41 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:30.132549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2072ea75-2282-4572-bc28-27fff97aca41 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:30.143516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2072ea75-2282-4572-bc28-27fff97aca41 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:30.144205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2072ea75-2282-4572-bc28-27fff97aca41 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:30.145376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2072ea75-2282-4572-bc28-27fff97aca41 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:30.146083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2072ea75-2282-4572-bc28-27fff97aca41 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:30.287107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2072ea75-2282-4572-bc28-27fff97aca41 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:30.298874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2072ea75-2282-4572-bc28-27fff97aca41 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.176751 Jun 02 19:18:30.299687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 842/1683] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:30 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:30.707347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:30.707898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:30.714973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:30.715415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:30.716163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:30.716590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:30.783384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:30.792837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:30.794283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:30.795429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c06764d2-2344-4271-9e44-790ef339993e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092068 Jun 02 19:18:30.795990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 842/1684] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:31.318291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b0341b64-2fdb-4554-94ef-44f374840f18 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:31.319017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b0341b64-2fdb-4554-94ef-44f374840f18 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:31.327752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0341b64-2fdb-4554-94ef-44f374840f18 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:31.328314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0341b64-2fdb-4554-94ef-44f374840f18 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:31.329232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0341b64-2fdb-4554-94ef-44f374840f18 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:31.329919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0341b64-2fdb-4554-94ef-44f374840f18 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:31.463240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0341b64-2fdb-4554-94ef-44f374840f18 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:31.471569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b0341b64-2fdb-4554-94ef-44f374840f18 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.158464 Jun 02 19:18:31.472127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 843/1685] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:31 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:31.816329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:31.817313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:31.826933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:31.827525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:31.828528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:31.829283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:31.899564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:31.908265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:31.909711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:31.910890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-73223ceb-e559-44cd-868f-1365cb3a43eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099901 Jun 02 19:18:31.911435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 843/1686] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:32.491561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8ae9c7c1-e208-4e69-b94f-e088d6bea712 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:32.492494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8ae9c7c1-e208-4e69-b94f-e088d6bea712 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:32.503027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ae9c7c1-e208-4e69-b94f-e088d6bea712 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:32.503727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ae9c7c1-e208-4e69-b94f-e088d6bea712 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:32.504903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ae9c7c1-e208-4e69-b94f-e088d6bea712 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:32.505564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ae9c7c1-e208-4e69-b94f-e088d6bea712 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:32.638536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ae9c7c1-e208-4e69-b94f-e088d6bea712 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:32.646960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8ae9c7c1-e208-4e69-b94f-e088d6bea712 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161391 Jun 02 19:18:32.647526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 844/1687] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:32 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:32.932920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:32.934467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:32.945784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:32.946570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:32.947842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:32.948826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:33.014811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:33.028363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:33.030631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:33.032154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-52a4aa7f-4291-42e5-ba4d-16fa20552ae8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105580 Jun 02 19:18:33.032801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 844/1688] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:33.665059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-792f84d2-1a19-4087-8678-5b2bade6cbec tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:33.665630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-792f84d2-1a19-4087-8678-5b2bade6cbec tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:33.673246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-792f84d2-1a19-4087-8678-5b2bade6cbec tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:33.673704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-792f84d2-1a19-4087-8678-5b2bade6cbec tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:33.674525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-792f84d2-1a19-4087-8678-5b2bade6cbec tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:33.674960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-792f84d2-1a19-4087-8678-5b2bade6cbec tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:33.810453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-792f84d2-1a19-4087-8678-5b2bade6cbec tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:33.819054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-792f84d2-1a19-4087-8678-5b2bade6cbec tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.158008 Jun 02 19:18:33.819631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 845/1689] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:33 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:34.054053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:34.055039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:34.063583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:34.063967 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:34.064741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:34.065178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:34.128654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:34.137903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:34.139434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:34.140606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ccb95dda-d6e1-49fb-a7c5-3e1ef092326b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092762 Jun 02 19:18:34.141162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 845/1690] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:34.967713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4b10c8a-3d5d-4ebd-9aee-9fe9ff64915f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:34.968329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c4b10c8a-3d5d-4ebd-9aee-9fe9ff64915f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:34.975051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4b10c8a-3d5d-4ebd-9aee-9fe9ff64915f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:34.975504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4b10c8a-3d5d-4ebd-9aee-9fe9ff64915f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:34.976402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4b10c8a-3d5d-4ebd-9aee-9fe9ff64915f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:34.976838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4b10c8a-3d5d-4ebd-9aee-9fe9ff64915f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:35.158574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:35.159227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:35.165998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:35.166451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:35.167218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:35.167896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:35.175929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c4b10c8a-3d5d-4ebd-9aee-9fe9ff64915f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:35.186338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c4b10c8a-3d5d-4ebd-9aee-9fe9ff64915f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.352165 Jun 02 19:18:35.188322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 846/1691] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:34 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:35.299262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:35.308699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:35.310246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:35.311362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-39d789dd-7660-409c-9792-9ba155470000 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.157053 Jun 02 19:18:35.311960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 846/1692] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:36.206686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a541c5b9-3eeb-46c6-ab4f-32aa823ba191 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:36.207496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a541c5b9-3eeb-46c6-ab4f-32aa823ba191 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:36.215859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a541c5b9-3eeb-46c6-ab4f-32aa823ba191 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:36.216433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a541c5b9-3eeb-46c6-ab4f-32aa823ba191 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:36.217389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a541c5b9-3eeb-46c6-ab4f-32aa823ba191 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:36.217844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a541c5b9-3eeb-46c6-ab4f-32aa823ba191 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:36.331507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:36.332177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:36.341871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:36.342327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:36.343101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:36.343534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:36.363074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a541c5b9-3eeb-46c6-ab4f-32aa823ba191 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:36.372036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a541c5b9-3eeb-46c6-ab4f-32aa823ba191 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169722 Jun 02 19:18:36.372619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 847/1693] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:36 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:36.406040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:36.416682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:36.419347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:36.420835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-578d1453-2422-432a-9921-607899a278d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094744 Jun 02 19:18:36.421609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 847/1694] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:37.391457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-94b31088-f91b-4f11-a0f8-a9b099089a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:37.392143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-94b31088-f91b-4f11-a0f8-a9b099089a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:37.399246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-94b31088-f91b-4f11-a0f8-a9b099089a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:37.399739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-94b31088-f91b-4f11-a0f8-a9b099089a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:37.400487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-94b31088-f91b-4f11-a0f8-a9b099089a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:37.400911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-94b31088-f91b-4f11-a0f8-a9b099089a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:37.443915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:37.444514 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:37.452604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:37.453180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:37.454360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:37.454795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:37.532777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:37.541677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:37.543597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:37.544758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dc27653e-eafa-46f6-8637-bd00f4392eb9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105143 Jun 02 19:18:37.545335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 848/1695] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:37.563217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-94b31088-f91b-4f11-a0f8-a9b099089a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:37.571633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-94b31088-f91b-4f11-a0f8-a9b099089a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.184225 Jun 02 19:18:37.572174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 848/1696] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:37 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:38.564082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:38.564699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:38.571567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:38.572022 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:38.572788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:38.573224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:38.588535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b0c70647-201a-4532-bf56-8a442c04ec64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:38.589143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b0c70647-201a-4532-bf56-8a442c04ec64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:38.596843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0c70647-201a-4532-bf56-8a442c04ec64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:38.597298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0c70647-201a-4532-bf56-8a442c04ec64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:38.598096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0c70647-201a-4532-bf56-8a442c04ec64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:38.598533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0c70647-201a-4532-bf56-8a442c04ec64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:38.642051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:38.650940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:38.652510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:38.654166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ee0ab81-d423-4dde-95cb-970db49ebf01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095094 Jun 02 19:18:38.654739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 849/1697] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:38.747863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0c70647-201a-4532-bf56-8a442c04ec64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:38.756044 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b0c70647-201a-4532-bf56-8a442c04ec64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171365 Jun 02 19:18:38.756612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 849/1698] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:38 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:39.673418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:39.674055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:39.681085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:39.681541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:39.682336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:39.682770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:39.752946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:39.763179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:39.764702 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:39.765830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aa7a1191-cbb4-48b5-9e97-f08722fc6fe8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096679 Jun 02 19:18:39.766413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 850/1699] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:39.773824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e7e4878e-9af3-416e-817d-b186c07b6a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:39.774625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e7e4878e-9af3-416e-817d-b186c07b6a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:39.781839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7e4878e-9af3-416e-817d-b186c07b6a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:39.782309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7e4878e-9af3-416e-817d-b186c07b6a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:39.783087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7e4878e-9af3-416e-817d-b186c07b6a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:39.783527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7e4878e-9af3-416e-817d-b186c07b6a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:39.924204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e7e4878e-9af3-416e-817d-b186c07b6a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:39.937588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e7e4878e-9af3-416e-817d-b186c07b6a3a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167320 Jun 02 19:18:39.938440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 850/1700] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:39 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:40.785260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:40.785861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:40.792937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:40.793317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:40.794106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:40.794543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:40.863742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:40.872477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:40.874135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:40.875306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9753381-121d-40f9-9cb6-4ebae0ebad5c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094045 Jun 02 19:18:40.875856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 851/1701] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:40.963712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3c2fd44e-1ea4-4743-89ac-fdcc6fceb4c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:40.964671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3c2fd44e-1ea4-4743-89ac-fdcc6fceb4c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:40.972890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c2fd44e-1ea4-4743-89ac-fdcc6fceb4c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:40.973367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c2fd44e-1ea4-4743-89ac-fdcc6fceb4c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:40.974140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c2fd44e-1ea4-4743-89ac-fdcc6fceb4c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:40.974571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3c2fd44e-1ea4-4743-89ac-fdcc6fceb4c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:41.109739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3c2fd44e-1ea4-4743-89ac-fdcc6fceb4c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:41.118102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3c2fd44e-1ea4-4743-89ac-fdcc6fceb4c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160917 Jun 02 19:18:41.118682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 851/1702] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:40 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:41.894163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:41.894756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:41.901724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:41.902315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:41.903073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:41.903505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:41.966771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:41.975616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:41.977086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:41.978249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-411dc256-6881-4133-96ba-02676a04c23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088697 Jun 02 19:18:41.978795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 852/1703] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:42.135706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0eb3c02e-0d9a-4eb1-88d6-1709f86637be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:42.136336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0eb3c02e-0d9a-4eb1-88d6-1709f86637be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:42.144425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0eb3c02e-0d9a-4eb1-88d6-1709f86637be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:42.144804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0eb3c02e-0d9a-4eb1-88d6-1709f86637be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:42.145668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0eb3c02e-0d9a-4eb1-88d6-1709f86637be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:42.146325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0eb3c02e-0d9a-4eb1-88d6-1709f86637be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:42.288115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0eb3c02e-0d9a-4eb1-88d6-1709f86637be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:42.299818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0eb3c02e-0d9a-4eb1-88d6-1709f86637be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167738 Jun 02 19:18:42.300668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 852/1704] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:42 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:43.000950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:43.001623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:43.010629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:43.011150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:43.012043 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:43.012546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:43.082904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:43.091378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:43.092983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:43.094155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0fe8eb71-d3dd-4e50-be8d-583d34103830 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099961 Jun 02 19:18:43.094701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 853/1705] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:43.324189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ba833d83-e217-44c8-bbaa-9d8d3b8abd4f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:43.324782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ba833d83-e217-44c8-bbaa-9d8d3b8abd4f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:43.332851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba833d83-e217-44c8-bbaa-9d8d3b8abd4f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:43.333308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba833d83-e217-44c8-bbaa-9d8d3b8abd4f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:43.334247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba833d83-e217-44c8-bbaa-9d8d3b8abd4f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:43.334690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba833d83-e217-44c8-bbaa-9d8d3b8abd4f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:43.338972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:43.484809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ba833d83-e217-44c8-bbaa-9d8d3b8abd4f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:43.493447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ba833d83-e217-44c8-bbaa-9d8d3b8abd4f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175004 Jun 02 19:18:43.494059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 853/1706] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:43 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:44.113025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:44.113622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:44.120583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:44.121029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:44.121826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:44.122282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:44.137127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:44.193626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:44.204430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:44.205981 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:44.207111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-85637b76-3ead-436b-a68b-07cbdd682cae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098185 Jun 02 19:18:44.207664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 854/1707] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:44.515088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fc5ac8ed-7c38-48de-b06f-edac1ae366c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:44.516105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fc5ac8ed-7c38-48de-b06f-edac1ae366c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:44.526317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc5ac8ed-7c38-48de-b06f-edac1ae366c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:44.527017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc5ac8ed-7c38-48de-b06f-edac1ae366c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:44.528304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc5ac8ed-7c38-48de-b06f-edac1ae366c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:44.529054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc5ac8ed-7c38-48de-b06f-edac1ae366c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:44.844726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fc5ac8ed-7c38-48de-b06f-edac1ae366c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:44.852403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fc5ac8ed-7c38-48de-b06f-edac1ae366c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.343746 Jun 02 19:18:44.852982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 854/1708] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:44 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:45.226571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:45.227317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:45.235716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:45.236290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:45.237173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:45.237672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:45.304698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:45.314040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:45.315486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:45.316623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dfebd909-41ec-4383-83a3-a97dbeb96e0d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094897 Jun 02 19:18:45.317175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 855/1709] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:45.870196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3dd71aa1-785b-48c5-88ff-628575b67e27 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:45.870829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3dd71aa1-785b-48c5-88ff-628575b67e27 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:45.878092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3dd71aa1-785b-48c5-88ff-628575b67e27 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:45.878549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3dd71aa1-785b-48c5-88ff-628575b67e27 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:45.879315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3dd71aa1-785b-48c5-88ff-628575b67e27 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:45.879752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3dd71aa1-785b-48c5-88ff-628575b67e27 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:46.038578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3dd71aa1-785b-48c5-88ff-628575b67e27 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:46.051303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3dd71aa1-785b-48c5-88ff-628575b67e27 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.184866 Jun 02 19:18:46.052199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 855/1710] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:45 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:46.336353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:46.336960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:46.344893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:46.345462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:46.346356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:46.346867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:46.410856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:46.420086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:46.421621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:46.422803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d871811f-e8f8-4e7e-8270-e4ccc552e456 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091101 Jun 02 19:18:46.423363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 856/1711] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:47.070690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f8858391-2f5c-44cb-8cc0-20d6c3787081 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:47.071415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f8858391-2f5c-44cb-8cc0-20d6c3787081 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:47.079240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8858391-2f5c-44cb-8cc0-20d6c3787081 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:47.079776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8858391-2f5c-44cb-8cc0-20d6c3787081 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:47.080988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8858391-2f5c-44cb-8cc0-20d6c3787081 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:47.081503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8858391-2f5c-44cb-8cc0-20d6c3787081 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:47.214897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f8858391-2f5c-44cb-8cc0-20d6c3787081 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:47.227401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f8858391-2f5c-44cb-8cc0-20d6c3787081 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161566 Jun 02 19:18:47.228180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 856/1712] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:47 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:47.440800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:47.441440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:47.449552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:47.450035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:47.450796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:47.451223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:47.518388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:47.528857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:47.530463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:47.531609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-18a6c4db-f1e8-41fa-81b9-2c55c4c6d5af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094789 Jun 02 19:18:47.532153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 857/1713] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:48.252606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-03916514-87f2-4be5-ad84-f4cb3d3f0207 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:48.253597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-03916514-87f2-4be5-ad84-f4cb3d3f0207 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:48.261836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03916514-87f2-4be5-ad84-f4cb3d3f0207 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:48.262316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03916514-87f2-4be5-ad84-f4cb3d3f0207 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:48.263219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03916514-87f2-4be5-ad84-f4cb3d3f0207 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:48.263660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03916514-87f2-4be5-ad84-f4cb3d3f0207 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:48.405855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-03916514-87f2-4be5-ad84-f4cb3d3f0207 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:48.419365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-03916514-87f2-4be5-ad84-f4cb3d3f0207 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173364 Jun 02 19:18:48.420350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 857/1714] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:48 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:48.554151 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:48.554699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:48.561651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:48.562131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:48.562894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:48.563323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:48.633337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:48.641724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:48.643241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:48.644368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-94827844-c4fe-438b-a994-acbb520402b5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096728 Jun 02 19:18:48.644929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 858/1715] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:49.439163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-241711ce-a47d-4bdd-8ce4-fd131b58784f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:49.439755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-241711ce-a47d-4bdd-8ce4-fd131b58784f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:49.447633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-241711ce-a47d-4bdd-8ce4-fd131b58784f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:49.448093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-241711ce-a47d-4bdd-8ce4-fd131b58784f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:49.448901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-241711ce-a47d-4bdd-8ce4-fd131b58784f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:49.449338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-241711ce-a47d-4bdd-8ce4-fd131b58784f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:49.591643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-241711ce-a47d-4bdd-8ce4-fd131b58784f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:49.600472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-241711ce-a47d-4bdd-8ce4-fd131b58784f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165171 Jun 02 19:18:49.601373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 858/1716] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:49 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:49.663855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:49.664406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:49.672746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:49.673196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:49.673978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:49.674401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:49.746616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:49.755654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:49.757152 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:49.758326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-18629c1e-b287-46fa-8fd3-99a67e13a3a4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098971 Jun 02 19:18:49.758974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 859/1717] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:50.618659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-775571af-a01f-40e0-b60c-60a24e98b019 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:50.619259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-775571af-a01f-40e0-b60c-60a24e98b019 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:50.626363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-775571af-a01f-40e0-b60c-60a24e98b019 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:50.626818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-775571af-a01f-40e0-b60c-60a24e98b019 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:50.627587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-775571af-a01f-40e0-b60c-60a24e98b019 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:50.628028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-775571af-a01f-40e0-b60c-60a24e98b019 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:50.770288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-775571af-a01f-40e0-b60c-60a24e98b019 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:50.780046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-775571af-a01f-40e0-b60c-60a24e98b019 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165451 Jun 02 19:18:50.780610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 859/1718] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:50 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:50.781745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:50.782428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:50.789371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:50.789759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:50.791049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:50.791482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:50.858517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:50.867655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:50.869764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:50.870944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bbf00e8b-fbbf-4b07-afa6-4ff98bf6d5d8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093217 Jun 02 19:18:50.871508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 860/1719] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:51.800450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a3c6604a-28b8-400c-907e-2293148df246 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:51.801281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a3c6604a-28b8-400c-907e-2293148df246 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:51.811450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3c6604a-28b8-400c-907e-2293148df246 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:51.812143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3c6604a-28b8-400c-907e-2293148df246 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:51.813310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3c6604a-28b8-400c-907e-2293148df246 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:51.814023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3c6604a-28b8-400c-907e-2293148df246 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:51.889763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:51.890486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:51.896972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:51.897417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:51.898227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:51.898651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:51.962576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:51.971317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:51.972814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:51.974003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1e94f873-c9a0-4db1-85d1-4e6ab31ee04f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088826 Jun 02 19:18:51.974564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 861/1720] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:51.984939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a3c6604a-28b8-400c-907e-2293148df246 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:51.993902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a3c6604a-28b8-400c-907e-2293148df246 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.199491 Jun 02 19:18:51.994496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 860/1721] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:51 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:52.992548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:52.993318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:53.000128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:53.000571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:53.001328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:53.001759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:53.011151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ab2e0273-cf89-41bd-8ca9-b93323099014 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:53.011738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ab2e0273-cf89-41bd-8ca9-b93323099014 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:53.018805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab2e0273-cf89-41bd-8ca9-b93323099014 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:53.019260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab2e0273-cf89-41bd-8ca9-b93323099014 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:53.020038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab2e0273-cf89-41bd-8ca9-b93323099014 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:53.020475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ab2e0273-cf89-41bd-8ca9-b93323099014 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:53.075346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:53.084054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:53.085563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:53.086789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d946f8c4-2552-4180-ba3b-57f7dc6dffe4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098197 Jun 02 19:18:53.087381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 862/1722] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:53.168062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ab2e0273-cf89-41bd-8ca9-b93323099014 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:53.182309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ab2e0273-cf89-41bd-8ca9-b93323099014 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174114 Jun 02 19:18:53.183246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 861/1723] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:53 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:18:54.104791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:54.105469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:54.112787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:54.113155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:54.113961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:54.114382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:54.180020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:54.188953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:54.190550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:54.191685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b2705e62-1c9a-4b53-a3ba-fb5ea9f87a3f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090885 Jun 02 19:18:54.192575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 863/1724] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:54.199102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2dae5db2-ee80-4525-a3c3-0a9f29c17800 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:54.199837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2dae5db2-ee80-4525-a3c3-0a9f29c17800 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:54.206834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dae5db2-ee80-4525-a3c3-0a9f29c17800 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:54.207286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dae5db2-ee80-4525-a3c3-0a9f29c17800 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:54.208051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dae5db2-ee80-4525-a3c3-0a9f29c17800 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:54.208486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dae5db2-ee80-4525-a3c3-0a9f29c17800 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:54.355858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2dae5db2-ee80-4525-a3c3-0a9f29c17800 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:54.367882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2dae5db2-ee80-4525-a3c3-0a9f29c17800 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172668 Jun 02 19:18:54.368487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 862/1725] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:54 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:55.213713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:55.214541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:55.221754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:55.222236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:55.222995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:55.223424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:55.294155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:55.308047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:55.309774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:55.310943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cfc4843f-1d63-449b-a70d-a94b1c36007d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103051 Jun 02 19:18:55.311496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 864/1726] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:55.388905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a037b949-4bc7-44fc-b05c-d8da2d0003e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:55.389560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a037b949-4bc7-44fc-b05c-d8da2d0003e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:55.397903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a037b949-4bc7-44fc-b05c-d8da2d0003e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:55.398362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a037b949-4bc7-44fc-b05c-d8da2d0003e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:55.399130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a037b949-4bc7-44fc-b05c-d8da2d0003e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:55.399570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a037b949-4bc7-44fc-b05c-d8da2d0003e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:55.531238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a037b949-4bc7-44fc-b05c-d8da2d0003e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:55.540358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a037b949-4bc7-44fc-b05c-d8da2d0003e4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.157120 Jun 02 19:18:55.540905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 863/1727] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:55 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:56.330345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:56.330982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:56.338514 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:56.338985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:56.339816 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:56.340270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:56.404683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:56.413836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:56.415360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:56.416505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d42e123b-39b7-4868-ad20-e6777f790e57 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090442 Jun 02 19:18:56.417057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 865/1728] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:56.559517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-38098b1e-d2fe-425b-9139-05142c7749d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:56.560137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-38098b1e-d2fe-425b-9139-05142c7749d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:56.567432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38098b1e-d2fe-425b-9139-05142c7749d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:56.568037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38098b1e-d2fe-425b-9139-05142c7749d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:56.568877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38098b1e-d2fe-425b-9139-05142c7749d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:56.569321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38098b1e-d2fe-425b-9139-05142c7749d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:56.719791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-38098b1e-d2fe-425b-9139-05142c7749d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:56.728413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-38098b1e-d2fe-425b-9139-05142c7749d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174873 Jun 02 19:18:56.728979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 864/1729] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:56 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:57.435232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:57.435905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:57.438285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=54 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:57.444225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:57.444678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:57.445427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:57.445889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:57.514787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:57.524082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:57.526102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:57.527903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4febc1ab-9157-4c8c-8970-392c2242271a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096726 Jun 02 19:18:57.529112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 866/1730] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:57.749453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2f447aa6-75a3-4fd1-9af7-ff668848635d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:57.750410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2f447aa6-75a3-4fd1-9af7-ff668848635d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:57.754090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=50 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:57.763241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f447aa6-75a3-4fd1-9af7-ff668848635d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:57.763731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f447aa6-75a3-4fd1-9af7-ff668848635d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:57.764502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f447aa6-75a3-4fd1-9af7-ff668848635d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:57.764939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f447aa6-75a3-4fd1-9af7-ff668848635d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:57.913683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2f447aa6-75a3-4fd1-9af7-ff668848635d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:57.924005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2f447aa6-75a3-4fd1-9af7-ff668848635d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.181240 Jun 02 19:18:57.924602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 865/1731] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:57 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:58.551142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:58.552220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:58.563040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:58.563804 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:58.565063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:58.565831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:58.640770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:58.653971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:58.656625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:58.658238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-97c7c3aa-c9d0-44a6-a769-1d7be4d730cd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.113178 Jun 02 19:18:58.658998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 867/1732] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:18:58.945097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-737c2704-927f-4d2c-92b9-3ed6a5613244 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:58.946204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-737c2704-927f-4d2c-92b9-3ed6a5613244 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:58.957606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-737c2704-927f-4d2c-92b9-3ed6a5613244 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:58.958417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-737c2704-927f-4d2c-92b9-3ed6a5613244 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:58.959689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-737c2704-927f-4d2c-92b9-3ed6a5613244 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:58.960438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-737c2704-927f-4d2c-92b9-3ed6a5613244 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:59.098871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-737c2704-927f-4d2c-92b9-3ed6a5613244 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:59.106945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-737c2704-927f-4d2c-92b9-3ed6a5613244 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168775 Jun 02 19:18:59.107481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 866/1733] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:18:58 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:18:59.684792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:18:59.686022 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:18:59.692738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:59.693203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:59.693993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:18:59.694417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:18:59.769729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:59.779109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:59.780635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:18:59.781758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-083f887d-3d92-4862-9e96-efd9cfc0183f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104108 Jun 02 19:18:59.782330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 868/1734] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:18:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:00.126066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8becec93-33f5-428c-9b08-533fea8690db tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:00.126710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8becec93-33f5-428c-9b08-533fea8690db tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:00.135332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8becec93-33f5-428c-9b08-533fea8690db tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:00.135907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8becec93-33f5-428c-9b08-533fea8690db tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:00.136939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8becec93-33f5-428c-9b08-533fea8690db tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:00.137448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8becec93-33f5-428c-9b08-533fea8690db tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:00.277390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8becec93-33f5-428c-9b08-533fea8690db tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:00.285746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8becec93-33f5-428c-9b08-533fea8690db tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165194 Jun 02 19:19:00.286369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 867/1735] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:00 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:00.802776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:00.803477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:00.813080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:00.813681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:00.814743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:00.815323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:00.885053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:00.895356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:00.896864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:00.898050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1de5e813-ca16-414c-8816-568a0d6e4a51 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100729 Jun 02 19:19:00.898611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 869/1736] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:01.303216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1a714370-0668-4f6e-b85c-bcb7a1989f0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:01.303808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1a714370-0668-4f6e-b85c-bcb7a1989f0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:01.311138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a714370-0668-4f6e-b85c-bcb7a1989f0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:01.311599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a714370-0668-4f6e-b85c-bcb7a1989f0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:01.312378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a714370-0668-4f6e-b85c-bcb7a1989f0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:01.312823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a714370-0668-4f6e-b85c-bcb7a1989f0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:01.466270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1a714370-0668-4f6e-b85c-bcb7a1989f0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:01.475009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1a714370-0668-4f6e-b85c-bcb7a1989f0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175788 Jun 02 19:19:01.475570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 868/1737] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:01 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:01.920264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:01.921211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:01.931791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:01.932467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:01.933700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:01.934416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:02.003495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:02.017705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:02.021075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:02.023667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fca30873-ec9f-4c26-a1ba-5a20f588130c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.109262 Jun 02 19:19:02.024842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 870/1738] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:02.494194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-61aa239f-2d7f-4344-8c07-6d430dc066f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:02.494890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-61aa239f-2d7f-4344-8c07-6d430dc066f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:02.502617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61aa239f-2d7f-4344-8c07-6d430dc066f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:02.503079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61aa239f-2d7f-4344-8c07-6d430dc066f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:02.503859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61aa239f-2d7f-4344-8c07-6d430dc066f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:02.504313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61aa239f-2d7f-4344-8c07-6d430dc066f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:02.645775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-61aa239f-2d7f-4344-8c07-6d430dc066f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:02.651296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:02.657574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-61aa239f-2d7f-4344-8c07-6d430dc066f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168123 Jun 02 19:19:02.658207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 869/1739] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:02 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:03.046959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:03.047572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:03.054833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:03.055313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:03.056053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:03.056491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:03.059051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:03.120490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:03.129591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:03.131130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:03.132283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-140d04af-c6e2-449d-b624-9b3cc6b1ce68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090571 Jun 02 19:19:03.132855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 871/1740] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:03.677596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-195e8d5f-2900-49ac-a42d-3a2c93a70dc5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:03.678498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-195e8d5f-2900-49ac-a42d-3a2c93a70dc5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:03.687640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-195e8d5f-2900-49ac-a42d-3a2c93a70dc5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:03.688245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-195e8d5f-2900-49ac-a42d-3a2c93a70dc5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:03.689263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-195e8d5f-2900-49ac-a42d-3a2c93a70dc5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:03.689926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-195e8d5f-2900-49ac-a42d-3a2c93a70dc5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:03.834765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-195e8d5f-2900-49ac-a42d-3a2c93a70dc5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:03.848378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-195e8d5f-2900-49ac-a42d-3a2c93a70dc5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.176421 Jun 02 19:19:03.849157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 870/1741] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:03 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:04.150381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:04.151004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:04.158232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:04.158677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:04.159430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:04.159856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:04.225618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:04.239671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:04.241948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:04.243630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-acb16962-4297-44d7-aabe-1e73891ff6ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097162 Jun 02 19:19:04.244397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 872/1742] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:04.872843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1aaf7ab0-b789-4f23-ba9b-1ecf7aa65f63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:04.874081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1aaf7ab0-b789-4f23-ba9b-1ecf7aa65f63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:04.881005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1aaf7ab0-b789-4f23-ba9b-1ecf7aa65f63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:04.881458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1aaf7ab0-b789-4f23-ba9b-1ecf7aa65f63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:04.882256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1aaf7ab0-b789-4f23-ba9b-1ecf7aa65f63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:04.882691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1aaf7ab0-b789-4f23-ba9b-1ecf7aa65f63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:05.012972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1aaf7ab0-b789-4f23-ba9b-1ecf7aa65f63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:05.021273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1aaf7ab0-b789-4f23-ba9b-1ecf7aa65f63 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.154910 Jun 02 19:19:05.021837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 871/1743] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:04 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:05.265158 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:05.265731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:05.272713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:05.273138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:05.273949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:05.274379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:05.341136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:05.350141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:05.351601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:05.352768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-742dcc85-73ed-4460-ba9b-1ea2929e50f5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093533 Jun 02 19:19:05.353351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 873/1744] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:06.043032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-72376550-7802-414f-9809-39e5762cb18a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:06.043976 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-72376550-7802-414f-9809-39e5762cb18a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:06.051819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-72376550-7802-414f-9809-39e5762cb18a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:06.052289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-72376550-7802-414f-9809-39e5762cb18a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:06.053060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-72376550-7802-414f-9809-39e5762cb18a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:06.053495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-72376550-7802-414f-9809-39e5762cb18a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:06.204203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-72376550-7802-414f-9809-39e5762cb18a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:06.212670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-72376550-7802-414f-9809-39e5762cb18a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.176213 Jun 02 19:19:06.213238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 872/1745] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:06 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:06.374857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:06.375417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:06.382397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:06.382847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:06.383641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:06.384070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:06.448340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:06.457569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:06.459109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:06.460260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3bb3c7bb-1855-48f2-af24-8f9b2bfc9e17 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091554 Jun 02 19:19:06.460812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 874/1746] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:07.230551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-124110ce-ddf6-46d9-b162-21cdfc90292f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:07.231137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-124110ce-ddf6-46d9-b162-21cdfc90292f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:07.238316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-124110ce-ddf6-46d9-b162-21cdfc90292f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:07.238766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-124110ce-ddf6-46d9-b162-21cdfc90292f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:07.239548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-124110ce-ddf6-46d9-b162-21cdfc90292f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:07.239991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-124110ce-ddf6-46d9-b162-21cdfc90292f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:07.396656 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-124110ce-ddf6-46d9-b162-21cdfc90292f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:07.405721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-124110ce-ddf6-46d9-b162-21cdfc90292f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179090 Jun 02 19:19:07.406298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 873/1747] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:07 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:07.478849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:07.479420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:07.486399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:07.486861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:07.487609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:07.488040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:07.551733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:07.560380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:07.562135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:07.563270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-98ce29f2-9120-4441-99e6-626ad870ee2b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088563 Jun 02 19:19:07.563805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 875/1748] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:08.423631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a63b39de-e2c8-4c6b-83d0-883d54fbe132 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:08.424241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a63b39de-e2c8-4c6b-83d0-883d54fbe132 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:08.431424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a63b39de-e2c8-4c6b-83d0-883d54fbe132 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:08.431887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a63b39de-e2c8-4c6b-83d0-883d54fbe132 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:08.432657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a63b39de-e2c8-4c6b-83d0-883d54fbe132 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:08.433095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a63b39de-e2c8-4c6b-83d0-883d54fbe132 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:08.565484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a63b39de-e2c8-4c6b-83d0-883d54fbe132 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:08.577510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a63b39de-e2c8-4c6b-83d0-883d54fbe132 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.158221 Jun 02 19:19:08.578091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 874/1749] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:08 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:08.581968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:08.582578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:08.589847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:08.590327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:08.591087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:08.591521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:08.671559 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:08.682726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:08.684491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:08.686310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad2a90a4-2a34-4b07-a7f9-da91015b5075 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.107978 Jun 02 19:19:08.687622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 876/1750] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:09.599537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d7c93dc1-8439-4382-9dcb-d7c22cd0021b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:09.600563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d7c93dc1-8439-4382-9dcb-d7c22cd0021b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:09.610390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7c93dc1-8439-4382-9dcb-d7c22cd0021b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:09.610858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7c93dc1-8439-4382-9dcb-d7c22cd0021b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:09.611745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7c93dc1-8439-4382-9dcb-d7c22cd0021b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:09.612190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7c93dc1-8439-4382-9dcb-d7c22cd0021b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:09.711334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:09.711932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:09.718665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:09.719113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:09.719898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:09.720327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:09.755721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d7c93dc1-8439-4382-9dcb-d7c22cd0021b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:09.764154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d7c93dc1-8439-4382-9dcb-d7c22cd0021b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171460 Jun 02 19:19:09.764822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 875/1751] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:09 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:09.784253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:09.797019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:09.798472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:09.799608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-64ce5b09-6e6e-48d8-b472-d6dc09440331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092217 Jun 02 19:19:09.800129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 877/1752] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:10.785012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d5cdffd-6a2e-45a6-bc3d-6063e0811f35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:10.786141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d5cdffd-6a2e-45a6-bc3d-6063e0811f35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:10.795196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d5cdffd-6a2e-45a6-bc3d-6063e0811f35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:10.795912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d5cdffd-6a2e-45a6-bc3d-6063e0811f35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:10.797082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d5cdffd-6a2e-45a6-bc3d-6063e0811f35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:10.797662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d5cdffd-6a2e-45a6-bc3d-6063e0811f35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:10.817693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:10.818310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:10.825339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:10.825781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:10.826559 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:10.827063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:10.901974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:10.911122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:10.912640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:10.913780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-853acc64-1a9d-48bf-982e-1ba4ed341d1b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100351 Jun 02 19:19:10.914350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 878/1753] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:10.958623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d5cdffd-6a2e-45a6-bc3d-6063e0811f35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:10.966766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d5cdffd-6a2e-45a6-bc3d-6063e0811f35 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.187690 Jun 02 19:19:10.967333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 876/1754] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:10 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:11.932244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:11.932847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:11.940294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:11.940741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:11.941471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:11.942333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:11.984345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-849effbe-974b-405e-b34e-752de043e1be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:11.984958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-849effbe-974b-405e-b34e-752de043e1be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:11.992150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-849effbe-974b-405e-b34e-752de043e1be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:11.992620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-849effbe-974b-405e-b34e-752de043e1be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:11.993400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-849effbe-974b-405e-b34e-752de043e1be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:11.993828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-849effbe-974b-405e-b34e-752de043e1be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:12.006075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:12.014977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:12.016483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:12.017813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d15c52ae-c143-4528-a86b-581e6255ffdb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.089462 Jun 02 19:19:12.018363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 879/1755] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:12.133743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-849effbe-974b-405e-b34e-752de043e1be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:12.144398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-849effbe-974b-405e-b34e-752de043e1be tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163958 Jun 02 19:19:12.144973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 877/1756] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:11 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:13.037544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:13.038351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:13.047247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:13.047768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:13.048677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:13.049243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:13.120136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:13.129526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:13.131138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:13.132232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-895ba74b-835f-4403-9c75-8276d61a4cc1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099259 Jun 02 19:19:13.132796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 880/1757] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:13.161694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e8f19de6-3b98-4d8a-a04e-3d4bec4e8c58 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:13.162342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e8f19de6-3b98-4d8a-a04e-3d4bec4e8c58 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:13.170037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8f19de6-3b98-4d8a-a04e-3d4bec4e8c58 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:13.170737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8f19de6-3b98-4d8a-a04e-3d4bec4e8c58 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:13.171647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8f19de6-3b98-4d8a-a04e-3d4bec4e8c58 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:13.172085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8f19de6-3b98-4d8a-a04e-3d4bec4e8c58 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:13.313260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8f19de6-3b98-4d8a-a04e-3d4bec4e8c58 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:13.326577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e8f19de6-3b98-4d8a-a04e-3d4bec4e8c58 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168369 Jun 02 19:19:13.327499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 878/1758] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:13 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:14.155272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:14.156893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:14.170262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:14.171007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:14.172051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:14.172487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:14.240537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:14.249495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:14.251208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:14.252393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-346a7fef-5eee-4870-bbce-1b91d08aa30a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103846 Jun 02 19:19:14.252927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 881/1759] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:14.346581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fcaf212c-e08e-4f71-b9b9-6bd7c0fc6224 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:14.347175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fcaf212c-e08e-4f71-b9b9-6bd7c0fc6224 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:14.354384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fcaf212c-e08e-4f71-b9b9-6bd7c0fc6224 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:14.354818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fcaf212c-e08e-4f71-b9b9-6bd7c0fc6224 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:14.355598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fcaf212c-e08e-4f71-b9b9-6bd7c0fc6224 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:14.356076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fcaf212c-e08e-4f71-b9b9-6bd7c0fc6224 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:14.511161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fcaf212c-e08e-4f71-b9b9-6bd7c0fc6224 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:14.519562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fcaf212c-e08e-4f71-b9b9-6bd7c0fc6224 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.177881 Jun 02 19:19:14.520154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 879/1760] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:14 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:15.275294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:15.276242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:15.285844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:15.286318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:15.287069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:15.287467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:15.350190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:15.359748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:15.361462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:15.362639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-89ba6fcb-dce6-4fc9-a813-01efe2f65b46 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094342 Jun 02 19:19:15.363204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 882/1761] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:15.541002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e20d605f-2500-44d7-b9b8-b76283edba5e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:15.542053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e20d605f-2500-44d7-b9b8-b76283edba5e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:15.551346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e20d605f-2500-44d7-b9b8-b76283edba5e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:15.551852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e20d605f-2500-44d7-b9b8-b76283edba5e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:15.552763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e20d605f-2500-44d7-b9b8-b76283edba5e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:15.553297 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e20d605f-2500-44d7-b9b8-b76283edba5e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:15.707670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e20d605f-2500-44d7-b9b8-b76283edba5e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:15.717001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e20d605f-2500-44d7-b9b8-b76283edba5e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.182465 Jun 02 19:19:15.717635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 880/1762] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:15 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:16.384356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:16.385293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:16.394377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:16.394832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:16.395608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:16.396040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:16.470700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:16.483863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:16.486144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:16.487741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fcbfa58b-00a3-4503-8359-038bcd7bc82b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.109755 Jun 02 19:19:16.488333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 883/1763] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:16.743624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f059f5db-d5ae-4b8b-9e3b-be442e9c9455 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:16.744729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f059f5db-d5ae-4b8b-9e3b-be442e9c9455 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:16.754296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f059f5db-d5ae-4b8b-9e3b-be442e9c9455 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:16.754950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f059f5db-d5ae-4b8b-9e3b-be442e9c9455 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:16.755721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f059f5db-d5ae-4b8b-9e3b-be442e9c9455 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:16.756160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f059f5db-d5ae-4b8b-9e3b-be442e9c9455 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:16.896225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f059f5db-d5ae-4b8b-9e3b-be442e9c9455 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:16.904821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f059f5db-d5ae-4b8b-9e3b-be442e9c9455 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166826 Jun 02 19:19:16.905469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 881/1764] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:16 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:17.507055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:17.507667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:17.514584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:17.515026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:17.515780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:17.516206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:17.583832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:17.597394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:17.598932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:17.600081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-febfa7c1-5eba-4806-8561-bf435f2de35a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097468 Jun 02 19:19:17.600609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 884/1765] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:17.926461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9c2d36b8-5a14-456f-9fca-6cd33b4edb77 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:17.927078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9c2d36b8-5a14-456f-9fca-6cd33b4edb77 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:17.934122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c2d36b8-5a14-456f-9fca-6cd33b4edb77 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:17.934576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c2d36b8-5a14-456f-9fca-6cd33b4edb77 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:17.935365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c2d36b8-5a14-456f-9fca-6cd33b4edb77 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:17.938235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9c2d36b8-5a14-456f-9fca-6cd33b4edb77 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:18.078042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9c2d36b8-5a14-456f-9fca-6cd33b4edb77 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:18.086590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9c2d36b8-5a14-456f-9fca-6cd33b4edb77 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165773 Jun 02 19:19:18.087159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 882/1766] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:17 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:18.619125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:18.619705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:18.627178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:18.627652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:18.628508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:18.629066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:18.698831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:18.709280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:18.710828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:18.712006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cdbdaa2b-f53f-43d1-b0b6-520a63595e8a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097367 Jun 02 19:19:18.712560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 885/1767] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:19.109126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7e10e957-219e-4098-8e0b-3bd601b7100a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:19.109818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7e10e957-219e-4098-8e0b-3bd601b7100a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:19.117092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e10e957-219e-4098-8e0b-3bd601b7100a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:19.117544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e10e957-219e-4098-8e0b-3bd601b7100a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:19.118351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e10e957-219e-4098-8e0b-3bd601b7100a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:19.118789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e10e957-219e-4098-8e0b-3bd601b7100a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:19.283649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7e10e957-219e-4098-8e0b-3bd601b7100a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:19.296132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7e10e957-219e-4098-8e0b-3bd601b7100a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.191503 Jun 02 19:19:19.296909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 883/1768] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:19 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:19.731506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:19.732240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:19.739622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:19.740068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:19.740828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:19.741252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:19.809626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:19.821534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:19.823058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:19.824339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b1e71e08-1db7-4dd4-98ae-f03e11871085 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096940 Jun 02 19:19:19.825088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 886/1769] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:20.319183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-152b4eb8-0c85-466d-aee3-37b20b1a66f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:20.319812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-152b4eb8-0c85-466d-aee3-37b20b1a66f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:20.327246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-152b4eb8-0c85-466d-aee3-37b20b1a66f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:20.327731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-152b4eb8-0c85-466d-aee3-37b20b1a66f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:20.328550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-152b4eb8-0c85-466d-aee3-37b20b1a66f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:20.329014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-152b4eb8-0c85-466d-aee3-37b20b1a66f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:20.467231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-152b4eb8-0c85-466d-aee3-37b20b1a66f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:20.477448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-152b4eb8-0c85-466d-aee3-37b20b1a66f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163889 Jun 02 19:19:20.478054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 884/1770] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:20 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:20.846389 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:20.847393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:20.858683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:20.859438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:20.860694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:20.861385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:20.940754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:20.944807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:20.955691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:20.957744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:20.958911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-121aef3b-6ca9-453c-9f4a-01aa8dfb99ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.119181 Jun 02 19:19:20.959481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 887/1771] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:21.495430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2e650768-82cb-496c-b228-536fc20df2e8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:21.496130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2e650768-82cb-496c-b228-536fc20df2e8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:21.503944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e650768-82cb-496c-b228-536fc20df2e8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:21.505068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e650768-82cb-496c-b228-536fc20df2e8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:21.506055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e650768-82cb-496c-b228-536fc20df2e8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:21.506572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e650768-82cb-496c-b228-536fc20df2e8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:21.647642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e650768-82cb-496c-b228-536fc20df2e8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:21.655926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2e650768-82cb-496c-b228-536fc20df2e8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.164797 Jun 02 19:19:21.656493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 885/1772] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:21 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:21.978092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:21.978717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:21.985827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:21.986305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:21.987061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:21.987496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:22.051448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:22.060055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:22.061547 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:22.062720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-954fd9b7-a8aa-48a4-abb4-1d296b7f46b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088940 Jun 02 19:19:22.063275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 888/1773] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:22.674073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-621bdc19-25c9-46c8-8ecb-923986ac4d90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:22.674705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-621bdc19-25c9-46c8-8ecb-923986ac4d90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:22.682114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-621bdc19-25c9-46c8-8ecb-923986ac4d90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:22.682576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-621bdc19-25c9-46c8-8ecb-923986ac4d90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:22.683356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-621bdc19-25c9-46c8-8ecb-923986ac4d90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:22.683798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-621bdc19-25c9-46c8-8ecb-923986ac4d90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:22.706407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:22.833864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-621bdc19-25c9-46c8-8ecb-923986ac4d90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:22.846588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-621bdc19-25c9-46c8-8ecb-923986ac4d90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.176132 Jun 02 19:19:22.847490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 886/1774] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:22 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:23.084364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:23.084920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:23.092111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:23.092563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:23.093328 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:23.093760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:23.163148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:23.174753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:23.176747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:23.177924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-06220a12-6444-424c-8223-3fee11448bf3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099234 Jun 02 19:19:23.178513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 889/1775] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:23.566259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5c684f8e-879a-48f3-9247-516fdace4002 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:23.567471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5c684f8e-879a-48f3-9247-516fdace4002 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:23.574506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c684f8e-879a-48f3-9247-516fdace4002 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:23.574960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c684f8e-879a-48f3-9247-516fdace4002 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:23.575725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c684f8e-879a-48f3-9247-516fdace4002 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:23.576159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c684f8e-879a-48f3-9247-516fdace4002 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:23.603230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5c684f8e-879a-48f3-9247-516fdace4002 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:19:23.687705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5c684f8e-879a-48f3-9247-516fdace4002 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 204 len: 0 microversion: 2.1 time: 0.128194 Jun 02 19:19:23.688406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 887/1776] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:19:23 2022] DELETE /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:19:23.697359 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f8020c3b-9990-4cf2-ac66-f93e70e9c958 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:23.698007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f8020c3b-9990-4cf2-ac66-f93e70e9c958 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:23.704400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8020c3b-9990-4cf2-ac66-f93e70e9c958 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:23.704844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8020c3b-9990-4cf2-ac66-f93e70e9c958 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:23.705599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8020c3b-9990-4cf2-ac66-f93e70e9c958 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:23.706057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8020c3b-9990-4cf2-ac66-f93e70e9c958 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:23.866129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f8020c3b-9990-4cf2-ac66-f93e70e9c958 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:23.866483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a8cb9a17-f8bc-4cc4-8d25-1b3a10da68f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:23.867192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a8cb9a17-f8bc-4cc4-8d25-1b3a10da68f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:23.873638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8cb9a17-f8bc-4cc4-8d25-1b3a10da68f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:23.873946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8cb9a17-f8bc-4cc4-8d25-1b3a10da68f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:23.874088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f8020c3b-9990-4cf2-ac66-f93e70e9c958 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1681 microversion: 2.1 time: 0.180630 Jun 02 19:19:23.874691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 890/1777] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:23 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:23.874844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8cb9a17-f8bc-4cc4-8d25-1b3a10da68f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:23.875171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8cb9a17-f8bc-4cc4-8d25-1b3a10da68f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:24.014705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a8cb9a17-f8bc-4cc4-8d25-1b3a10da68f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:24.025706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a8cb9a17-f8bc-4cc4-8d25-1b3a10da68f0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163477 Jun 02 19:19:24.026579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 888/1778] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:23 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:24.198632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:24.199253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:24.205778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:24.206330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:24.207082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:24.207514 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:24.278521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:24.289842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:24.291368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:24.292508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c67462be-1f64-4f53-b90d-927fef26182f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098697 Jun 02 19:19:24.293061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 891/1779] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:24.892188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5b3a85c7-5617-43e1-ac1f-95a1d2f156db tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:24.892833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5b3a85c7-5617-43e1-ac1f-95a1d2f156db tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:24.900731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b3a85c7-5617-43e1-ac1f-95a1d2f156db tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:24.901722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b3a85c7-5617-43e1-ac1f-95a1d2f156db tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:24.902531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b3a85c7-5617-43e1-ac1f-95a1d2f156db tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:24.902971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b3a85c7-5617-43e1-ac1f-95a1d2f156db tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:25.038550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5b3a85c7-5617-43e1-ac1f-95a1d2f156db tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:25.043613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bb97b64e-ace1-46f2-936e-dbca4a2db870 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:25.044226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bb97b64e-ace1-46f2-936e-dbca4a2db870 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:25.046503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5b3a85c7-5617-43e1-ac1f-95a1d2f156db tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1681 microversion: 2.1 time: 0.158189 Jun 02 19:19:25.047185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 889/1780] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:24 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:25.051490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb97b64e-ace1-46f2-936e-dbca4a2db870 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:25.052254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb97b64e-ace1-46f2-936e-dbca4a2db870 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:25.053033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb97b64e-ace1-46f2-936e-dbca4a2db870 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:25.053469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bb97b64e-ace1-46f2-936e-dbca4a2db870 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:25.198120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bb97b64e-ace1-46f2-936e-dbca4a2db870 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:25.207409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bb97b64e-ace1-46f2-936e-dbca4a2db870 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168182 Jun 02 19:19:25.208074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 892/1781] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:25 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:25.311477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:25.312102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:25.318953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:25.319414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:25.320193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:25.320635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:25.383427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:25.392472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:25.394093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:25.395156 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-402dbb0d-dbd2-40fe-bd56-946a4b93f23c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088304 Jun 02 19:19:25.395741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 890/1782] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:25.860592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-95ccd2cd-fc84-448b-9e34-473b5ae9bdea req-7eeeec20-b0a8-4615-8bb4-67b469a68327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086880e0-e0d9-43ab-ae0b-1af70fab62b2", "name": "network-vif-deleted", "tag": "041757c0-ba75-4107-87a3-4d045aa06995"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:19:25.871182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-95ccd2cd-fc84-448b-9e34-473b5ae9bdea req-7eeeec20-b0a8-4615-8bb4-67b469a68327 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:25.872072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-95ccd2cd-fc84-448b-9e34-473b5ae9bdea req-7eeeec20-b0a8-4615-8bb4-67b469a68327 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:25.886136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-95ccd2cd-fc84-448b-9e34-473b5ae9bdea req-7eeeec20-b0a8-4615-8bb4-67b469a68327 service nova] Creating event network-vif-deleted:041757c0-ba75-4107-87a3-4d045aa06995 for instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 on hv-cinder-79760 Jun 02 19:19:25.892952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-95ccd2cd-fc84-448b-9e34-473b5ae9bdea req-7eeeec20-b0a8-4615-8bb4-67b469a68327 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036264 Jun 02 19:19:25.893656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 893/1783] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:19:26.064820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:26.065608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:26.073079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:26.073577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:26.074642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:26.075110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:26.109482 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:26.109979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:26.110506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lazy-loading 'fault' on Instance uuid 086880e0-e0d9-43ab-ae0b-1af70fab62b2 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:19:26.152929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a660a47927140d6b4d0543de5e281a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a66e7666ca24a079738eea09c470cdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:26.160534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3444db97-3cda-47a7-9cd7-9e943af192ae tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 200 len: 1331 microversion: 2.1 time: 0.100239 Jun 02 19:19:26.161138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 891/1784] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:26 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:26.225547 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ea7ef1b-3344-4022-8a24-6185cc582351 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:26.227009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5ea7ef1b-3344-4022-8a24-6185cc582351 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:26.234448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ea7ef1b-3344-4022-8a24-6185cc582351 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:26.234895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ea7ef1b-3344-4022-8a24-6185cc582351 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:26.235634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ea7ef1b-3344-4022-8a24-6185cc582351 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:26.236243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ea7ef1b-3344-4022-8a24-6185cc582351 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:26.412697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:26.413538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:26.420770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:26.421387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:26.422730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:26.422876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:26.596688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:26.607304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:26.609403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:26.610882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47296374-349b-4b89-bd18-d973e76ff5f7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.202209 Jun 02 19:19:26.612064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 892/1785] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:19:26.626813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ea7ef1b-3344-4022-8a24-6185cc582351 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:26.635331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ea7ef1b-3344-4022-8a24-6185cc582351 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.414131 Jun 02 19:19:26.635919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 894/1786] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:26 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:27.178408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:27.179053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:27.187630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:27.188012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:27.188805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:27.190323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:27.208117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 HTTP/1.1 Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:19:27.209968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:27.211475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '086880e0-e0d9-43ab-ae0b-1af70fab62b2'} Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:19:27.212367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:27.214350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:27.215670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:19:27.215670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-89653032-e3c1-4704-aadf-daabec11608f tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 404 len: 111 microversion: 2.1 time: 0.037160 Jun 02 19:19:27.215670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 893/1787] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:27 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:19:27.220325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a151a049-718f-4dcc-8880-728e9bdf5ab5 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '.version_select at 0x7f5b785f65e0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:27.249632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a151a049-718f-4dcc-8880-728e9bdf5ab5 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459166918" status: 202 len: 0 microversion: 2.1 time: 0.033092 Jun 02 19:19:27.250388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 895/1788] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Jun 2 19:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459166918 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 19:19:27.629985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:27.630595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:27.637373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:27.637827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:27.638622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:27.639041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:27.652547 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6edeb3e9-be6d-4d02-90c9-c17357069fa9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:27.653642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6edeb3e9-be6d-4d02-90c9-c17357069fa9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:27.655826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:27.663452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6edeb3e9-be6d-4d02-90c9-c17357069fa9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:27.664140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6edeb3e9-be6d-4d02-90c9-c17357069fa9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:27.665236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6edeb3e9-be6d-4d02-90c9-c17357069fa9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:27.665848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6edeb3e9-be6d-4d02-90c9-c17357069fa9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:27.738191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:27.747163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:27.748659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:27.749829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b5749279-73e2-43d7-b918-a00933aa2edc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.123860 Jun 02 19:19:27.750390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 894/1789] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:27.869576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6edeb3e9-be6d-4d02-90c9-c17357069fa9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:27.878510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6edeb3e9-be6d-4d02-90c9-c17357069fa9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.229934 Jun 02 19:19:27.879427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 896/1790] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:27 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:28.033855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:28.034382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:28.036399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:28.041279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:28.042398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:28.043214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:28.043661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:28.058967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 HTTP/1.1 Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:19:28.060560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.062427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '086880e0-e0d9-43ab-ae0b-1af70fab62b2'} Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:19:28.063362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.064886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.066437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:19:28.066437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d69bd8ae-7872-451d-93e8-ac9ca363a1fb tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 404 len: 111 microversion: 2.1 time: 0.033520 Jun 02 19:19:28.067340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 895/1791] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:19:28 2022] DELETE /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:19:28.072386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:28.073476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 086880e0-e0d9-43ab-ae0b-1af70fab62b2] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:28.081019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:28.081623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:28.082785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:28.083415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:28.097175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 HTTP/1.1 Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:19:28.098875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.100478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '086880e0-e0d9-43ab-ae0b-1af70fab62b2'} Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:19:28.101321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. Jun 02 19:19:28.102758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:19:28.104116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 086880e0-e0d9-43ab-ae0b-1af70fab62b2 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:19:28.104116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c52fb1a0-d5d5-40a9-a175-c71adbca8677 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2" status: 404 len: 111 microversion: 2.1 time: 0.031749 Jun 02 19:19:28.104116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 897/1792] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:28 2022] GET /compute/v2.1/servers/086880e0-e0d9-43ab-ae0b-1af70fab62b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:19:28.771388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:28.771991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:28.782255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:28.782712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:28.783488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:28.783927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:28.849285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:28.857978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:28.859485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:28.860610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b47d5751-8b9d-4c61-abb1-2d1155b4c758 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095906 Jun 02 19:19:28.861178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 896/1793] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:28.896118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8d447ac7-5b90-49b6-88eb-1cdbd056547c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:28.896733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8d447ac7-5b90-49b6-88eb-1cdbd056547c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:28.904633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d447ac7-5b90-49b6-88eb-1cdbd056547c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:28.905088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d447ac7-5b90-49b6-88eb-1cdbd056547c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:28.905854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d447ac7-5b90-49b6-88eb-1cdbd056547c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:28.906319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d447ac7-5b90-49b6-88eb-1cdbd056547c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:29.039243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8d447ac7-5b90-49b6-88eb-1cdbd056547c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:29.047845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8d447ac7-5b90-49b6-88eb-1cdbd056547c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.155653 Jun 02 19:19:29.048418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 898/1794] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:28 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:29.879836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:29.880454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:29.887951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:29.888440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:29.889207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:29.889649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:29.966222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:29.976932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:29.979306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:29.980473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b0cc6725-fee3-4284-98bd-f3ac82196cbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104682 Jun 02 19:19:29.981024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 897/1795] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:30.064666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1614ca2a-ccc1-43f9-b7a7-9337dbadb67f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:30.065270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1614ca2a-ccc1-43f9-b7a7-9337dbadb67f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:30.072217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1614ca2a-ccc1-43f9-b7a7-9337dbadb67f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:30.072999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1614ca2a-ccc1-43f9-b7a7-9337dbadb67f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:30.073770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1614ca2a-ccc1-43f9-b7a7-9337dbadb67f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:30.074239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1614ca2a-ccc1-43f9-b7a7-9337dbadb67f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:30.227624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1614ca2a-ccc1-43f9-b7a7-9337dbadb67f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:30.240913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1614ca2a-ccc1-43f9-b7a7-9337dbadb67f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179894 Jun 02 19:19:30.241848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 899/1796] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:30 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:30.998990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:30.999588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:31.006520 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:31.006982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:31.007755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:31.008200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:31.078786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:31.092620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:31.094166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:31.095323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-08f6fde4-a3e8-4555-8fcc-862ee0843c91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100550 Jun 02 19:19:31.095873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 898/1797] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:31.264367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a4bead5a-ad10-4438-904a-fcff62fb8c4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:31.265182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a4bead5a-ad10-4438-904a-fcff62fb8c4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:31.271989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4bead5a-ad10-4438-904a-fcff62fb8c4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:31.272443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4bead5a-ad10-4438-904a-fcff62fb8c4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:31.273194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4bead5a-ad10-4438-904a-fcff62fb8c4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:31.273620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4bead5a-ad10-4438-904a-fcff62fb8c4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:31.430905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a4bead5a-ad10-4438-904a-fcff62fb8c4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:31.439382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a4bead5a-ad10-4438-904a-fcff62fb8c4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.181376 Jun 02 19:19:31.439945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 900/1798] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:31 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:32.114898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:32.115659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:32.123357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:32.123827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:32.124713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:32.125167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:32.193643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:32.202406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:32.205472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:32.205472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92102f43-e063-4602-b80b-bc45d7f43eb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094913 Jun 02 19:19:32.206253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 899/1799] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:19:32.464106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b0ef4a6a-2ac1-4859-9f14-77438fa9e700 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:32.465018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b0ef4a6a-2ac1-4859-9f14-77438fa9e700 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:32.473611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0ef4a6a-2ac1-4859-9f14-77438fa9e700 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:32.474086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0ef4a6a-2ac1-4859-9f14-77438fa9e700 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:32.474848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0ef4a6a-2ac1-4859-9f14-77438fa9e700 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:32.475276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0ef4a6a-2ac1-4859-9f14-77438fa9e700 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:32.612240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b0ef4a6a-2ac1-4859-9f14-77438fa9e700 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:32.621999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b0ef4a6a-2ac1-4859-9f14-77438fa9e700 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163761 Jun 02 19:19:32.622603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 901/1800] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:32 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:33.224174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:33.224925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:33.231974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:33.232429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:33.233199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:33.233640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:33.313159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:33.322476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:33.323986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:33.325134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0dd48572-9882-4c7b-b39f-c470e9ca1088 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105003 Jun 02 19:19:33.325681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 900/1801] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:33.644632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6a79e935-4a5b-439c-9638-d906256c9f05 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:33.645250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6a79e935-4a5b-439c-9638-d906256c9f05 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:33.652649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a79e935-4a5b-439c-9638-d906256c9f05 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:33.653084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a79e935-4a5b-439c-9638-d906256c9f05 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:33.653891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a79e935-4a5b-439c-9638-d906256c9f05 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:33.654462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a79e935-4a5b-439c-9638-d906256c9f05 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:33.794952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6a79e935-4a5b-439c-9638-d906256c9f05 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:33.803971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6a79e935-4a5b-439c-9638-d906256c9f05 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163919 Jun 02 19:19:33.804540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 902/1802] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:33 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:34.346624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:34.347416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:34.357567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:34.358218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:34.359336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:34.359956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:34.430079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:34.440209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:34.442820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:34.444450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eaeb8041-19fd-4616-8287-6dfcc09bcf47 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104373 Jun 02 19:19:34.454025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 901/1803] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:34.821564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0da5eba7-c0fb-411f-92ab-b59f1cb98209 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:34.822306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0da5eba7-c0fb-411f-92ab-b59f1cb98209 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:34.829283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0da5eba7-c0fb-411f-92ab-b59f1cb98209 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:34.829826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0da5eba7-c0fb-411f-92ab-b59f1cb98209 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:34.830636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0da5eba7-c0fb-411f-92ab-b59f1cb98209 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:34.831069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0da5eba7-c0fb-411f-92ab-b59f1cb98209 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:34.998512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0da5eba7-c0fb-411f-92ab-b59f1cb98209 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:35.010875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0da5eba7-c0fb-411f-92ab-b59f1cb98209 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.193061 Jun 02 19:19:35.011624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 903/1804] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:34 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:35.463918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:35.464525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:35.471664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:35.472113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:35.472889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:35.473324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:35.492866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:35.540424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:35.549591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:35.551147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:35.552306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a73ca4eb-b5da-4c7c-9f7d-95b13a40d362 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092412 Jun 02 19:19:35.553064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 902/1805] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:36.033818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3eb7c2a-9a22-481b-9341-a9d89b66b63f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:36.034436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c3eb7c2a-9a22-481b-9341-a9d89b66b63f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:36.041257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3eb7c2a-9a22-481b-9341-a9d89b66b63f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:36.041699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3eb7c2a-9a22-481b-9341-a9d89b66b63f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:36.042481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3eb7c2a-9a22-481b-9341-a9d89b66b63f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:36.042905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3eb7c2a-9a22-481b-9341-a9d89b66b63f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:36.187430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c3eb7c2a-9a22-481b-9341-a9d89b66b63f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:36.197245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3eb7c2a-9a22-481b-9341-a9d89b66b63f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169891 Jun 02 19:19:36.197832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 904/1806] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:36 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:36.571120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:36.571845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:36.578780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:36.579261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:36.580081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:36.580625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:36.648238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:36.657093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:36.658614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:36.659790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-36dd494f-1515-4fd8-aec0-f0e0e8522792 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093093 Jun 02 19:19:36.660326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 903/1807] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:37.219233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-565236d4-529e-45df-926f-f6dafe813061 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:37.220060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-565236d4-529e-45df-926f-f6dafe813061 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:37.231718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-565236d4-529e-45df-926f-f6dafe813061 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:37.232448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-565236d4-529e-45df-926f-f6dafe813061 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:37.233651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-565236d4-529e-45df-926f-f6dafe813061 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:37.234440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-565236d4-529e-45df-926f-f6dafe813061 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:37.372092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-565236d4-529e-45df-926f-f6dafe813061 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:37.380810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-565236d4-529e-45df-926f-f6dafe813061 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168195 Jun 02 19:19:37.381416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 905/1808] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:37 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:37.679045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:37.679703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:37.686763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:37.687228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:37.688008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:37.688451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:37.764004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:37.773528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:37.775089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:37.776240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-62a70374-28f4-48bf-a4a6-65e27ece51e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101279 Jun 02 19:19:37.776786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 904/1809] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:38.398263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edf8b728-e643-418e-b7ec-06e37db2c568 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:38.398818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-edf8b728-e643-418e-b7ec-06e37db2c568 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:38.406127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edf8b728-e643-418e-b7ec-06e37db2c568 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:38.406573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edf8b728-e643-418e-b7ec-06e37db2c568 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:38.407307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edf8b728-e643-418e-b7ec-06e37db2c568 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:38.407753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edf8b728-e643-418e-b7ec-06e37db2c568 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:38.555656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-edf8b728-e643-418e-b7ec-06e37db2c568 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:38.557945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:38.565199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-edf8b728-e643-418e-b7ec-06e37db2c568 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.170876 Jun 02 19:19:38.565871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 906/1810] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:38 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:38.797140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:38.797785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:38.805495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:38.806167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:38.807386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:38.808062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:38.879724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:38.888589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:38.890124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:38.891278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6311d152-fb81-44be-8e39-4627811fcb45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099486 Jun 02 19:19:38.891808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 905/1811] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:39.583087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9621f09-a45d-4de8-aa08-c3f2a72ee31e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:39.583712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9621f09-a45d-4de8-aa08-c3f2a72ee31e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:39.590952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9621f09-a45d-4de8-aa08-c3f2a72ee31e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:39.591401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9621f09-a45d-4de8-aa08-c3f2a72ee31e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:39.592166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9621f09-a45d-4de8-aa08-c3f2a72ee31e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:39.592596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9621f09-a45d-4de8-aa08-c3f2a72ee31e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:39.732656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9621f09-a45d-4de8-aa08-c3f2a72ee31e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:39.741534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9621f09-a45d-4de8-aa08-c3f2a72ee31e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162549 Jun 02 19:19:39.742159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 907/1812] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:39 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:39.914928 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:39.915991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:39.927491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:39.928412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:39.930103 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:39.930894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:40.019932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:40.031331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:40.033654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:40.035357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-09600f2f-fba1-4feb-8f30-8258123dfe28 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.128152 Jun 02 19:19:40.036114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 906/1813] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:40.759488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-605f05e3-cc2b-49f9-a6a1-fe1c5c6f0aa2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:40.760064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-605f05e3-cc2b-49f9-a6a1-fe1c5c6f0aa2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:40.767462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-605f05e3-cc2b-49f9-a6a1-fe1c5c6f0aa2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:40.767913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-605f05e3-cc2b-49f9-a6a1-fe1c5c6f0aa2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:40.768662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-605f05e3-cc2b-49f9-a6a1-fe1c5c6f0aa2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:40.769086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-605f05e3-cc2b-49f9-a6a1-fe1c5c6f0aa2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:40.927635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-605f05e3-cc2b-49f9-a6a1-fe1c5c6f0aa2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:40.936568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-605f05e3-cc2b-49f9-a6a1-fe1c5c6f0aa2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.181031 Jun 02 19:19:40.937124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 908/1814] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:40 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:41.054118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:41.054729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:41.062203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:41.062665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:41.063478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:41.063987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:41.130384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:41.140236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:41.141745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:41.142917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1125b707-2697-4a99-a675-1e6e456f7431 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093524 Jun 02 19:19:41.143464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 907/1815] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:41.953928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b309c61b-e7cc-40c1-95f7-ba6f236a51ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:41.955212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b309c61b-e7cc-40c1-95f7-ba6f236a51ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:41.968969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b309c61b-e7cc-40c1-95f7-ba6f236a51ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:41.969708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b309c61b-e7cc-40c1-95f7-ba6f236a51ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:41.970998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b309c61b-e7cc-40c1-95f7-ba6f236a51ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:41.971711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b309c61b-e7cc-40c1-95f7-ba6f236a51ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:42.114916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b309c61b-e7cc-40c1-95f7-ba6f236a51ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:42.123429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b309c61b-e7cc-40c1-95f7-ba6f236a51ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173452 Jun 02 19:19:42.123996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 909/1816] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:41 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:42.161842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:42.162454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:42.169677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:42.170170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:42.170937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:42.171372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:42.244524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:42.257756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:42.259348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:42.260510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2c356454-c487-4531-858e-b39a5d801a2f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102713 Jun 02 19:19:42.261076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 908/1817] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:43.144918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-da10c2bf-94d1-4500-a409-ac22feba6dd8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:43.145665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-da10c2bf-94d1-4500-a409-ac22feba6dd8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:43.153343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da10c2bf-94d1-4500-a409-ac22feba6dd8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:43.153823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da10c2bf-94d1-4500-a409-ac22feba6dd8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:43.154591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da10c2bf-94d1-4500-a409-ac22feba6dd8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:43.155029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da10c2bf-94d1-4500-a409-ac22feba6dd8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:43.278257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:43.278883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:43.285785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:43.286278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:43.287066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:43.287477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:43.303934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-da10c2bf-94d1-4500-a409-ac22feba6dd8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:43.315557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-da10c2bf-94d1-4500-a409-ac22feba6dd8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175142 Jun 02 19:19:43.316506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 910/1818] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:43 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:43.357528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:43.366506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:43.368100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:43.370176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2ccd64b7-b586-4cf5-8c0b-79f9b83c6c34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095970 Jun 02 19:19:43.370744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 909/1819] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:44.332800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-77896605-949f-4eeb-b4ae-9609bb148e42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:44.333407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-77896605-949f-4eeb-b4ae-9609bb148e42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:44.340607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77896605-949f-4eeb-b4ae-9609bb148e42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:44.341062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77896605-949f-4eeb-b4ae-9609bb148e42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:44.341829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77896605-949f-4eeb-b4ae-9609bb148e42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:44.342310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77896605-949f-4eeb-b4ae-9609bb148e42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:44.394289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:44.394897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:44.401979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:44.402433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:44.403212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:44.403779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:44.481353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:44.490178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:44.491681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:44.493479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-76db7900-c484-4caf-982a-60593e48d28b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103191 Jun 02 19:19:44.494113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 910/1820] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:44.507879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-77896605-949f-4eeb-b4ae-9609bb148e42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:44.520693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-77896605-949f-4eeb-b4ae-9609bb148e42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.191695 Jun 02 19:19:44.521543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 911/1821] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:44 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:45.515546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:45.516174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:45.523148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:45.523606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:45.524487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:45.524926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:45.543090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d48c6c97-c9b2-4f9c-8755-5e8259921c06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:45.543739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d48c6c97-c9b2-4f9c-8755-5e8259921c06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:45.550825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d48c6c97-c9b2-4f9c-8755-5e8259921c06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:45.551264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d48c6c97-c9b2-4f9c-8755-5e8259921c06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:45.552123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d48c6c97-c9b2-4f9c-8755-5e8259921c06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:45.552554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d48c6c97-c9b2-4f9c-8755-5e8259921c06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:45.598685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:45.607998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:45.609527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:45.610796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-72a2671e-f773-41ba-aeb6-2935c01a331d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101502 Jun 02 19:19:45.611478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 911/1822] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:45.692713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d48c6c97-c9b2-4f9c-8755-5e8259921c06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:45.701594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d48c6c97-c9b2-4f9c-8755-5e8259921c06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162421 Jun 02 19:19:45.702196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 912/1823] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:45 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:46.628838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:46.629456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:46.636684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:46.637133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:46.637933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:46.638418 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:46.706551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:46.715472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:46.716966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:46.718142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-739b1294-87d6-468c-8cf5-8cbb1c08fd9b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093235 Jun 02 19:19:46.718682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 912/1824] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:46.728515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3439ad3e-9156-437b-a394-58bc5eb3f55f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:46.728515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3439ad3e-9156-437b-a394-58bc5eb3f55f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:46.728515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3439ad3e-9156-437b-a394-58bc5eb3f55f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:46.728515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3439ad3e-9156-437b-a394-58bc5eb3f55f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:46.729245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3439ad3e-9156-437b-a394-58bc5eb3f55f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:46.729341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3439ad3e-9156-437b-a394-58bc5eb3f55f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:46.875761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3439ad3e-9156-437b-a394-58bc5eb3f55f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:46.885164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3439ad3e-9156-437b-a394-58bc5eb3f55f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169445 Jun 02 19:19:46.885821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 913/1825] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:46 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:19:47.736814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:47.737387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:47.744086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:47.744538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:47.745298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:47.745734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:47.822168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:47.831303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:47.832797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:47.833978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c92e1a6f-4b74-45eb-add4-0db10b08ed97 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101265 Jun 02 19:19:47.834532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 913/1826] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:47.904548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7ea5e6a5-6b75-4298-8c19-16875a905b44 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:47.905140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7ea5e6a5-6b75-4298-8c19-16875a905b44 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:47.912110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ea5e6a5-6b75-4298-8c19-16875a905b44 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:47.912558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ea5e6a5-6b75-4298-8c19-16875a905b44 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:47.913315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ea5e6a5-6b75-4298-8c19-16875a905b44 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:47.913749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ea5e6a5-6b75-4298-8c19-16875a905b44 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:48.070194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7ea5e6a5-6b75-4298-8c19-16875a905b44 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:48.078744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7ea5e6a5-6b75-4298-8c19-16875a905b44 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179776 Jun 02 19:19:48.079312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 914/1827] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:47 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:48.859823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:48.860636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:48.872364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:48.872815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:48.873588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:48.874049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:48.945735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:48.954995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:48.956503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:48.957652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6d8c563b-a59d-41f2-8cc2-b2311e2780cb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105353 Jun 02 19:19:48.958260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 914/1828] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:49.095714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d335fa6b-5c24-4d35-b8b4-a0a3c5829e08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:49.096427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d335fa6b-5c24-4d35-b8b4-a0a3c5829e08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:49.103315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d335fa6b-5c24-4d35-b8b4-a0a3c5829e08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:49.103770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d335fa6b-5c24-4d35-b8b4-a0a3c5829e08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:49.104535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d335fa6b-5c24-4d35-b8b4-a0a3c5829e08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:49.104970 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d335fa6b-5c24-4d35-b8b4-a0a3c5829e08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:49.246756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d335fa6b-5c24-4d35-b8b4-a0a3c5829e08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:49.255064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d335fa6b-5c24-4d35-b8b4-a0a3c5829e08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163269 Jun 02 19:19:49.255763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 915/1829] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:49 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:49.976398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:49.977043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:49.984792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:49.985261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:49.986080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:49.986523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:50.053236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:50.064287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:50.065831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:50.067322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-943c1866-fce7-4712-8d24-652009ab06d7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095164 Jun 02 19:19:50.067879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 915/1830] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:50.272629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b4e386f2-8862-4529-8d5b-ed2b9f6aaaae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:50.273225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b4e386f2-8862-4529-8d5b-ed2b9f6aaaae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:50.280211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4e386f2-8862-4529-8d5b-ed2b9f6aaaae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:50.280664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4e386f2-8862-4529-8d5b-ed2b9f6aaaae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:50.281419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4e386f2-8862-4529-8d5b-ed2b9f6aaaae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:50.281887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4e386f2-8862-4529-8d5b-ed2b9f6aaaae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:50.425329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b4e386f2-8862-4529-8d5b-ed2b9f6aaaae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:50.433883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b4e386f2-8862-4529-8d5b-ed2b9f6aaaae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165196 Jun 02 19:19:50.434499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 916/1831] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:50 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:51.092999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:51.093613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:51.101038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:51.101532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:51.102329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:51.102777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:51.181066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:51.195115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:51.197527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:51.199343 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ccf74919-e79d-4a1a-8913-d50d210f1f5e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110581 Jun 02 19:19:51.200134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 916/1832] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:51.458318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-50d4726e-2e60-428d-ae29-93d524dfd92e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:51.459040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-50d4726e-2e60-428d-ae29-93d524dfd92e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:51.466119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50d4726e-2e60-428d-ae29-93d524dfd92e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:51.466566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50d4726e-2e60-428d-ae29-93d524dfd92e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:51.467432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50d4726e-2e60-428d-ae29-93d524dfd92e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:51.467910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50d4726e-2e60-428d-ae29-93d524dfd92e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:51.618755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-50d4726e-2e60-428d-ae29-93d524dfd92e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:51.627458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-50d4726e-2e60-428d-ae29-93d524dfd92e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173474 Jun 02 19:19:51.628053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 917/1833] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:51 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:52.219689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:52.220455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:52.228683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:52.229231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:52.230176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:52.230750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:52.306321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:52.315562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:52.317911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:52.319061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a47f395e-1eac-4695-95b7-311d5b67acc8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104656 Jun 02 19:19:52.319868 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 917/1834] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:52.647562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd56e4b6-1909-4182-87fd-1a05e48b1226 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:52.648160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fd56e4b6-1909-4182-87fd-1a05e48b1226 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:52.658492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd56e4b6-1909-4182-87fd-1a05e48b1226 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:52.659109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd56e4b6-1909-4182-87fd-1a05e48b1226 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:52.660205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd56e4b6-1909-4182-87fd-1a05e48b1226 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:52.660836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd56e4b6-1909-4182-87fd-1a05e48b1226 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:52.822306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fd56e4b6-1909-4182-87fd-1a05e48b1226 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:52.832076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd56e4b6-1909-4182-87fd-1a05e48b1226 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.190075 Jun 02 19:19:52.832733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 918/1835] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:52 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:53.345513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:53.346143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:53.353175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:53.353634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:53.354438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:53.355008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:53.421980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:53.431196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:53.432703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:53.433918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-26e885e5-b7c3-4c52-adc6-d1700b1cd57d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093768 Jun 02 19:19:53.434503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 918/1836] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:53.855704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-337a4f9a-9043-4051-b369-886b87b651d6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:53.856523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-337a4f9a-9043-4051-b369-886b87b651d6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:53.866040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-337a4f9a-9043-4051-b369-886b87b651d6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:53.866676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-337a4f9a-9043-4051-b369-886b87b651d6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:53.867766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-337a4f9a-9043-4051-b369-886b87b651d6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:53.868382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-337a4f9a-9043-4051-b369-886b87b651d6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:54.019648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-337a4f9a-9043-4051-b369-886b87b651d6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:54.029129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-337a4f9a-9043-4051-b369-886b87b651d6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179869 Jun 02 19:19:54.029890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 919/1837] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:53 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:54.454649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:54.455963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:54.465054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:54.465518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:54.466321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:54.466762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:54.471883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:54.540969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:54.553516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:54.555971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:54.557669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-57648091-c932-4237-8cda-17f3bddbd6b0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.107766 Jun 02 19:19:54.558304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 919/1838] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:55.049919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4c7eed19-fc9f-401b-abf3-566b47b40d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:55.050494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4c7eed19-fc9f-401b-abf3-566b47b40d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:55.057504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4c7eed19-fc9f-401b-abf3-566b47b40d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:55.057978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4c7eed19-fc9f-401b-abf3-566b47b40d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:55.058743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4c7eed19-fc9f-401b-abf3-566b47b40d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:55.059170 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4c7eed19-fc9f-401b-abf3-566b47b40d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:55.201152 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4c7eed19-fc9f-401b-abf3-566b47b40d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:55.214834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4c7eed19-fc9f-401b-abf3-566b47b40d36 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.170234 Jun 02 19:19:55.215683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 920/1839] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:55 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:55.261713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:19:55.261965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:19:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:19:55.580345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:55.581036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:55.588044 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:55.588507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:55.589280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:55.589722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:55.661982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:55.670941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:55.672498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:55.673965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a61a96cd-ba9f-4da4-bf3d-965ca1c83f71 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099436 Jun 02 19:19:55.674546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 920/1840] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:56.236661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b33d58c0-b89a-43b0-b947-1cb4dc6c797e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:56.237371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b33d58c0-b89a-43b0-b947-1cb4dc6c797e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:56.248231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b33d58c0-b89a-43b0-b947-1cb4dc6c797e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:56.248967 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b33d58c0-b89a-43b0-b947-1cb4dc6c797e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:56.250255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b33d58c0-b89a-43b0-b947-1cb4dc6c797e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:56.250944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b33d58c0-b89a-43b0-b947-1cb4dc6c797e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:56.392182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b33d58c0-b89a-43b0-b947-1cb4dc6c797e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:56.400843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b33d58c0-b89a-43b0-b947-1cb4dc6c797e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169821 Jun 02 19:19:56.401409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 921/1841] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:56 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:56.695154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:56.695791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:56.702522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:56.702981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:56.703808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:56.704269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:56.769501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:56.778631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:56.780120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:56.781265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f069ba90-56f1-4663-9948-c570b5f3f334 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091701 Jun 02 19:19:56.781821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 921/1842] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:57.419731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-539e8d77-b694-44f9-8e55-6afa0575fce9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:57.420370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-539e8d77-b694-44f9-8e55-6afa0575fce9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:57.427060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-539e8d77-b694-44f9-8e55-6afa0575fce9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:57.427509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-539e8d77-b694-44f9-8e55-6afa0575fce9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:57.428262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-539e8d77-b694-44f9-8e55-6afa0575fce9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:57.428692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-539e8d77-b694-44f9-8e55-6afa0575fce9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:57.581303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-539e8d77-b694-44f9-8e55-6afa0575fce9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:57.589462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-539e8d77-b694-44f9-8e55-6afa0575fce9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173640 Jun 02 19:19:57.590042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 922/1843] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:57 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:57.803761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:57.804573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:57.811106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:57.811566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:57.812380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:57.812820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:57.885306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:57.895201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:57.896701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:57.897867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3a6df231-9c4b-4373-8604-7e1583d91b34 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100730 Jun 02 19:19:57.898480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 922/1844] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:58.607178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d029c7e1-fd93-4220-b19f-94c910b7c799 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:58.607804 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d029c7e1-fd93-4220-b19f-94c910b7c799 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:58.610041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=54 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:58.615719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d029c7e1-fd93-4220-b19f-94c910b7c799 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:58.616173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d029c7e1-fd93-4220-b19f-94c910b7c799 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:58.616938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d029c7e1-fd93-4220-b19f-94c910b7c799 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:58.617368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d029c7e1-fd93-4220-b19f-94c910b7c799 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:58.635164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:58.752072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d029c7e1-fd93-4220-b19f-94c910b7c799 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:58.764546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d029c7e1-fd93-4220-b19f-94c910b7c799 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161145 Jun 02 19:19:58.765323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 923/1845] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:58 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:19:58.924693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:58.925345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:58.927893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=56 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:58.935269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:58.935916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:58.937069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:58.937667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:59.007052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:59.017144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:59.019143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:59.020933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e1386c74-0ba7-4ff5-8eb3-ff9d1b68671f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102627 Jun 02 19:19:59.021497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 923/1846] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:19:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:19:59.785233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-67253c2e-a082-4530-b1cf-112eb5f256ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:19:59.786244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-67253c2e-a082-4530-b1cf-112eb5f256ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:19:59.795090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67253c2e-a082-4530-b1cf-112eb5f256ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:59.795539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67253c2e-a082-4530-b1cf-112eb5f256ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:59.796301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67253c2e-a082-4530-b1cf-112eb5f256ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:19:59.796703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67253c2e-a082-4530-b1cf-112eb5f256ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:19:59.932774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67253c2e-a082-4530-b1cf-112eb5f256ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:19:59.946589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-67253c2e-a082-4530-b1cf-112eb5f256ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167113 Jun 02 19:19:59.947170 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 924/1847] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:19:59 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:00.046288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:00.047059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:00.055379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:00.055806 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:00.056544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:00.057159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:00.124875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:00.137117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:00.139498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:00.141140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0439d7c6-30ea-4600-adbf-229d804dd139 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099834 Jun 02 19:20:00.141837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 924/1848] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:00.964997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0edfc24b-7fb6-4d2c-8539-45efb138bdff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:00.965560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0edfc24b-7fb6-4d2c-8539-45efb138bdff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:00.972476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0edfc24b-7fb6-4d2c-8539-45efb138bdff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:00.972929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0edfc24b-7fb6-4d2c-8539-45efb138bdff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:00.973689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0edfc24b-7fb6-4d2c-8539-45efb138bdff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:00.974146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0edfc24b-7fb6-4d2c-8539-45efb138bdff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:01.114300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0edfc24b-7fb6-4d2c-8539-45efb138bdff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:01.126130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0edfc24b-7fb6-4d2c-8539-45efb138bdff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165230 Jun 02 19:20:01.126824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 925/1849] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:00 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:01.160531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:01.161116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:01.168586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:01.169076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:01.169882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:01.170322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:01.245823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:01.254855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:01.256336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:01.257487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1124bad2-f520-4759-92dd-e6836365dde0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100929 Jun 02 19:20:01.258165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 925/1850] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:02.147226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f8c3ed81-5d35-42f4-92f7-0dca4678d77c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:02.148164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f8c3ed81-5d35-42f4-92f7-0dca4678d77c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:02.155969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8c3ed81-5d35-42f4-92f7-0dca4678d77c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:02.156420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8c3ed81-5d35-42f4-92f7-0dca4678d77c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:02.157186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8c3ed81-5d35-42f4-92f7-0dca4678d77c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:02.157610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8c3ed81-5d35-42f4-92f7-0dca4678d77c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:02.276006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:02.276623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:02.284227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:02.284683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:02.285462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:02.285929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:02.293348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f8c3ed81-5d35-42f4-92f7-0dca4678d77c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:02.301466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f8c3ed81-5d35-42f4-92f7-0dca4678d77c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160723 Jun 02 19:20:02.301991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 926/1851] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:02 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:02.354167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:02.362780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:02.364279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:02.365431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ff0ecaa3-4bbf-447e-860b-1b3a90d380df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093590 Jun 02 19:20:02.366223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 926/1852] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:03.323095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8d8d882b-4b55-4846-b8a0-82c732012fef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:03.323723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8d8d882b-4b55-4846-b8a0-82c732012fef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:03.330981 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d8d882b-4b55-4846-b8a0-82c732012fef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:03.331405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d8d882b-4b55-4846-b8a0-82c732012fef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:03.332189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d8d882b-4b55-4846-b8a0-82c732012fef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:03.332616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d8d882b-4b55-4846-b8a0-82c732012fef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:03.383985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:03.384843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:03.391757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:03.392288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:03.393132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:03.393556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:03.476457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:03.486488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:03.488000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:03.489161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5a04f315-95dc-4da8-900f-f1aaaa1c4169 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.109144 Jun 02 19:20:03.489715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 927/1853] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:03.498458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8d8d882b-4b55-4846-b8a0-82c732012fef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:03.507263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8d8d882b-4b55-4846-b8a0-82c732012fef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.190795 Jun 02 19:20:03.507829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 927/1854] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:03 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:04.507477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:04.508215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:04.515404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:04.515867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:04.516649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:04.517123 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:04.524342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-35f42095-ce71-4215-aeae-1a2e993e38fd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:04.524921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-35f42095-ce71-4215-aeae-1a2e993e38fd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:04.532052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35f42095-ce71-4215-aeae-1a2e993e38fd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:04.532823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35f42095-ce71-4215-aeae-1a2e993e38fd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:04.533918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35f42095-ce71-4215-aeae-1a2e993e38fd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:04.534053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35f42095-ce71-4215-aeae-1a2e993e38fd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:04.592977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:04.601582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:04.603174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:04.604376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-afede556-bb17-4698-b98d-99175cd2a93e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100904 Jun 02 19:20:04.613599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 928/1855] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:04.684777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-35f42095-ce71-4215-aeae-1a2e993e38fd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:04.693472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-35f42095-ce71-4215-aeae-1a2e993e38fd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173098 Jun 02 19:20:04.694083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 928/1856] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:04 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:05.626089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:05.627167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:05.637234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:05.637689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:05.638493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:05.638932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:05.710427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:05.711922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f8ee92ed-d077-4009-84f8-a02199737417 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:05.712531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f8ee92ed-d077-4009-84f8-a02199737417 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:05.719703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:05.720102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8ee92ed-d077-4009-84f8-a02199737417 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:05.720540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8ee92ed-d077-4009-84f8-a02199737417 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:05.721197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:05.721350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8ee92ed-d077-4009-84f8-a02199737417 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:05.721709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f8ee92ed-d077-4009-84f8-a02199737417 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:05.722373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b6888c5e-53e6-4673-88e7-8e40e7e929c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102942 Jun 02 19:20:05.722943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 929/1857] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:05.855908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f8ee92ed-d077-4009-84f8-a02199737417 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:05.864480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f8ee92ed-d077-4009-84f8-a02199737417 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.157162 Jun 02 19:20:05.865063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 929/1858] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:05 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:06.740949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:06.741563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:06.749075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:06.749524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:06.750309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:06.750793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:06.821412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:06.830212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:06.831729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:06.832869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6c10013b-2987-4ac3-bf42-44ca058326a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095958 Jun 02 19:20:06.833425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 930/1859] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:06.886914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-322e3f71-58a9-492f-8f34-303ecb822157 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:06.887881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-322e3f71-58a9-492f-8f34-303ecb822157 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:06.899085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-322e3f71-58a9-492f-8f34-303ecb822157 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:06.899784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-322e3f71-58a9-492f-8f34-303ecb822157 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:06.900998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-322e3f71-58a9-492f-8f34-303ecb822157 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:06.901667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-322e3f71-58a9-492f-8f34-303ecb822157 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:07.036166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-322e3f71-58a9-492f-8f34-303ecb822157 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:07.045029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-322e3f71-58a9-492f-8f34-303ecb822157 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.164455 Jun 02 19:20:07.045577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 930/1860] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:06 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:07.855997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:07.856629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:07.864484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:07.864988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:07.865846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:07.866348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:07.930261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:07.940744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:07.942601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:07.943753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b73c6a9d-04f2-4a2b-ab4f-e949b0bb8536 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094803 Jun 02 19:20:07.944302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 931/1861] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:08.063986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fc0e9670-2091-4cf1-a370-ca5440a7f873 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:08.064571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fc0e9670-2091-4cf1-a370-ca5440a7f873 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:08.072122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc0e9670-2091-4cf1-a370-ca5440a7f873 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:08.072572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc0e9670-2091-4cf1-a370-ca5440a7f873 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:08.073338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc0e9670-2091-4cf1-a370-ca5440a7f873 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:08.073777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc0e9670-2091-4cf1-a370-ca5440a7f873 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:08.211887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fc0e9670-2091-4cf1-a370-ca5440a7f873 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:08.220278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fc0e9670-2091-4cf1-a370-ca5440a7f873 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160320 Jun 02 19:20:08.220858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 931/1862] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:08 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:08.965258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:08.966130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:08.973035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:08.973493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:08.974295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:08.974729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:09.045517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:09.054287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:09.055896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:09.057029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6c0e0e2b-db7d-439a-9047-dc98914c3f56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097991 Jun 02 19:20:09.057584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 932/1863] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:09.245589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cbeaaddc-fedc-4f74-a3ae-528900a547ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:09.246585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cbeaaddc-fedc-4f74-a3ae-528900a547ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:09.257489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbeaaddc-fedc-4f74-a3ae-528900a547ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:09.258289 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbeaaddc-fedc-4f74-a3ae-528900a547ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:09.259549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbeaaddc-fedc-4f74-a3ae-528900a547ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:09.260267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbeaaddc-fedc-4f74-a3ae-528900a547ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:09.403051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cbeaaddc-fedc-4f74-a3ae-528900a547ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:09.411322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cbeaaddc-fedc-4f74-a3ae-528900a547ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172468 Jun 02 19:20:09.411886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 932/1864] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:09 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:10.077769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:10.078567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:10.087558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:10.088195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:10.089207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:10.089824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:10.159083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:10.171194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:10.172688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:10.173930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0ea60931-7244-44bd-a122-8a9992695264 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101645 Jun 02 19:20:10.174481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 933/1865] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:10.431646 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8b476cf1-4e5d-44a5-b730-b503cddde20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:10.432239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8b476cf1-4e5d-44a5-b730-b503cddde20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:10.439501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b476cf1-4e5d-44a5-b730-b503cddde20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:10.439944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b476cf1-4e5d-44a5-b730-b503cddde20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:10.440699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b476cf1-4e5d-44a5-b730-b503cddde20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:10.441127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b476cf1-4e5d-44a5-b730-b503cddde20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:10.578360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8b476cf1-4e5d-44a5-b730-b503cddde20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:10.586564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8b476cf1-4e5d-44a5-b730-b503cddde20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.158846 Jun 02 19:20:10.587141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 933/1866] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:10 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:10.968364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:20:10.968536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:20:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:20:11.197992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:11.198609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:11.207218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:11.207665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:11.208441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:11.208881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:11.289930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:11.302346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:11.304845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:11.306814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-229f316f-aed4-4527-85d0-56d16d7e97af tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.113250 Jun 02 19:20:11.307682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 934/1867] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:11.608171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5d0c86ec-6058-470e-9ab9-27ec2e8d59ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:11.608727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5d0c86ec-6058-470e-9ab9-27ec2e8d59ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:11.615689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d0c86ec-6058-470e-9ab9-27ec2e8d59ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:11.616148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d0c86ec-6058-470e-9ab9-27ec2e8d59ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:11.616903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d0c86ec-6058-470e-9ab9-27ec2e8d59ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:11.617336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d0c86ec-6058-470e-9ab9-27ec2e8d59ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:11.759989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5d0c86ec-6058-470e-9ab9-27ec2e8d59ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:11.769342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5d0c86ec-6058-470e-9ab9-27ec2e8d59ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167849 Jun 02 19:20:11.769950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 934/1868] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:11 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:12.327524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:12.328153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:12.335186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:12.335641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:12.336411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:12.336857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:12.412112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:12.415609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:12.421198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:12.422721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:12.423865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c0f13a62-4029-4fbb-9549-6d05b207fd06 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101155 Jun 02 19:20:12.424423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 935/1869] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:12.790931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-46137da1-882d-46ea-b47f-3ddfc64d9d59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:12.791941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-46137da1-882d-46ea-b47f-3ddfc64d9d59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:12.803900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-46137da1-882d-46ea-b47f-3ddfc64d9d59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:12.804669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-46137da1-882d-46ea-b47f-3ddfc64d9d59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:12.806036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-46137da1-882d-46ea-b47f-3ddfc64d9d59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:12.806745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-46137da1-882d-46ea-b47f-3ddfc64d9d59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:12.957259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-46137da1-882d-46ea-b47f-3ddfc64d9d59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:12.970430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-46137da1-882d-46ea-b47f-3ddfc64d9d59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.185743 Jun 02 19:20:12.971140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 935/1870] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:12 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:13.450272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:13.451796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:13.467248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:13.467912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:13.469054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:13.469705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:13.545273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:13.555898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:13.557745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:13.559240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d1a89964-dce4-4d2d-9b24-7d383f1016bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.119313 Jun 02 19:20:13.559793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 936/1871] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:13.992348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5a99c68b-51b9-4ff7-b9a5-00860f2c16e5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:13.992936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5a99c68b-51b9-4ff7-b9a5-00860f2c16e5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:14.000358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a99c68b-51b9-4ff7-b9a5-00860f2c16e5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:14.000802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a99c68b-51b9-4ff7-b9a5-00860f2c16e5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:14.001565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a99c68b-51b9-4ff7-b9a5-00860f2c16e5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:14.002016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a99c68b-51b9-4ff7-b9a5-00860f2c16e5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:14.166621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5a99c68b-51b9-4ff7-b9a5-00860f2c16e5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:14.179497 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5a99c68b-51b9-4ff7-b9a5-00860f2c16e5 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.190819 Jun 02 19:20:14.180343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 936/1872] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:13 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:14.578792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:14.579421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:14.586659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:14.587464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:14.588347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:14.588782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:14.657562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:14.666849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:14.668337 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:14.669483 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-024c022d-13c4-45a9-abc8-f78053218c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095476 Jun 02 19:20:14.670058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 937/1873] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:15.213871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9a7f015d-fcf6-4643-9411-945e890500b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:15.214914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9a7f015d-fcf6-4643-9411-945e890500b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:15.226535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a7f015d-fcf6-4643-9411-945e890500b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:15.227271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a7f015d-fcf6-4643-9411-945e890500b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:15.228643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a7f015d-fcf6-4643-9411-945e890500b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:15.229355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9a7f015d-fcf6-4643-9411-945e890500b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:15.366699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9a7f015d-fcf6-4643-9411-945e890500b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:15.375360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9a7f015d-fcf6-4643-9411-945e890500b4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168141 Jun 02 19:20:15.375937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 937/1874] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:15 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:15.689779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:15.690689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:15.697824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:15.698296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:15.699063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:15.699498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:15.772608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:15.784032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:15.785610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:15.786818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f2a7f809-4f97-4fc2-886e-1aa018b99805 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102749 Jun 02 19:20:15.787375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 938/1875] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:16.396589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16e6f413-126e-473b-b9e2-f77a73824999 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:16.397635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-16e6f413-126e-473b-b9e2-f77a73824999 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:16.407371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16e6f413-126e-473b-b9e2-f77a73824999 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:16.407816 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16e6f413-126e-473b-b9e2-f77a73824999 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:16.408585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16e6f413-126e-473b-b9e2-f77a73824999 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:16.409011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16e6f413-126e-473b-b9e2-f77a73824999 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:16.571150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-16e6f413-126e-473b-b9e2-f77a73824999 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:16.580083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16e6f413-126e-473b-b9e2-f77a73824999 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.189988 Jun 02 19:20:16.580658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 938/1876] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:16 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:16.816094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:16.817441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:16.828013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:16.828493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:16.829287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:16.829724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:16.900848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:16.913363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:16.915314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:16.916857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c6c0787f-3cc2-47f2-a9a1-218416b435f0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.107441 Jun 02 19:20:16.917552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 939/1877] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:17.604865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-afe8daca-a0de-4cbc-9c25-51a7b069d911 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:17.605439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-afe8daca-a0de-4cbc-9c25-51a7b069d911 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:17.614270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe8daca-a0de-4cbc-9c25-51a7b069d911 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:17.614722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe8daca-a0de-4cbc-9c25-51a7b069d911 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:17.615484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe8daca-a0de-4cbc-9c25-51a7b069d911 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:17.615916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe8daca-a0de-4cbc-9c25-51a7b069d911 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:17.761988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-afe8daca-a0de-4cbc-9c25-51a7b069d911 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:17.774131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-afe8daca-a0de-4cbc-9c25-51a7b069d911 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175398 Jun 02 19:20:17.774916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 939/1878] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:17 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:17.935835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:17.936663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:17.944311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:17.944774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:17.945544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:17.946032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:18.017774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:18.026853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:18.028355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:18.029531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-21baa1ac-7c4a-42ba-8e2b-5f95ff7dd8ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097681 Jun 02 19:20:18.030126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 940/1879] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:18.795826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-67eef844-2aae-4fab-8341-adc119408b31 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:18.796673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-67eef844-2aae-4fab-8341-adc119408b31 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:18.807751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67eef844-2aae-4fab-8341-adc119408b31 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:18.808502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67eef844-2aae-4fab-8341-adc119408b31 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:18.809757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67eef844-2aae-4fab-8341-adc119408b31 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:18.810521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67eef844-2aae-4fab-8341-adc119408b31 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:18.814044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:18.952619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67eef844-2aae-4fab-8341-adc119408b31 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:18.961310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-67eef844-2aae-4fab-8341-adc119408b31 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172076 Jun 02 19:20:18.961913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 940/1880] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:18 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:19.053874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:19.054399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:19.061194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:19.061627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:19.062461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:19.062937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:19.132298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:19.144126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:19.145639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:19.146833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0845b6f0-20f1-4477-8e60-a795997b4343 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097062 Jun 02 19:20:19.147394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 941/1881] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:19.982593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e163fd99-a10a-4969-b914-13b0fac6a3ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:19.983533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e163fd99-a10a-4969-b914-13b0fac6a3ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:19.994729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e163fd99-a10a-4969-b914-13b0fac6a3ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:19.995511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e163fd99-a10a-4969-b914-13b0fac6a3ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:19.997220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e163fd99-a10a-4969-b914-13b0fac6a3ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:19.998000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e163fd99-a10a-4969-b914-13b0fac6a3ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:20.164818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:20.165440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:20.173024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:20.173608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:20.174625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:20.175069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:20.323351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:20.332505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:20.334055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:20.335215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-df95fe1e-0e5a-454e-941a-50981d689e6f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.174407 Jun 02 19:20:20.335989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 942/1882] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:20:20.385404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e163fd99-a10a-4969-b914-13b0fac6a3ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:20.395601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e163fd99-a10a-4969-b914-13b0fac6a3ea tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.419672 Jun 02 19:20:20.396178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 941/1883] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:19 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:21.354668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:21.355287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:21.363658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:21.364124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:21.364910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:21.365350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:21.412837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-674827f1-5192-41ca-838c-153e2d8bc088 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:21.413422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-674827f1-5192-41ca-838c-153e2d8bc088 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:21.420483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-674827f1-5192-41ca-838c-153e2d8bc088 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:21.420928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-674827f1-5192-41ca-838c-153e2d8bc088 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:21.421696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-674827f1-5192-41ca-838c-153e2d8bc088 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:21.422470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-674827f1-5192-41ca-838c-153e2d8bc088 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:21.440914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:21.451646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:21.453163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:21.454443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f2f6fbbf-ed3f-43ae-86a4-423396e251c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104378 Jun 02 19:20:21.455060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 943/1884] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:21.579362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-674827f1-5192-41ca-838c-153e2d8bc088 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:21.592269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-674827f1-5192-41ca-838c-153e2d8bc088 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.183164 Jun 02 19:20:21.592980 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 942/1885] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:21 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:20:22.474985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:22.475610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:22.483669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:22.483669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:22.484324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:22.484934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:22.548715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:22.557372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:22.558903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:22.560054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c80372ba-43e1-4135-812c-e7447a42c77d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.089981 Jun 02 19:20:22.560643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 944/1886] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:22.615435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4868cf4e-69be-46ed-bd37-c5c13e7b5b92 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:22.616024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4868cf4e-69be-46ed-bd37-c5c13e7b5b92 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:22.622973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4868cf4e-69be-46ed-bd37-c5c13e7b5b92 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:22.623428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4868cf4e-69be-46ed-bd37-c5c13e7b5b92 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:22.624193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4868cf4e-69be-46ed-bd37-c5c13e7b5b92 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:22.624684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4868cf4e-69be-46ed-bd37-c5c13e7b5b92 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:22.933160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4868cf4e-69be-46ed-bd37-c5c13e7b5b92 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:22.944138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4868cf4e-69be-46ed-bd37-c5c13e7b5b92 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.333737 Jun 02 19:20:22.944701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 943/1887] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:22 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:23.579504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:23.580119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:23.587542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:23.588122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:23.588888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:23.589324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:23.652603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:23.661422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:23.663144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:23.664293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eee45a84-ad4f-46e0-8518-9c632424461f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088791 Jun 02 19:20:23.664844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 945/1888] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:23.965773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4158fb6e-2ac0-45af-97c2-8ea0492444cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:23.966772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4158fb6e-2ac0-45af-97c2-8ea0492444cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:23.975825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4158fb6e-2ac0-45af-97c2-8ea0492444cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:23.976277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4158fb6e-2ac0-45af-97c2-8ea0492444cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:23.977040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4158fb6e-2ac0-45af-97c2-8ea0492444cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:23.977472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4158fb6e-2ac0-45af-97c2-8ea0492444cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:24.114018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4158fb6e-2ac0-45af-97c2-8ea0492444cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:24.125053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4158fb6e-2ac0-45af-97c2-8ea0492444cb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165504 Jun 02 19:20:24.125753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 944/1889] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:23 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:24.685680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:24.686491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:24.694942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:24.695497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:24.696274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:24.696736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:24.772827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:24.786910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:24.789249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:24.791193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9ce6f17f-e9f0-472b-8672-04d323a315f4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110238 Jun 02 19:20:24.792075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 946/1890] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:25.152439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d4f5c79c-db4d-43bd-8bc9-1004629886c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:25.153079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d4f5c79c-db4d-43bd-8bc9-1004629886c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:25.162577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4f5c79c-db4d-43bd-8bc9-1004629886c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:25.163183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4f5c79c-db4d-43bd-8bc9-1004629886c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:25.164201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4f5c79c-db4d-43bd-8bc9-1004629886c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:25.164781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4f5c79c-db4d-43bd-8bc9-1004629886c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:25.307322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d4f5c79c-db4d-43bd-8bc9-1004629886c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:25.320269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d4f5c79c-db4d-43bd-8bc9-1004629886c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171680 Jun 02 19:20:25.321023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 945/1891] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:25 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:25.818300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:25.818906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:25.826337 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:25.826819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:25.827714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:25.828177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:25.893775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:25.906877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:25.909189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:25.910853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bbd38829-54fc-4fd3-b789-f630ce8ab453 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099652 Jun 02 19:20:25.911825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 947/1892] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:26.339376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-88e87b08-d1d5-468e-be17-414e0337275a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:26.340116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-88e87b08-d1d5-468e-be17-414e0337275a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:26.354255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88e87b08-d1d5-468e-be17-414e0337275a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:26.354890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88e87b08-d1d5-468e-be17-414e0337275a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:26.355942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88e87b08-d1d5-468e-be17-414e0337275a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:26.356549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-88e87b08-d1d5-468e-be17-414e0337275a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:26.503638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-88e87b08-d1d5-468e-be17-414e0337275a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:26.516819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-88e87b08-d1d5-468e-be17-414e0337275a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.182004 Jun 02 19:20:26.517609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 946/1893] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:26 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:26.934632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:26.935634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:26.945851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:26.946328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:26.947089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:26.947525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:27.024693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:27.034237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:27.035744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:27.036955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b5df4d4c-ea23-40cd-8224-fc832f4d9e56 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.109695 Jun 02 19:20:27.038091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 948/1894] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:27.535665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-741d7ce8-a76d-4245-8617-d35a556a1f46 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:27.536294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-741d7ce8-a76d-4245-8617-d35a556a1f46 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:27.543382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-741d7ce8-a76d-4245-8617-d35a556a1f46 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:27.543829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-741d7ce8-a76d-4245-8617-d35a556a1f46 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:27.544582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-741d7ce8-a76d-4245-8617-d35a556a1f46 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:27.545016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-741d7ce8-a76d-4245-8617-d35a556a1f46 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:27.689868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-741d7ce8-a76d-4245-8617-d35a556a1f46 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:27.699627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-741d7ce8-a76d-4245-8617-d35a556a1f46 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168111 Jun 02 19:20:27.700190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 947/1895] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:27 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:28.061205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:28.061816 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:28.069467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:28.069952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:28.070854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:28.071298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:28.139674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:28.149268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:28.151023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:28.152188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d631c359-1bb1-433f-8e77-8719b55c128e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095042 Jun 02 19:20:28.152754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 949/1896] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:28.720183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92b4dbeb-ca12-4a9b-af80-796b330f8ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:28.721076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92b4dbeb-ca12-4a9b-af80-796b330f8ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:28.724625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=50 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:28.735463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92b4dbeb-ca12-4a9b-af80-796b330f8ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:28.736393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92b4dbeb-ca12-4a9b-af80-796b330f8ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:28.737606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92b4dbeb-ca12-4a9b-af80-796b330f8ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:28.738334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92b4dbeb-ca12-4a9b-af80-796b330f8ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:28.885850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-92b4dbeb-ca12-4a9b-af80-796b330f8ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:28.897987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92b4dbeb-ca12-4a9b-af80-796b330f8ffe tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.183512 Jun 02 19:20:28.899164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 948/1897] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:28 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:29.176191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:29.177142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:29.181173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:29.186853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:29.187306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:29.188067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:29.188521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:29.260478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:29.269457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:29.271002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:29.272157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f352ceab-b229-4bc9-87ee-87fa695239bd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102626 Jun 02 19:20:29.272719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 950/1898] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:29.921836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-de8bcacb-8e24-4c2f-93ce-d1a739ee90c7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:29.922558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-de8bcacb-8e24-4c2f-93ce-d1a739ee90c7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:29.930446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de8bcacb-8e24-4c2f-93ce-d1a739ee90c7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:29.930879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de8bcacb-8e24-4c2f-93ce-d1a739ee90c7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:29.931643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de8bcacb-8e24-4c2f-93ce-d1a739ee90c7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:29.932145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de8bcacb-8e24-4c2f-93ce-d1a739ee90c7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:30.088252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-de8bcacb-8e24-4c2f-93ce-d1a739ee90c7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:30.098320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-de8bcacb-8e24-4c2f-93ce-d1a739ee90c7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.180315 Jun 02 19:20:30.099131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 949/1899] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:29 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:30.291295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:30.291910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:30.298992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:30.299460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:30.300230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:30.300668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:30.366611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:30.376831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:30.379544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:30.381176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2131f9bd-5e2e-4fc6-aed9-b581e412e3db tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093707 Jun 02 19:20:30.382188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 951/1900] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:31.120142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-255376e9-943b-434e-af27-c8fafa998f7a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:31.120976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-255376e9-943b-434e-af27-c8fafa998f7a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:31.131323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-255376e9-943b-434e-af27-c8fafa998f7a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:31.131999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-255376e9-943b-434e-af27-c8fafa998f7a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:31.133486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-255376e9-943b-434e-af27-c8fafa998f7a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:31.133972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-255376e9-943b-434e-af27-c8fafa998f7a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:31.276954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-255376e9-943b-434e-af27-c8fafa998f7a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:31.285074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-255376e9-943b-434e-af27-c8fafa998f7a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171407 Jun 02 19:20:31.285635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 950/1901] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:31 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:31.404024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:31.405099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:31.415645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:31.416104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:31.416880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:31.417319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:31.440812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:31.493448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:31.502364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:31.503879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:31.505042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-30bf7c53-138f-4de2-9da4-4cb041397832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.108427 Jun 02 19:20:31.505626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 952/1902] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:32.306841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c41a8d8f-bd44-4df2-9477-70c3bd8e37c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:32.307495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c41a8d8f-bd44-4df2-9477-70c3bd8e37c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:32.316480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c41a8d8f-bd44-4df2-9477-70c3bd8e37c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:32.317004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c41a8d8f-bd44-4df2-9477-70c3bd8e37c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:32.318071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c41a8d8f-bd44-4df2-9477-70c3bd8e37c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:32.318646 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c41a8d8f-bd44-4df2-9477-70c3bd8e37c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:32.475658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c41a8d8f-bd44-4df2-9477-70c3bd8e37c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:32.488300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c41a8d8f-bd44-4df2-9477-70c3bd8e37c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.187688 Jun 02 19:20:32.489147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 951/1903] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:32 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:32.526265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:32.526891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:32.533864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:32.534321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:32.535191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:32.535543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:32.601989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:32.611419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:32.612921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:32.614092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-782fa3e4-792a-45ab-8fa4-0a5e30da0d8b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094707 Jun 02 19:20:32.614643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 953/1904] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:33.511247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4e10beab-645e-4726-9e02-36f4398d8aad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:33.511877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4e10beab-645e-4726-9e02-36f4398d8aad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:33.518939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e10beab-645e-4726-9e02-36f4398d8aad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:33.519398 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e10beab-645e-4726-9e02-36f4398d8aad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:33.520172 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e10beab-645e-4726-9e02-36f4398d8aad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:33.520613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e10beab-645e-4726-9e02-36f4398d8aad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:33.631773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:33.632397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:33.639644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:33.640109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:33.640888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:33.641335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:33.656116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4e10beab-645e-4726-9e02-36f4398d8aad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:33.664850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4e10beab-645e-4726-9e02-36f4398d8aad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160044 Jun 02 19:20:33.665682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 952/1905] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:33 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:33.707990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:33.717554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:33.719203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:33.720473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-490dbad5-8f71-43cb-8a26-7e2db04ff795 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092712 Jun 02 19:20:33.721861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 954/1906] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:34.686311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4824de3a-17d6-49a9-8df2-9441a34349e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:34.687135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4824de3a-17d6-49a9-8df2-9441a34349e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:34.695518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4824de3a-17d6-49a9-8df2-9441a34349e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:34.695971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4824de3a-17d6-49a9-8df2-9441a34349e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:34.696871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4824de3a-17d6-49a9-8df2-9441a34349e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:34.697385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4824de3a-17d6-49a9-8df2-9441a34349e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:34.738419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:34.739040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:34.747623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:34.748091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:34.748848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:34.749321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:34.826274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:34.835051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:34.836579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:34.837753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-496c9dfb-8860-4c68-b547-11b07138571c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103323 Jun 02 19:20:34.838400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 955/1907] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:34.861434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4824de3a-17d6-49a9-8df2-9441a34349e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:34.874241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4824de3a-17d6-49a9-8df2-9441a34349e3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.193854 Jun 02 19:20:34.874963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 953/1908] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:34 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:35.860955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:35.861786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:35.873016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:35.873706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:35.874914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:35.875584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:35.892518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bbedbc82-869b-4a24-b5f0-9663027cd048 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:35.893112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bbedbc82-869b-4a24-b5f0-9663027cd048 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:35.899855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbedbc82-869b-4a24-b5f0-9663027cd048 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:35.900308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbedbc82-869b-4a24-b5f0-9663027cd048 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:35.901066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbedbc82-869b-4a24-b5f0-9663027cd048 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:35.901502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbedbc82-869b-4a24-b5f0-9663027cd048 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:35.944031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:35.952968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:35.954504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:35.955653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-68ed24dd-6b04-49cf-9370-fc84069cd399 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102047 Jun 02 19:20:35.956209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 956/1909] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:36.041528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bbedbc82-869b-4a24-b5f0-9663027cd048 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:36.053536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bbedbc82-869b-4a24-b5f0-9663027cd048 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.164683 Jun 02 19:20:36.054313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 954/1910] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:35 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:20:36.976754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:36.977537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:36.986672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:36.987618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:36.988392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:36.988814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:37.056176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:37.073330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:37.074399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b3136816-0a71-48b3-85d6-90826204ab40 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:37.075411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b3136816-0a71-48b3-85d6-90826204ab40 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:37.076585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:37.079085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c7901648-f61c-47c2-9102-aea0f0799b5d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.107395 Jun 02 19:20:37.080043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 957/1911] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:37.083531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3136816-0a71-48b3-85d6-90826204ab40 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:37.083990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3136816-0a71-48b3-85d6-90826204ab40 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:37.084772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3136816-0a71-48b3-85d6-90826204ab40 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:37.085236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3136816-0a71-48b3-85d6-90826204ab40 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:37.233270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b3136816-0a71-48b3-85d6-90826204ab40 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:37.241684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b3136816-0a71-48b3-85d6-90826204ab40 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171813 Jun 02 19:20:37.242288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 955/1912] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:37 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:20:38.100985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:38.101612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:38.111775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:38.112464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:38.113720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:38.114396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:38.185833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:38.195179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:38.196655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:38.197817 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dc3cae32-69b9-4637-9218-464b310eea43 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100946 Jun 02 19:20:38.198380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 958/1913] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:38.261364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cf3a62ee-4b12-4fff-9f5e-31565654d548 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:38.262157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cf3a62ee-4b12-4fff-9f5e-31565654d548 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:38.271992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf3a62ee-4b12-4fff-9f5e-31565654d548 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:38.272640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf3a62ee-4b12-4fff-9f5e-31565654d548 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:38.273665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf3a62ee-4b12-4fff-9f5e-31565654d548 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:38.274289 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf3a62ee-4b12-4fff-9f5e-31565654d548 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:38.412343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cf3a62ee-4b12-4fff-9f5e-31565654d548 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:38.414559 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:38.421268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cf3a62ee-4b12-4fff-9f5e-31565654d548 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165071 Jun 02 19:20:38.421835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 956/1914] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:38 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:39.221836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:39.222534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:39.233490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:39.234214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:39.235305 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:39.235749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:39.309041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:39.318812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:39.320329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:39.321476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-03f58efe-dc78-4037-b5a3-3c3dfdd8b8cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104046 Jun 02 19:20:39.322130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 959/1915] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:39.440351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9117be9b-9880-4371-92f4-3d2e9de498b8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:39.440351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9117be9b-9880-4371-92f4-3d2e9de498b8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:39.448185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9117be9b-9880-4371-92f4-3d2e9de498b8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:39.448636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9117be9b-9880-4371-92f4-3d2e9de498b8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:39.449400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9117be9b-9880-4371-92f4-3d2e9de498b8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:39.449824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9117be9b-9880-4371-92f4-3d2e9de498b8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:39.596658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9117be9b-9880-4371-92f4-3d2e9de498b8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:39.608297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9117be9b-9880-4371-92f4-3d2e9de498b8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173368 Jun 02 19:20:39.608986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 957/1916] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:39 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:40.345589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:40.346335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:40.354384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:40.354932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:40.355833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:40.356398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:40.425579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:40.434920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:40.436865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:40.438167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0941e28c-4671-40b8-ab9a-48fe3995a797 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098250 Jun 02 19:20:40.438624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 960/1917] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:40.633404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1452d6d-6fcb-4f07-a59a-6888b54004f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:40.634507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d1452d6d-6fcb-4f07-a59a-6888b54004f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:40.645856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1452d6d-6fcb-4f07-a59a-6888b54004f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:40.646659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1452d6d-6fcb-4f07-a59a-6888b54004f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:40.647951 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1452d6d-6fcb-4f07-a59a-6888b54004f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:40.648736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1452d6d-6fcb-4f07-a59a-6888b54004f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:40.797862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1452d6d-6fcb-4f07-a59a-6888b54004f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:40.806252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d1452d6d-6fcb-4f07-a59a-6888b54004f1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179269 Jun 02 19:20:40.806796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 958/1918] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:40 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:41.456662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:41.457314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:41.464370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:41.464825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:41.465597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:41.466359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:41.529145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:41.538266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:41.539776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:41.540936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cbcb0502-78e8-474c-a112-291d5d31f564 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088389 Jun 02 19:20:41.541498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 961/1919] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:41.828600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ceac6bb2-e307-41f9-8958-0287e6602361 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:41.829401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ceac6bb2-e307-41f9-8958-0287e6602361 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:41.839999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceac6bb2-e307-41f9-8958-0287e6602361 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:41.840690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceac6bb2-e307-41f9-8958-0287e6602361 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:41.841667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceac6bb2-e307-41f9-8958-0287e6602361 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:41.842146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ceac6bb2-e307-41f9-8958-0287e6602361 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:41.984607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ceac6bb2-e307-41f9-8958-0287e6602361 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:41.993330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ceac6bb2-e307-41f9-8958-0287e6602361 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171504 Jun 02 19:20:41.994255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 959/1920] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:41 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:42.559320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:42.560480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:42.567900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:42.568357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:42.569131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:42.569573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:42.637691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:42.647387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:42.648897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:42.650084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3485009e-fcef-43f0-b4a8-5ae2993e12e6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094765 Jun 02 19:20:42.650642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 962/1921] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:43.014782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-375ecccd-b68b-465b-84db-b638e5d8531c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:43.015411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-375ecccd-b68b-465b-84db-b638e5d8531c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:43.022595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-375ecccd-b68b-465b-84db-b638e5d8531c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:43.023051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-375ecccd-b68b-465b-84db-b638e5d8531c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:43.023821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-375ecccd-b68b-465b-84db-b638e5d8531c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:43.024258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-375ecccd-b68b-465b-84db-b638e5d8531c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:43.181541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-375ecccd-b68b-465b-84db-b638e5d8531c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:43.195137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-375ecccd-b68b-465b-84db-b638e5d8531c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.185906 Jun 02 19:20:43.195957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 960/1922] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:43 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:43.671000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:43.671576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:43.678538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:43.679004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:43.679750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:43.680190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:43.744828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:43.754712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:43.756233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:43.757422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ca456eab-ef68-4312-8581-62c050a1810b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091477 Jun 02 19:20:43.758319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 963/1923] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:44.213776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-efdb0303-d34b-4c00-af4e-b08433750df3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:44.214496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-efdb0303-d34b-4c00-af4e-b08433750df3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:44.222279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efdb0303-d34b-4c00-af4e-b08433750df3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:44.222843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efdb0303-d34b-4c00-af4e-b08433750df3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:44.223740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efdb0303-d34b-4c00-af4e-b08433750df3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:44.224260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efdb0303-d34b-4c00-af4e-b08433750df3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:44.375261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-efdb0303-d34b-4c00-af4e-b08433750df3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:44.387323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-efdb0303-d34b-4c00-af4e-b08433750df3 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.177888 Jun 02 19:20:44.388101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 961/1924] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:44 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:44.783011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:44.783630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:44.790569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:44.790960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:44.791730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:44.792170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:44.867974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:44.876748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:44.878276 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:44.879412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-140f6ed9-e6bb-4b81-b340-94f5ef4972b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101435 Jun 02 19:20:44.879969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 964/1925] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:45.408015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fe0e43ed-78e7-49cb-8aab-dc1da39979c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:45.408648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fe0e43ed-78e7-49cb-8aab-dc1da39979c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:45.416288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe0e43ed-78e7-49cb-8aab-dc1da39979c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:45.416737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe0e43ed-78e7-49cb-8aab-dc1da39979c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:45.417492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe0e43ed-78e7-49cb-8aab-dc1da39979c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:45.417961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe0e43ed-78e7-49cb-8aab-dc1da39979c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:45.561153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fe0e43ed-78e7-49cb-8aab-dc1da39979c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:45.569830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fe0e43ed-78e7-49cb-8aab-dc1da39979c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168028 Jun 02 19:20:45.570376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 962/1926] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:45 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:45.901611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:45.902621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:45.914810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:45.915575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:45.916895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:45.917674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:45.993466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:46.003727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:46.005241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:46.006426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b42256c5-b97a-4ab5-97e4-3e279e709352 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.111290 Jun 02 19:20:46.007003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 965/1927] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:46.591664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7cede0df-f601-4ea9-8e93-1c190103ec38 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:46.592927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7cede0df-f601-4ea9-8e93-1c190103ec38 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:46.602890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7cede0df-f601-4ea9-8e93-1c190103ec38 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:46.603588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7cede0df-f601-4ea9-8e93-1c190103ec38 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:46.604883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7cede0df-f601-4ea9-8e93-1c190103ec38 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:46.605681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7cede0df-f601-4ea9-8e93-1c190103ec38 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:46.741432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7cede0df-f601-4ea9-8e93-1c190103ec38 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:46.751036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7cede0df-f601-4ea9-8e93-1c190103ec38 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.165859 Jun 02 19:20:46.751571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 963/1928] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:46 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:47.029371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:47.030961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:47.038230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:47.038685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:47.039462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:47.039894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:47.105376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:47.119065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:47.121636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:47.123554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fe36eeb9-9f0f-419c-b2a3-e79e8c9a1194 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100454 Jun 02 19:20:47.124091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 966/1929] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:47.769059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-925dad6e-578a-44e0-b002-4e78229e87fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:47.769674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-925dad6e-578a-44e0-b002-4e78229e87fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:47.776885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-925dad6e-578a-44e0-b002-4e78229e87fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:47.777345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-925dad6e-578a-44e0-b002-4e78229e87fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:47.778147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-925dad6e-578a-44e0-b002-4e78229e87fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:47.778589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-925dad6e-578a-44e0-b002-4e78229e87fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:47.926244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-925dad6e-578a-44e0-b002-4e78229e87fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:47.935902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-925dad6e-578a-44e0-b002-4e78229e87fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.170668 Jun 02 19:20:47.936763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 964/1930] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:47 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:48.148496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:48.149272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:48.157440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:48.157930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:48.158770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:48.159215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:48.223416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:48.232453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:48.234026 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:48.235186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d57e317-6212-40de-8419-79d89b3eaf0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091317 Jun 02 19:20:48.235745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 967/1931] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:20:48.955632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-578d2172-5b4e-462a-a20f-8e55d31b316a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:48.956217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-578d2172-5b4e-462a-a20f-8e55d31b316a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:48.963201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-578d2172-5b4e-462a-a20f-8e55d31b316a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:48.963650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-578d2172-5b4e-462a-a20f-8e55d31b316a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:48.964417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-578d2172-5b4e-462a-a20f-8e55d31b316a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:48.964845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-578d2172-5b4e-462a-a20f-8e55d31b316a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:49.100426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-578d2172-5b4e-462a-a20f-8e55d31b316a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:49.111663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-578d2172-5b4e-462a-a20f-8e55d31b316a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160630 Jun 02 19:20:49.112275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 965/1932] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:48 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:49.253520 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:49.254065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:49.263438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:49.264270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:49.265310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:49.265723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:49.339983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:49.350155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:49.351647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:49.352796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0ad1d314-ba21-4b4e-8930-ea6781937312 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103409 Jun 02 19:20:49.353352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 968/1933] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:50.130345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b6976083-02f2-41b0-8ba1-26f41659e3dc tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:50.130990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b6976083-02f2-41b0-8ba1-26f41659e3dc tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:50.138772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6976083-02f2-41b0-8ba1-26f41659e3dc tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:50.139279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6976083-02f2-41b0-8ba1-26f41659e3dc tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:50.140137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6976083-02f2-41b0-8ba1-26f41659e3dc tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:50.140619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6976083-02f2-41b0-8ba1-26f41659e3dc tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:50.282717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b6976083-02f2-41b0-8ba1-26f41659e3dc tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:50.291086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b6976083-02f2-41b0-8ba1-26f41659e3dc tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166040 Jun 02 19:20:50.291659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 966/1934] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:50 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:50.376655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:50.377268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:50.385203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:50.385749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:50.386725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:50.387233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:50.403758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:50.453492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:50.465342 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:50.467691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:50.469424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-368360eb-8e2f-4f9c-bbdd-b89e0ea8db91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096501 Jun 02 19:20:50.470148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 969/1935] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:51.312089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6b8d2bb6-2cb1-4249-8771-415a6b42be34 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:51.312838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6b8d2bb6-2cb1-4249-8771-415a6b42be34 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:51.320430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b8d2bb6-2cb1-4249-8771-415a6b42be34 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:51.320886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b8d2bb6-2cb1-4249-8771-415a6b42be34 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:51.321671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b8d2bb6-2cb1-4249-8771-415a6b42be34 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:51.322141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b8d2bb6-2cb1-4249-8771-415a6b42be34 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:51.469285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6b8d2bb6-2cb1-4249-8771-415a6b42be34 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:51.478109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6b8d2bb6-2cb1-4249-8771-415a6b42be34 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172562 Jun 02 19:20:51.478681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 967/1936] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:51 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:51.488188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:51.488962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:51.496306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:51.496759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:51.497529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:51.497996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:51.561831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:51.571592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:51.573172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:51.574377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d73487e-423a-4c43-909b-1f9d3effc09c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090231 Jun 02 19:20:51.574939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 970/1937] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:52.496795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e88354d1-f254-463d-aecd-f931ff1d3b14 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:52.497408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e88354d1-f254-463d-aecd-f931ff1d3b14 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:52.505104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e88354d1-f254-463d-aecd-f931ff1d3b14 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:52.505593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e88354d1-f254-463d-aecd-f931ff1d3b14 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:52.506551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e88354d1-f254-463d-aecd-f931ff1d3b14 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:52.507624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e88354d1-f254-463d-aecd-f931ff1d3b14 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:52.593270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:52.593922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:52.601040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:52.601498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:52.602319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:52.602757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:52.655904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e88354d1-f254-463d-aecd-f931ff1d3b14 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:52.664145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e88354d1-f254-463d-aecd-f931ff1d3b14 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171540 Jun 02 19:20:52.664702 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 968/1938] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:52 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:52.671607 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:52.680296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:52.682061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:52.683244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bcb15652-622b-4f66-8295-8f09b12fcc49 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093989 Jun 02 19:20:52.683795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 971/1939] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:53.683654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9f0e4d2a-5657-4a4e-b36b-c16cf47b9502 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:53.684450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9f0e4d2a-5657-4a4e-b36b-c16cf47b9502 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:53.693820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f0e4d2a-5657-4a4e-b36b-c16cf47b9502 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:53.694317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f0e4d2a-5657-4a4e-b36b-c16cf47b9502 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:53.695088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f0e4d2a-5657-4a4e-b36b-c16cf47b9502 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:53.695536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f0e4d2a-5657-4a4e-b36b-c16cf47b9502 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:53.700665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:53.701283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:53.708888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:53.709348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:53.710198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:53.710640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:53.795487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:53.805031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:53.806593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:53.807761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-730b694a-4666-4573-9f39-42c93245cce0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.111108 Jun 02 19:20:53.808320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 972/1940] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:53.856340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9f0e4d2a-5657-4a4e-b36b-c16cf47b9502 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:53.864728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9f0e4d2a-5657-4a4e-b36b-c16cf47b9502 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.186248 Jun 02 19:20:53.865289 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 969/1941] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:53 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:54.830914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:54.831835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:54.843003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:54.843769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:54.845059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:54.845859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:54.883837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f276d008-0e80-42b3-bb4d-5ef4d0f54571 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:54.884560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f276d008-0e80-42b3-bb4d-5ef4d0f54571 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:54.891666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f276d008-0e80-42b3-bb4d-5ef4d0f54571 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:54.892124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f276d008-0e80-42b3-bb4d-5ef4d0f54571 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:54.892900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f276d008-0e80-42b3-bb4d-5ef4d0f54571 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:54.893337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f276d008-0e80-42b3-bb4d-5ef4d0f54571 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:54.912357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:54.921492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:54.923049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:54.924191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-34b19d8c-b11d-400f-a35d-2fac3e86aa00 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100266 Jun 02 19:20:54.924821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 973/1942] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:55.035955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f276d008-0e80-42b3-bb4d-5ef4d0f54571 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:55.044660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f276d008-0e80-42b3-bb4d-5ef4d0f54571 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166620 Jun 02 19:20:55.045219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 970/1943] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:54 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:55.946187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:55.946986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:55.956629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:55.957275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:55.958581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:55.959150 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:56.024645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:56.033974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:56.035597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:56.036760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6123716e-136a-495a-9fba-984aac8530eb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097228 Jun 02 19:20:56.037325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 974/1944] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:56.062197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d3e71b68-333c-4a0a-b488-535d64739816 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:56.062842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d3e71b68-333c-4a0a-b488-535d64739816 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:56.070435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3e71b68-333c-4a0a-b488-535d64739816 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:56.070889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3e71b68-333c-4a0a-b488-535d64739816 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:56.071732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3e71b68-333c-4a0a-b488-535d64739816 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:56.072202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3e71b68-333c-4a0a-b488-535d64739816 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:56.209492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d3e71b68-333c-4a0a-b488-535d64739816 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:56.218880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d3e71b68-333c-4a0a-b488-535d64739816 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160620 Jun 02 19:20:56.219448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 971/1945] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:56 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:57.056875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:57.057521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:57.064415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:57.064877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:57.065657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:57.066475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:57.134072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:57.147504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:57.150061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:57.151566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-45838b60-e509-499f-82cc-a831ad6099e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098566 Jun 02 19:20:57.152290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 975/1946] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:57.236450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7841208a-72cc-48ce-9f4d-9caa2f6021ff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:57.237045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7841208a-72cc-48ce-9f4d-9caa2f6021ff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:57.244576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7841208a-72cc-48ce-9f4d-9caa2f6021ff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:57.245032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7841208a-72cc-48ce-9f4d-9caa2f6021ff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:57.245812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7841208a-72cc-48ce-9f4d-9caa2f6021ff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:57.246281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7841208a-72cc-48ce-9f4d-9caa2f6021ff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:57.380358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7841208a-72cc-48ce-9f4d-9caa2f6021ff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:57.391708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7841208a-72cc-48ce-9f4d-9caa2f6021ff tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.159291 Jun 02 19:20:57.392277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 972/1947] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:57 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:58.175844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:58.176507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:58.183731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:58.184189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:58.184959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:58.185427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:58.253463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:58.263067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:58.264597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:58.265758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-900bc373-4b02-438b-b1f2-0a0b693548c7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093952 Jun 02 19:20:58.266327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 976/1948] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:58.408931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-08020d5d-3b59-4059-8c4f-908af923483b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:58.409513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-08020d5d-3b59-4059-8c4f-908af923483b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:58.416638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08020d5d-3b59-4059-8c4f-908af923483b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:58.417203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08020d5d-3b59-4059-8c4f-908af923483b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:58.418185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08020d5d-3b59-4059-8c4f-908af923483b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:58.418635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08020d5d-3b59-4059-8c4f-908af923483b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:58.433553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:58.559768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-08020d5d-3b59-4059-8c4f-908af923483b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:58.571845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-08020d5d-3b59-4059-8c4f-908af923483b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166468 Jun 02 19:20:58.572597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 973/1949] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:58 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:20:59.289170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:59.289788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:59.291793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:59.298028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:59.298485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:59.299261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:59.299700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:59.371260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:59.384269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:59.386788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:59.388567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-da3db769-0231-4bc5-826e-509f3fc58278 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104376 Jun 02 19:20:59.389129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 977/1950] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:20:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:20:59.589304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5c40b2ac-8696-406e-b0c4-7d4f50bd968a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:20:59.589887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5c40b2ac-8696-406e-b0c4-7d4f50bd968a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:20:59.591999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:59.598188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5c40b2ac-8696-406e-b0c4-7d4f50bd968a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:59.598653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5c40b2ac-8696-406e-b0c4-7d4f50bd968a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:59.599435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5c40b2ac-8696-406e-b0c4-7d4f50bd968a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:20:59.599856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5c40b2ac-8696-406e-b0c4-7d4f50bd968a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:20:59.731654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5c40b2ac-8696-406e-b0c4-7d4f50bd968a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:20:59.740879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5c40b2ac-8696-406e-b0c4-7d4f50bd968a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.155743 Jun 02 19:20:59.741562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 974/1951] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:20:59 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:00.408785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:00.409389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:00.416110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:00.416618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:00.417404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:00.417840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:00.486221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:00.495136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:00.496649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:00.498389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ff8c5cef-4182-477d-93c4-223c57dde6ce tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093444 Jun 02 19:21:00.498953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 978/1952] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:00.763715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-db34463c-9f81-4d8a-9bca-c6a54ae636ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:00.764333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-db34463c-9f81-4d8a-9bca-c6a54ae636ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:00.771247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-db34463c-9f81-4d8a-9bca-c6a54ae636ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:00.771704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-db34463c-9f81-4d8a-9bca-c6a54ae636ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:00.772475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-db34463c-9f81-4d8a-9bca-c6a54ae636ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:00.772904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-db34463c-9f81-4d8a-9bca-c6a54ae636ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:00.931007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-db34463c-9f81-4d8a-9bca-c6a54ae636ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:00.943272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-db34463c-9f81-4d8a-9bca-c6a54ae636ee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.185832 Jun 02 19:21:00.944106 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 975/1953] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:00 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:01.517829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:01.518582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:01.525629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:01.526114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:01.526890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:01.527327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:01.595154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:01.604149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:01.605660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:01.606854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f56f26bf-7158-4bef-8d35-16a5689172c2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093920 Jun 02 19:21:01.607695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 979/1954] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:01.965301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-401dce96-a34d-4b51-872b-b76109e147d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:01.966428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-401dce96-a34d-4b51-872b-b76109e147d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:01.973624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-401dce96-a34d-4b51-872b-b76109e147d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:01.974130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-401dce96-a34d-4b51-872b-b76109e147d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:01.974933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-401dce96-a34d-4b51-872b-b76109e147d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:01.975390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-401dce96-a34d-4b51-872b-b76109e147d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:02.120987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-401dce96-a34d-4b51-872b-b76109e147d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:02.129320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-401dce96-a34d-4b51-872b-b76109e147d0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.170515 Jun 02 19:21:02.129914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 976/1955] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:01 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:02.626884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:02.627477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:02.634650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:02.635105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:02.635871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:02.636315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:02.709195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:02.720437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:02.721973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:02.723121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3d76ceb5-e935-44da-a1d2-3a5008be0980 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101287 Jun 02 19:21:02.723645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 980/1956] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:03.151230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-74d066d6-615e-47e8-be9b-6713d9772b4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:03.152162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-74d066d6-615e-47e8-be9b-6713d9772b4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:03.163473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74d066d6-615e-47e8-be9b-6713d9772b4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:03.164214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74d066d6-615e-47e8-be9b-6713d9772b4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:03.165470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74d066d6-615e-47e8-be9b-6713d9772b4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:03.166240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74d066d6-615e-47e8-be9b-6713d9772b4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:03.311982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-74d066d6-615e-47e8-be9b-6713d9772b4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:03.320899 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-74d066d6-615e-47e8-be9b-6713d9772b4e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.176174 Jun 02 19:21:03.321481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 977/1957] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:03 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:03.745891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:03.746898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:03.759063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:03.759822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:03.761094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:03.761875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:03.837474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:03.851527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:03.853856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:03.855592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-175ad1d7-dd83-4f31-955e-a74882c4ea30 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.116127 Jun 02 19:21:03.856396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 981/1958] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:04.339619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f7abdb43-bf23-4da0-bf07-a1be64e6647d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:04.340345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f7abdb43-bf23-4da0-bf07-a1be64e6647d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:04.347965 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f7abdb43-bf23-4da0-bf07-a1be64e6647d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:04.348417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f7abdb43-bf23-4da0-bf07-a1be64e6647d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:04.349178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f7abdb43-bf23-4da0-bf07-a1be64e6647d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:04.349610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f7abdb43-bf23-4da0-bf07-a1be64e6647d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:04.485353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f7abdb43-bf23-4da0-bf07-a1be64e6647d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:04.493598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f7abdb43-bf23-4da0-bf07-a1be64e6647d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.158644 Jun 02 19:21:04.494200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 978/1959] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:04 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:04.883534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:04.884535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:04.896076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:04.896829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:04.898149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:04.898887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:04.965130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:04.974463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:04.975970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:04.977122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-82c3bfb5-f366-4725-a905-66c85e3ec914 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100256 Jun 02 19:21:04.977709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 982/1960] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:05.519582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8ddf57f6-7aae-4d7d-b10d-114dfbac79ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:05.520678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8ddf57f6-7aae-4d7d-b10d-114dfbac79ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:05.530777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ddf57f6-7aae-4d7d-b10d-114dfbac79ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:05.531224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ddf57f6-7aae-4d7d-b10d-114dfbac79ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:05.531996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ddf57f6-7aae-4d7d-b10d-114dfbac79ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:05.532417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ddf57f6-7aae-4d7d-b10d-114dfbac79ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:05.688318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8ddf57f6-7aae-4d7d-b10d-114dfbac79ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:05.697058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8ddf57f6-7aae-4d7d-b10d-114dfbac79ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.184310 Jun 02 19:21:05.697618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 979/1961] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:05 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:05.999264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:06.000318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:06.011395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:06.012145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:06.013432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:06.013931 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:06.079657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:06.088212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:06.089697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:06.090868 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0b24c7ed-7d28-4b59-909f-4b33cb33cfab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098362 Jun 02 19:21:06.092170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 983/1962] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:06.714678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5a78d10e-c6bf-4363-80cd-09acf222e4ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:06.715296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5a78d10e-c6bf-4363-80cd-09acf222e4ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:06.722417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a78d10e-c6bf-4363-80cd-09acf222e4ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:06.722859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a78d10e-c6bf-4363-80cd-09acf222e4ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:06.723618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a78d10e-c6bf-4363-80cd-09acf222e4ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:06.724046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a78d10e-c6bf-4363-80cd-09acf222e4ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:06.871817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5a78d10e-c6bf-4363-80cd-09acf222e4ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:06.885109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5a78d10e-c6bf-4363-80cd-09acf222e4ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174115 Jun 02 19:21:06.886057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 980/1963] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:06 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:07.113016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:07.113966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:07.124160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:07.124893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:07.125653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:07.126137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:07.194362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:07.207503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:07.209729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:07.211444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f6d9e3d8-06aa-4e32-a1f8-239233b57366 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104955 Jun 02 19:21:07.212213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 984/1964] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:07.906704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6ed5b6be-b859-4718-ab68-2670e7bc1d5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:07.907311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6ed5b6be-b859-4718-ab68-2670e7bc1d5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:07.914262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ed5b6be-b859-4718-ab68-2670e7bc1d5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:07.914717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ed5b6be-b859-4718-ab68-2670e7bc1d5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:07.915484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ed5b6be-b859-4718-ab68-2670e7bc1d5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:07.915919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ed5b6be-b859-4718-ab68-2670e7bc1d5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:08.056368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6ed5b6be-b859-4718-ab68-2670e7bc1d5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:08.065094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6ed5b6be-b859-4718-ab68-2670e7bc1d5f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163600 Jun 02 19:21:08.066008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 981/1965] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:07 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:08.234488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:08.235082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:08.242482 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:08.242956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:08.243766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:08.244224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:08.315375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:08.319163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:08.325645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:08.327349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:08.328594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2e269869-473f-49e8-a72a-7cd3cf096997 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100074 Jun 02 19:21:08.329155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 985/1966] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:09.084065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-175d362a-9237-43b1-9ae6-d69b798c4138 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:09.084843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-175d362a-9237-43b1-9ae6-d69b798c4138 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:09.094241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-175d362a-9237-43b1-9ae6-d69b798c4138 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:09.094844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-175d362a-9237-43b1-9ae6-d69b798c4138 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:09.095845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-175d362a-9237-43b1-9ae6-d69b798c4138 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:09.096422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-175d362a-9237-43b1-9ae6-d69b798c4138 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:09.247753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-175d362a-9237-43b1-9ae6-d69b798c4138 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:09.256654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-175d362a-9237-43b1-9ae6-d69b798c4138 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.177834 Jun 02 19:21:09.257217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 982/1967] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:09 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:09.349775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:09.350637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:09.361192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:09.361937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:09.363112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:09.363781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:09.429229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:09.438406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:09.439935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:09.441429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bb1acc8c-b5bb-4467-8693-d1be2c85e97c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098311 Jun 02 19:21:09.442005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 986/1968] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:10.278332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-11b53554-3ccb-4128-9268-79a596b74510 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:10.279812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-11b53554-3ccb-4128-9268-79a596b74510 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:10.287896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11b53554-3ccb-4128-9268-79a596b74510 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:10.288347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11b53554-3ccb-4128-9268-79a596b74510 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:10.289102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11b53554-3ccb-4128-9268-79a596b74510 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:10.289530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11b53554-3ccb-4128-9268-79a596b74510 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:10.424281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-11b53554-3ccb-4128-9268-79a596b74510 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:10.432505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-11b53554-3ccb-4128-9268-79a596b74510 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161168 Jun 02 19:21:10.433063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 983/1969] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:10 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:10.461357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:10.462047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:10.473767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:10.474560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:10.475843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:10.476606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:10.544878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:10.555424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:10.556930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:10.558154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9813bf8c-b33b-4e09-9fc7-3a336ae0dd0b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101403 Jun 02 19:21:10.558705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 987/1970] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:11.450769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-000bfde9-1b23-46fc-8cd0-fe78142b8dcb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:11.451407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-000bfde9-1b23-46fc-8cd0-fe78142b8dcb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:11.458914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-000bfde9-1b23-46fc-8cd0-fe78142b8dcb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:11.459358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-000bfde9-1b23-46fc-8cd0-fe78142b8dcb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:11.460124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-000bfde9-1b23-46fc-8cd0-fe78142b8dcb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:11.460554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-000bfde9-1b23-46fc-8cd0-fe78142b8dcb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:11.577002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:11.577712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:11.585105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:11.585563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:11.586386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:11.586831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:11.605940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-000bfde9-1b23-46fc-8cd0-fe78142b8dcb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:11.614722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-000bfde9-1b23-46fc-8cd0-fe78142b8dcb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167917 Jun 02 19:21:11.615300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 984/1971] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:11 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:11.649701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:11.659008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:11.660524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:11.661685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9e482c07-0c2c-4879-9c85-966422c3aa45 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088956 Jun 02 19:21:11.662271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 988/1972] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:12.632271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b959cb9-65b5-434b-a1fa-84fcfdc9bb4b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:12.632850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b959cb9-65b5-434b-a1fa-84fcfdc9bb4b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:12.640405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b959cb9-65b5-434b-a1fa-84fcfdc9bb4b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:12.640857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b959cb9-65b5-434b-a1fa-84fcfdc9bb4b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:12.641622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b959cb9-65b5-434b-a1fa-84fcfdc9bb4b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:12.642066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b959cb9-65b5-434b-a1fa-84fcfdc9bb4b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:12.679367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:12.679933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:12.688917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:12.689372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:12.690192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:12.691136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:12.768861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:12.783805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:12.785395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:12.786641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e7191161-2c4c-41a5-93de-0fa80bce106b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.111060 Jun 02 19:21:12.787265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 989/1973] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:12.800576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3b959cb9-65b5-434b-a1fa-84fcfdc9bb4b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:12.809186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b959cb9-65b5-434b-a1fa-84fcfdc9bb4b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.180876 Jun 02 19:21:12.809748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 985/1974] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:12 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:13.807970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:13.808753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:13.817367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:13.817834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:13.818633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:13.819075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:13.827051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6ea1dff4-ebdc-4aa7-ac90-801e8d3a718c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:13.827884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6ea1dff4-ebdc-4aa7-ac90-801e8d3a718c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:13.834543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ea1dff4-ebdc-4aa7-ac90-801e8d3a718c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:13.834984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ea1dff4-ebdc-4aa7-ac90-801e8d3a718c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:13.835729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ea1dff4-ebdc-4aa7-ac90-801e8d3a718c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:13.836172 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ea1dff4-ebdc-4aa7-ac90-801e8d3a718c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:13.886026 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:13.895451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:13.896955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:13.898143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-58144f11-a138-4651-a822-8e66f57b1f23 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096030 Jun 02 19:21:13.898694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 990/1975] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:13.982042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6ea1dff4-ebdc-4aa7-ac90-801e8d3a718c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:13.990735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6ea1dff4-ebdc-4aa7-ac90-801e8d3a718c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167574 Jun 02 19:21:13.991301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 986/1976] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:13 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:14.916592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:14.917188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:14.924447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:14.924904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:14.925676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:14.926152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:14.997455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:15.008078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:15.008331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54e92598-9a15-4250-9163-b934bab64f9b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:15.008886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-54e92598-9a15-4250-9163-b934bab64f9b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:15.009778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:15.010978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a5ee7f13-e353-47df-be3c-8d9707c5447f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098602 Jun 02 19:21:15.011529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 991/1977] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:15.016395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54e92598-9a15-4250-9163-b934bab64f9b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:15.016906 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54e92598-9a15-4250-9163-b934bab64f9b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:15.017613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54e92598-9a15-4250-9163-b934bab64f9b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:15.018072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54e92598-9a15-4250-9163-b934bab64f9b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:15.157173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-54e92598-9a15-4250-9163-b934bab64f9b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:15.165756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-54e92598-9a15-4250-9163-b934bab64f9b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161587 Jun 02 19:21:15.166356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 987/1978] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:15 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:16.033524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:16.034172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:16.041144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:16.041604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:16.042435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:16.042880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:16.113025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:16.125496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:16.127027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:16.128178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cccd4708-3683-4838-85bf-42a090709491 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100709 Jun 02 19:21:16.128744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 992/1979] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:16.182879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-34883edc-2dfa-4b46-982d-2f35e7bdf8fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:16.183446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-34883edc-2dfa-4b46-982d-2f35e7bdf8fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:16.191161 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34883edc-2dfa-4b46-982d-2f35e7bdf8fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:16.191609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34883edc-2dfa-4b46-982d-2f35e7bdf8fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:16.192372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34883edc-2dfa-4b46-982d-2f35e7bdf8fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:16.192804 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34883edc-2dfa-4b46-982d-2f35e7bdf8fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:16.346421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-34883edc-2dfa-4b46-982d-2f35e7bdf8fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:16.359430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-34883edc-2dfa-4b46-982d-2f35e7bdf8fb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.180383 Jun 02 19:21:16.360030 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 988/1980] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:16 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:17.150283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:17.151222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:17.159690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:17.160166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:17.160937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:17.161377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:17.227554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:17.240061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:17.241552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:17.242724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8922c879-eeae-49dc-919b-3213c4d1f243 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098847 Jun 02 19:21:17.243281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 993/1981] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:17.379717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1b3a05f9-aadc-41d6-be41-0aa96cee6a03 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:17.380335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1b3a05f9-aadc-41d6-be41-0aa96cee6a03 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:17.387509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b3a05f9-aadc-41d6-be41-0aa96cee6a03 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:17.387981 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b3a05f9-aadc-41d6-be41-0aa96cee6a03 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:17.388749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b3a05f9-aadc-41d6-be41-0aa96cee6a03 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:17.389176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b3a05f9-aadc-41d6-be41-0aa96cee6a03 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:17.544108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1b3a05f9-aadc-41d6-be41-0aa96cee6a03 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:17.553097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1b3a05f9-aadc-41d6-be41-0aa96cee6a03 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.178677 Jun 02 19:21:17.553669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 989/1982] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:17 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:18.261514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:18.262155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:18.269956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:18.270412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:18.271149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:18.271618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:18.335690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:18.345399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:18.346961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:18.348122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-01932325-25f9-4e3a-83c8-09c292dfd832 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090877 Jun 02 19:21:18.348677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 994/1983] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:18.574953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59c46841-189d-487f-a802-9d9a00df5860 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:18.575625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-59c46841-189d-487f-a802-9d9a00df5860 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:18.582959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59c46841-189d-487f-a802-9d9a00df5860 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:18.583419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59c46841-189d-487f-a802-9d9a00df5860 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:18.584186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59c46841-189d-487f-a802-9d9a00df5860 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:18.584624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59c46841-189d-487f-a802-9d9a00df5860 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:18.587214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:18.729366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-59c46841-189d-487f-a802-9d9a00df5860 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:18.738942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-59c46841-189d-487f-a802-9d9a00df5860 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167843 Jun 02 19:21:18.739698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 990/1984] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:18 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:19.370689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:19.371698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:19.382902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:19.383667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:19.384936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:19.385673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:19.453940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:19.463650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:19.465175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:19.466404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bf1b8d80-957f-44e3-989b-d9336c080541 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102424 Jun 02 19:21:19.466950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 995/1985] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:19.765368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-50a98006-beda-42cd-b326-c315d514dc17 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:19.766495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-50a98006-beda-42cd-b326-c315d514dc17 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:19.778037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50a98006-beda-42cd-b326-c315d514dc17 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:19.778794 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50a98006-beda-42cd-b326-c315d514dc17 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:19.780057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50a98006-beda-42cd-b326-c315d514dc17 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:19.780780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50a98006-beda-42cd-b326-c315d514dc17 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:19.932968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-50a98006-beda-42cd-b326-c315d514dc17 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:19.942279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-50a98006-beda-42cd-b326-c315d514dc17 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.183309 Jun 02 19:21:19.942849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 991/1986] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:19 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:20.485158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:20.485728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:20.493061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:20.493530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:20.494351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:20.494793 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:20.560726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:20.570100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:20.571635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:20.572789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d46c2e7f-83fa-40a4-a31d-eb28a8b9df8d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091869 Jun 02 19:21:20.573346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 996/1987] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:20.962540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1ae4c919-1b60-400b-bca8-516ef108427e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:20.963379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1ae4c919-1b60-400b-bca8-516ef108427e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:20.972610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ae4c919-1b60-400b-bca8-516ef108427e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:20.973207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ae4c919-1b60-400b-bca8-516ef108427e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:20.974273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ae4c919-1b60-400b-bca8-516ef108427e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:20.974856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ae4c919-1b60-400b-bca8-516ef108427e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:21.118036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1ae4c919-1b60-400b-bca8-516ef108427e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:21.126362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1ae4c919-1b60-400b-bca8-516ef108427e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169551 Jun 02 19:21:21.126919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 992/1988] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:20 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:21.591284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:21.591858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:21.599132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:21.599373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:21.600151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:21.600593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:21.881452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:21.892833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:21.894369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:21.895515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-80653964-ccc8-4d3f-9db9-3ecb6a76519c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.308378 Jun 02 19:21:21.896436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 997/1989] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:22.145120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-63ffb712-d7c6-4856-95c7-52e21113c507 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:22.145839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-63ffb712-d7c6-4856-95c7-52e21113c507 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:22.154539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63ffb712-d7c6-4856-95c7-52e21113c507 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:22.155583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63ffb712-d7c6-4856-95c7-52e21113c507 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:22.157154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63ffb712-d7c6-4856-95c7-52e21113c507 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:22.157704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63ffb712-d7c6-4856-95c7-52e21113c507 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:22.320780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-63ffb712-d7c6-4856-95c7-52e21113c507 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:22.334378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-63ffb712-d7c6-4856-95c7-52e21113c507 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.194355 Jun 02 19:21:22.334956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 993/1990] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:22 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:22.919168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:22.919780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:22.930338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:22.930792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:22.931564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:22.931997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:23.001860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:23.015728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:23.018229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:23.019919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7dc18793-f760-44a2-ae04-7bb0218e50aa tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.106087 Jun 02 19:21:23.020715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 998/1991] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:23.354326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cfdca29d-7a30-4f04-a02c-5673948f8937 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:23.354987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cfdca29d-7a30-4f04-a02c-5673948f8937 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:23.361886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfdca29d-7a30-4f04-a02c-5673948f8937 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:23.362335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfdca29d-7a30-4f04-a02c-5673948f8937 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:23.363105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfdca29d-7a30-4f04-a02c-5673948f8937 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:23.363543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfdca29d-7a30-4f04-a02c-5673948f8937 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:23.507607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cfdca29d-7a30-4f04-a02c-5673948f8937 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:23.516099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cfdca29d-7a30-4f04-a02c-5673948f8937 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166926 Jun 02 19:21:23.516673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 994/1992] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:23 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:24.041809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:24.042416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:24.049165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:24.049628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:24.050438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:24.050881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:24.115780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:24.129429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:24.132468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:24.134313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a7c5ca33-e2ac-4c88-ab77-b0caf5f2cf64 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097583 Jun 02 19:21:24.134871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 999/1993] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:24.533645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3d397895-27b2-41eb-bd61-d14b9a32d16f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:24.534253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3d397895-27b2-41eb-bd61-d14b9a32d16f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:24.541994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3d397895-27b2-41eb-bd61-d14b9a32d16f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:24.542449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3d397895-27b2-41eb-bd61-d14b9a32d16f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:24.543225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3d397895-27b2-41eb-bd61-d14b9a32d16f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:24.543654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3d397895-27b2-41eb-bd61-d14b9a32d16f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:24.688230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3d397895-27b2-41eb-bd61-d14b9a32d16f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:24.700737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3d397895-27b2-41eb-bd61-d14b9a32d16f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.170855 Jun 02 19:21:24.701532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 995/1994] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:24 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:25.155064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:25.156701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:25.165476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:25.166099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:25.167048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:25.167593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:25.239626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:25.248601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:25.250124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:25.251264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3afabc80-ec84-4b88-bf00-5d9ea5e1d287 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101455 Jun 02 19:21:25.251828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1000/1995] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:25.463256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:21:25.463495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:21:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:21:25.722883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a68a0a1d-5804-42bf-9c6c-54c09ff57ec8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:25.723740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a68a0a1d-5804-42bf-9c6c-54c09ff57ec8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:25.735882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a68a0a1d-5804-42bf-9c6c-54c09ff57ec8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:25.736361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a68a0a1d-5804-42bf-9c6c-54c09ff57ec8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:25.737154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a68a0a1d-5804-42bf-9c6c-54c09ff57ec8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:25.737585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a68a0a1d-5804-42bf-9c6c-54c09ff57ec8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:25.872749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a68a0a1d-5804-42bf-9c6c-54c09ff57ec8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:25.884554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a68a0a1d-5804-42bf-9c6c-54c09ff57ec8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168019 Jun 02 19:21:25.885425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 996/1996] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:25 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:26.271884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:26.273424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:26.283900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:26.284590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:26.285756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:26.286448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:26.361905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:26.370769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:26.372286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:26.373429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7f26f51f-b0bc-4ecd-806a-9e98f4eeca6d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.107553 Jun 02 19:21:26.373972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1001/1997] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:26.910651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-03a52a4d-7944-42f3-8996-a3853f7e3eee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:26.911563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-03a52a4d-7944-42f3-8996-a3853f7e3eee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:26.921265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03a52a4d-7944-42f3-8996-a3853f7e3eee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:26.921858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03a52a4d-7944-42f3-8996-a3853f7e3eee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:26.923082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03a52a4d-7944-42f3-8996-a3853f7e3eee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:26.923627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03a52a4d-7944-42f3-8996-a3853f7e3eee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:27.074690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-03a52a4d-7944-42f3-8996-a3853f7e3eee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:27.083058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-03a52a4d-7944-42f3-8996-a3853f7e3eee tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.178982 Jun 02 19:21:27.083627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 997/1998] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:26 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:27.395752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:27.396472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:27.404432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:27.404880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:27.405644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:27.406116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:27.425015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:27.477577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:27.489105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:27.491019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:27.492668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-01fce2bd-2fe5-43da-a731-1de6ddc60196 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103545 Jun 02 19:21:27.493282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1002/1999] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:28.104740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aff74e27-c925-4d0a-9422-212707b3d83b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:28.105677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aff74e27-c925-4d0a-9422-212707b3d83b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:28.116888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aff74e27-c925-4d0a-9422-212707b3d83b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:28.117305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aff74e27-c925-4d0a-9422-212707b3d83b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:28.118123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aff74e27-c925-4d0a-9422-212707b3d83b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:28.118558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aff74e27-c925-4d0a-9422-212707b3d83b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:28.266399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aff74e27-c925-4d0a-9422-212707b3d83b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:28.275036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aff74e27-c925-4d0a-9422-212707b3d83b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.176942 Jun 02 19:21:28.275608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 998/2000] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:28 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:28.513078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:28.513739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:28.522337 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:28.522834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:28.523710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:28.524231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:28.595503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:28.604525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:28.606082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:28.607239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-272880c2-45a7-4b64-ad9f-234d3b919e37 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098645 Jun 02 19:21:28.607798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1003/2001] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:21:29.291938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-23ebf1a2-ada9-45a1-85d2-cf6948276475 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:29.292549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-23ebf1a2-ada9-45a1-85d2-cf6948276475 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:29.299604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23ebf1a2-ada9-45a1-85d2-cf6948276475 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:29.300059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23ebf1a2-ada9-45a1-85d2-cf6948276475 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:29.300824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23ebf1a2-ada9-45a1-85d2-cf6948276475 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:29.301241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-23ebf1a2-ada9-45a1-85d2-cf6948276475 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:29.450105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-23ebf1a2-ada9-45a1-85d2-cf6948276475 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:29.462300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-23ebf1a2-ada9-45a1-85d2-cf6948276475 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174123 Jun 02 19:21:29.463046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 999/2002] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:29 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:29.630000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:29.630983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:29.634757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:29.643799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:29.644522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:29.645948 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:29.646587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:29.715346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:29.728877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:29.731726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:29.733486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9bca92cd-a7a4-4f1b-99a3-737a985490ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110146 Jun 02 19:21:29.734378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1004/2003] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:30.482786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cae247d3-3415-4961-a61a-d73c3ef74301 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:30.483555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cae247d3-3415-4961-a61a-d73c3ef74301 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:30.486827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:30.494151 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cae247d3-3415-4961-a61a-d73c3ef74301 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:30.494680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cae247d3-3415-4961-a61a-d73c3ef74301 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:30.495321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cae247d3-3415-4961-a61a-d73c3ef74301 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:30.495752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cae247d3-3415-4961-a61a-d73c3ef74301 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:30.642035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cae247d3-3415-4961-a61a-d73c3ef74301 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:30.651357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cae247d3-3415-4961-a61a-d73c3ef74301 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173892 Jun 02 19:21:30.651921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1000/2004] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:30 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:30.760447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:30.761020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:30.767936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:30.768385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:30.769149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:30.769593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:30.842763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:30.851641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:30.853233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:30.854516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9fd018f6-c0ea-414b-bd84-c98d26ecbd74 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101279 Jun 02 19:21:30.855065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1005/2005] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:31.678064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5bc16607-f29a-4967-873d-9af060c93528 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:31.679053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5bc16607-f29a-4967-873d-9af060c93528 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:31.690197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bc16607-f29a-4967-873d-9af060c93528 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:31.691330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bc16607-f29a-4967-873d-9af060c93528 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:31.692668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bc16607-f29a-4967-873d-9af060c93528 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:31.693413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bc16607-f29a-4967-873d-9af060c93528 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:31.838120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5bc16607-f29a-4967-873d-9af060c93528 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:31.846511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5bc16607-f29a-4967-873d-9af060c93528 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174999 Jun 02 19:21:31.847066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1001/2006] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:31 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:31.875025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:31.876077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:31.886994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:31.887646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:31.888732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:31.889366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:31.960318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:31.970042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:31.971557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:31.972721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-13172e68-1c39-4f63-a30d-8d590cdb5f6c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103121 Jun 02 19:21:31.973276 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1006/2007] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:32.872837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-762f03f7-3d95-4d54-a4f9-9ba5556d0c71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:32.873855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-762f03f7-3d95-4d54-a4f9-9ba5556d0c71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:32.884601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-762f03f7-3d95-4d54-a4f9-9ba5556d0c71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:32.885300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-762f03f7-3d95-4d54-a4f9-9ba5556d0c71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:32.886362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-762f03f7-3d95-4d54-a4f9-9ba5556d0c71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:32.886981 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-762f03f7-3d95-4d54-a4f9-9ba5556d0c71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:32.991203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:32.991889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:32.998919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:32.999381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:33.000166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:33.000616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:33.032715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-762f03f7-3d95-4d54-a4f9-9ba5556d0c71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:33.041395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-762f03f7-3d95-4d54-a4f9-9ba5556d0c71 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175060 Jun 02 19:21:33.041888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1002/2008] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:32 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:33.064317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:33.073899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:33.075451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:33.076612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bff5fdb6-c5c8-4a6e-b8e6-19f4fef5e642 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.089424 Jun 02 19:21:33.077170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1007/2009] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:34.058584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9c59f5b3-7775-4276-aff5-ac5fe2e45648 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:34.059187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9c59f5b3-7775-4276-aff5-ac5fe2e45648 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:34.066116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c59f5b3-7775-4276-aff5-ac5fe2e45648 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:34.066568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c59f5b3-7775-4276-aff5-ac5fe2e45648 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:34.067332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c59f5b3-7775-4276-aff5-ac5fe2e45648 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:34.067824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c59f5b3-7775-4276-aff5-ac5fe2e45648 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:34.096596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:34.097190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:34.104232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:34.104415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:34.105217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:34.105728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:34.187238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:34.196376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:34.198105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:34.199288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-43dcec1e-f0ee-406b-9729-03a351ee9b72 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.107794 Jun 02 19:21:34.199850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1008/2010] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:34.231376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9c59f5b3-7775-4276-aff5-ac5fe2e45648 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:34.239641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9c59f5b3-7775-4276-aff5-ac5fe2e45648 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.185177 Jun 02 19:21:34.240204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1003/2011] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:34 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:35.218110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:35.218725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:35.225694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:35.226190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:35.226969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:35.227409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:35.256889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-66c0b7e6-4931-4952-b05d-20f398e91339 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:35.257480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-66c0b7e6-4931-4952-b05d-20f398e91339 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:35.264418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66c0b7e6-4931-4952-b05d-20f398e91339 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:35.264869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66c0b7e6-4931-4952-b05d-20f398e91339 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:35.265628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66c0b7e6-4931-4952-b05d-20f398e91339 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:35.266079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66c0b7e6-4931-4952-b05d-20f398e91339 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:35.291256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:35.300096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:35.301603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:35.302808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6672c1b6-2923-4ef5-9d47-bf8fca94f114 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088893 Jun 02 19:21:35.303361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1009/2012] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:35.401509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-66c0b7e6-4931-4952-b05d-20f398e91339 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:35.415084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-66c0b7e6-4931-4952-b05d-20f398e91339 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161726 Jun 02 19:21:35.416003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1004/2013] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:35 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:36.323192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:36.324626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:36.333746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:36.334391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:36.335419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:36.336004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:36.399399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:36.408606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:36.410146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:36.411298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4f43f29a-f9c0-44fa-833d-9b1b2feba9ed tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093461 Jun 02 19:21:36.411845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1010/2014] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:36.435255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9ecc44d8-257c-4c76-9aec-a0c0fb982d0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:36.435852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9ecc44d8-257c-4c76-9aec-a0c0fb982d0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:36.442993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ecc44d8-257c-4c76-9aec-a0c0fb982d0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:36.443446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ecc44d8-257c-4c76-9aec-a0c0fb982d0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:36.444258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ecc44d8-257c-4c76-9aec-a0c0fb982d0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:36.444694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ecc44d8-257c-4c76-9aec-a0c0fb982d0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:36.596349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9ecc44d8-257c-4c76-9aec-a0c0fb982d0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:36.604399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9ecc44d8-257c-4c76-9aec-a0c0fb982d0e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175166 Jun 02 19:21:36.604937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1005/2015] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:36 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:37.439408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:37.440798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:37.450593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:37.451053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:37.451829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:37.452274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:37.517508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:37.526463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:37.527952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:37.529182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ee694823-1bd0-4e34-8d08-a49f88626929 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096520 Jun 02 19:21:37.529743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1011/2016] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:37.621448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e788910c-221f-4ece-9711-f181b6dafd16 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:37.622083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e788910c-221f-4ece-9711-f181b6dafd16 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:37.629029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e788910c-221f-4ece-9711-f181b6dafd16 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:37.629478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e788910c-221f-4ece-9711-f181b6dafd16 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:37.630273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e788910c-221f-4ece-9711-f181b6dafd16 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:37.630703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e788910c-221f-4ece-9711-f181b6dafd16 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:37.769419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e788910c-221f-4ece-9711-f181b6dafd16 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:37.771712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:37.780697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e788910c-221f-4ece-9711-f181b6dafd16 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161712 Jun 02 19:21:37.780697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1006/2017] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:37 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:38.550295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:38.551006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:38.560122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:38.560605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:38.561384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:38.561832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:38.625136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:38.633890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:38.635400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:38.636568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-069e7aec-a97d-49dc-82d1-025030bb5d7d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092570 Jun 02 19:21:38.637135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1012/2018] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:38.800732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e21c8b8f-83fe-4f67-ab86-832e90a4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:38.801729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e21c8b8f-83fe-4f67-ab86-832e90a4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:38.811105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e21c8b8f-83fe-4f67-ab86-832e90a4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:38.811556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e21c8b8f-83fe-4f67-ab86-832e90a4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:38.812364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e21c8b8f-83fe-4f67-ab86-832e90a4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:38.812796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e21c8b8f-83fe-4f67-ab86-832e90a4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:38.958174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e21c8b8f-83fe-4f67-ab86-832e90a4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:38.966563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e21c8b8f-83fe-4f67-ab86-832e90a4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172325 Jun 02 19:21:38.967157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1007/2019] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:38 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:39.657140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:39.657770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:39.667792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:39.668163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:39.668956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:39.669358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:39.738081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:39.747030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:39.748533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:39.749705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0955cebf-07df-48c8-9f6e-8fd2cc5b0c0a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099019 Jun 02 19:21:39.750267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1013/2020] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:39.987723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2762d711-45c2-490f-91b1-180ae7b7a13f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:39.988661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2762d711-45c2-490f-91b1-180ae7b7a13f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:39.997669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2762d711-45c2-490f-91b1-180ae7b7a13f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:39.998135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2762d711-45c2-490f-91b1-180ae7b7a13f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:39.998914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2762d711-45c2-490f-91b1-180ae7b7a13f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:39.999347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2762d711-45c2-490f-91b1-180ae7b7a13f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:40.135754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2762d711-45c2-490f-91b1-180ae7b7a13f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:40.144089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2762d711-45c2-490f-91b1-180ae7b7a13f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162748 Jun 02 19:21:40.144654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1008/2021] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:39 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:40.771295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:40.772361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:40.781282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:40.781746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:40.782553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:40.783000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:40.849318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:40.858136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:40.859642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:40.860802 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b10f7641-46b9-4003-9638-f3aa15bfb454 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096207 Jun 02 19:21:40.861390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1014/2022] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:41.165493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0d450ae4-d3ad-4a31-aa72-f11942f46480 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:41.166624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0d450ae4-d3ad-4a31-aa72-f11942f46480 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:41.173913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d450ae4-d3ad-4a31-aa72-f11942f46480 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:41.174372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d450ae4-d3ad-4a31-aa72-f11942f46480 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:41.175138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d450ae4-d3ad-4a31-aa72-f11942f46480 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:41.175570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0d450ae4-d3ad-4a31-aa72-f11942f46480 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:41.322587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0d450ae4-d3ad-4a31-aa72-f11942f46480 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:41.331122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0d450ae4-d3ad-4a31-aa72-f11942f46480 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172184 Jun 02 19:21:41.331716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1009/2023] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:41 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:41.880854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:41.881782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:41.890029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:41.890486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:41.891250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:41.891722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:41.959325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:41.968315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:41.969838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:41.970980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-21379089-b3d7-4e86-81fa-1c95968b7b12 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095615 Jun 02 19:21:41.971532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1015/2024] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:42.351085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e413bd01-3d4d-4fc9-88b9-e4f52090a4d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:42.351947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e413bd01-3d4d-4fc9-88b9-e4f52090a4d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:42.362689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e413bd01-3d4d-4fc9-88b9-e4f52090a4d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:42.363437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e413bd01-3d4d-4fc9-88b9-e4f52090a4d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:42.364712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e413bd01-3d4d-4fc9-88b9-e4f52090a4d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:42.365392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e413bd01-3d4d-4fc9-88b9-e4f52090a4d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:42.504115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e413bd01-3d4d-4fc9-88b9-e4f52090a4d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:42.512674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e413bd01-3d4d-4fc9-88b9-e4f52090a4d1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167764 Jun 02 19:21:42.513250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1010/2025] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:42 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:42.993219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:42.994202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:43.002230 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:43.002688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:43.003460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:43.003898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:43.075433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:43.091312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:43.092812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:43.094006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-84995d31-c188-442a-b786-07b2e6a8c1fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.107261 Jun 02 19:21:43.094587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1016/2026] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:43.531586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-47c601d3-3fd6-46d1-b221-66e8eedd4131 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:43.532271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-47c601d3-3fd6-46d1-b221-66e8eedd4131 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:43.540541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47c601d3-3fd6-46d1-b221-66e8eedd4131 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:43.541075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47c601d3-3fd6-46d1-b221-66e8eedd4131 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:43.542173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47c601d3-3fd6-46d1-b221-66e8eedd4131 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:43.543185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47c601d3-3fd6-46d1-b221-66e8eedd4131 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:43.684336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-47c601d3-3fd6-46d1-b221-66e8eedd4131 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:43.693153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-47c601d3-3fd6-46d1-b221-66e8eedd4131 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167045 Jun 02 19:21:43.693715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1011/2027] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:43 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:44.114748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:44.115568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:44.125604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:44.126289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:44.127379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:44.128041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:44.195106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:44.204174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:44.205674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:44.206838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8964de40-a918-4d61-88e1-77ae79b7ff20 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097741 Jun 02 19:21:44.207398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1017/2028] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:44.714249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d4d198d2-6fb5-4ce6-8f7e-50598e9a280d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:44.714886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d4d198d2-6fb5-4ce6-8f7e-50598e9a280d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:44.722007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4d198d2-6fb5-4ce6-8f7e-50598e9a280d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:44.722525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4d198d2-6fb5-4ce6-8f7e-50598e9a280d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:44.723297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4d198d2-6fb5-4ce6-8f7e-50598e9a280d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:44.723736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4d198d2-6fb5-4ce6-8f7e-50598e9a280d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:44.867137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d4d198d2-6fb5-4ce6-8f7e-50598e9a280d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:44.876005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d4d198d2-6fb5-4ce6-8f7e-50598e9a280d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167999 Jun 02 19:21:44.876579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1012/2029] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:44 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:45.228896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:45.229963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:45.238604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:45.239326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:45.240136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:45.240653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:45.306971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:45.316670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:45.318349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:45.319504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-336d48b1-4830-4fc6-9d64-b9262ae98bf7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097488 Jun 02 19:21:45.320053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1018/2030] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:45.897526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dc94cd21-d8a3-4ef3-b35f-119d8cf9c980 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:45.898550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dc94cd21-d8a3-4ef3-b35f-119d8cf9c980 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:45.910748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc94cd21-d8a3-4ef3-b35f-119d8cf9c980 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:45.911591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc94cd21-d8a3-4ef3-b35f-119d8cf9c980 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:45.914037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc94cd21-d8a3-4ef3-b35f-119d8cf9c980 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:45.914780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc94cd21-d8a3-4ef3-b35f-119d8cf9c980 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:46.060492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dc94cd21-d8a3-4ef3-b35f-119d8cf9c980 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:46.069691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dc94cd21-d8a3-4ef3-b35f-119d8cf9c980 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.178713 Jun 02 19:21:46.070292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1013/2031] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:45 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:46.340856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:46.341445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:46.348285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:46.348740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:46.349501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:46.349969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:46.353866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:46.417410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:46.426638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:46.428143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:46.429266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8ec79c68-1c82-4ab4-81b0-cc9f5cf1e04e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093987 Jun 02 19:21:46.429833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1019/2032] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:47.089690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6432ea10-14ae-47d1-b7a2-6ac97fbf16a1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:47.090294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6432ea10-14ae-47d1-b7a2-6ac97fbf16a1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:47.097083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6432ea10-14ae-47d1-b7a2-6ac97fbf16a1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:47.097535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6432ea10-14ae-47d1-b7a2-6ac97fbf16a1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:47.098419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6432ea10-14ae-47d1-b7a2-6ac97fbf16a1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:47.098851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6432ea10-14ae-47d1-b7a2-6ac97fbf16a1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:47.240897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6432ea10-14ae-47d1-b7a2-6ac97fbf16a1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:47.249338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6432ea10-14ae-47d1-b7a2-6ac97fbf16a1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166261 Jun 02 19:21:47.250231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1014/2033] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:47 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:47.454615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:47.455236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:47.461864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:47.462344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:47.463122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:47.463565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:47.536580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:47.546588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:47.548108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:47.549298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-81972c76-07e5-4182-8e96-106da12afd05 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098604 Jun 02 19:21:47.549893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1020/2034] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:48.270032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d66f381d-0dcc-4e66-8beb-4769cf65b45b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:48.270664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d66f381d-0dcc-4e66-8beb-4769cf65b45b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:48.277425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d66f381d-0dcc-4e66-8beb-4769cf65b45b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:48.277916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d66f381d-0dcc-4e66-8beb-4769cf65b45b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:48.278722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d66f381d-0dcc-4e66-8beb-4769cf65b45b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:48.279162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d66f381d-0dcc-4e66-8beb-4769cf65b45b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:48.412036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d66f381d-0dcc-4e66-8beb-4769cf65b45b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:48.420557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d66f381d-0dcc-4e66-8beb-4769cf65b45b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.154549 Jun 02 19:21:48.421161 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1015/2035] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:48 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:48.568316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:48.568951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:48.575923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:48.576377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:48.577144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:48.577586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:48.643791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:48.653143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:48.654686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:48.655877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e8e59cb8-3158-4734-a319-fb8b98e9fca6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091997 Jun 02 19:21:48.656433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1021/2036] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:49.438395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0bfb8f83-3bd6-4b03-989c-b5813415cdad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:49.439056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0bfb8f83-3bd6-4b03-989c-b5813415cdad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:49.446517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0bfb8f83-3bd6-4b03-989c-b5813415cdad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:49.446965 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0bfb8f83-3bd6-4b03-989c-b5813415cdad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:49.447728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0bfb8f83-3bd6-4b03-989c-b5813415cdad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:49.448160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0bfb8f83-3bd6-4b03-989c-b5813415cdad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:49.584336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0bfb8f83-3bd6-4b03-989c-b5813415cdad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:49.595422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0bfb8f83-3bd6-4b03-989c-b5813415cdad tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160988 Jun 02 19:21:49.595978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1016/2037] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:49 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:49.674857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:49.675493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:49.683213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:49.683824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:49.684624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:49.685086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:49.751610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:49.760519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:49.762247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:49.763576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e063fce4-87be-40b6-84fb-4e6b86d058d2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092842 Jun 02 19:21:49.764147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1022/2038] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:50.612759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3437e984-e9a5-41e2-9647-1b74a3ab9d06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:50.613406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3437e984-e9a5-41e2-9647-1b74a3ab9d06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:50.620407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3437e984-e9a5-41e2-9647-1b74a3ab9d06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:50.620960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3437e984-e9a5-41e2-9647-1b74a3ab9d06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:50.621709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3437e984-e9a5-41e2-9647-1b74a3ab9d06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:50.622202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3437e984-e9a5-41e2-9647-1b74a3ab9d06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:50.755949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3437e984-e9a5-41e2-9647-1b74a3ab9d06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:50.764423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3437e984-e9a5-41e2-9647-1b74a3ab9d06 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.155621 Jun 02 19:21:50.765009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1017/2039] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:50 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:50.781924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:50.782510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:50.789499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:50.789909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:50.790680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:50.791113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:50.857857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:50.866569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:50.868068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:50.869204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3d61da96-5888-4b66-b929-d514df27f6d3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091269 Jun 02 19:21:50.869773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1023/2040] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:50 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:51.789853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea150c6e-67da-4462-a11b-9e0e793726ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:51.790475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ea150c6e-67da-4462-a11b-9e0e793726ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:51.797675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea150c6e-67da-4462-a11b-9e0e793726ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:51.798156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea150c6e-67da-4462-a11b-9e0e793726ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:51.798913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea150c6e-67da-4462-a11b-9e0e793726ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:51.799347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea150c6e-67da-4462-a11b-9e0e793726ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:51.887603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:51.888209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:51.895131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:51.895616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:51.896404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:51.896936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:51.954910 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ea150c6e-67da-4462-a11b-9e0e793726ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:51.963186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ea150c6e-67da-4462-a11b-9e0e793726ce tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.177396 Jun 02 19:21:51.963768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1018/2041] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:51 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:51.979240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:51.988516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:51.990073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:51.991244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9518b7e5-71b7-43f4-93ac-4d492d294f4d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.108152 Jun 02 19:21:51.991782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1024/2042] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:21:52.980862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1529e554-1eb4-49cf-b9b7-e011442d4f7f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:52.981554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1529e554-1eb4-49cf-b9b7-e011442d4f7f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:52.988480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1529e554-1eb4-49cf-b9b7-e011442d4f7f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:52.988932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1529e554-1eb4-49cf-b9b7-e011442d4f7f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:52.989693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1529e554-1eb4-49cf-b9b7-e011442d4f7f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:52.990162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1529e554-1eb4-49cf-b9b7-e011442d4f7f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:53.008743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:53.009543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:53.016493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:53.016934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:53.017745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:53.018194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:53.091508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:53.100608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:53.102149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:53.103323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1f42c42f-6d49-45b5-84d7-5116c68bb10a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098585 Jun 02 19:21:53.104147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1025/2043] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:53.151320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1529e554-1eb4-49cf-b9b7-e011442d4f7f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:53.160854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1529e554-1eb4-49cf-b9b7-e011442d4f7f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.183916 Jun 02 19:21:53.161400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1019/2044] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:52 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:54.122209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:54.122836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:54.130292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:54.130821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:54.131718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:54.132208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:54.180877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9eccde99-28e5-460b-9a81-356e921845c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:54.181539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9eccde99-28e5-460b-9a81-356e921845c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:54.189126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9eccde99-28e5-460b-9a81-356e921845c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:54.189601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9eccde99-28e5-460b-9a81-356e921845c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:54.190743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9eccde99-28e5-460b-9a81-356e921845c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:54.191172 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9eccde99-28e5-460b-9a81-356e921845c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:54.197768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:54.207152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:54.208649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:54.209784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-389f3c84-f901-40b0-ad30-f013817edc92 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091745 Jun 02 19:21:54.210373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1026/2045] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:54.325675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9eccde99-28e5-460b-9a81-356e921845c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:54.334213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9eccde99-28e5-460b-9a81-356e921845c1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.157347 Jun 02 19:21:54.334783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1020/2046] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:54 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:55.228330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:55.228935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:55.236134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:55.236594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:55.237372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:55.237914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:55.303849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:55.312877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:55.314428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:55.315928 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-91bf7ba4-c46b-4d66-861d-808f3d5dd3a8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091695 Jun 02 19:21:55.316490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1027/2047] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:55.351589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54b783f9-aa1b-43a2-af14-1329c2c4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:55.352199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-54b783f9-aa1b-43a2-af14-1329c2c4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:55.359588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54b783f9-aa1b-43a2-af14-1329c2c4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:55.360040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54b783f9-aa1b-43a2-af14-1329c2c4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:55.360809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54b783f9-aa1b-43a2-af14-1329c2c4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:55.361244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54b783f9-aa1b-43a2-af14-1329c2c4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:55.497197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-54b783f9-aa1b-43a2-af14-1329c2c4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:55.505638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-54b783f9-aa1b-43a2-af14-1329c2c4a955 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.157912 Jun 02 19:21:55.506244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1021/2048] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:55 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:56.334421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:56.335071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:56.342012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:56.342468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:56.343232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:56.343667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:56.412176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:56.421779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:56.423348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:56.424563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47a9c764-490c-4a1e-8f8a-cc365e254c84 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094129 Jun 02 19:21:56.425175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1028/2049] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:56.523197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4a41a523-2664-4bcd-913e-5ead640cf9eb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:56.523826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4a41a523-2664-4bcd-913e-5ead640cf9eb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:56.531199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a41a523-2664-4bcd-913e-5ead640cf9eb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:56.531650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a41a523-2664-4bcd-913e-5ead640cf9eb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:56.532419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a41a523-2664-4bcd-913e-5ead640cf9eb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:56.532855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a41a523-2664-4bcd-913e-5ead640cf9eb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:56.671721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4a41a523-2664-4bcd-913e-5ead640cf9eb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:56.680736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4a41a523-2664-4bcd-913e-5ead640cf9eb tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161430 Jun 02 19:21:56.681306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1022/2050] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:56 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:57.443532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:57.444246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:57.453068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:57.453741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:57.454947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:57.455614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:57.523141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:57.533751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:57.535507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:57.536833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e63860d3-c598-4daf-91bb-9d1d1577b4ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097650 Jun 02 19:21:57.537401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1029/2051] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:57.699007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-52a218a1-db90-4f43-bf97-4779c32a9cb1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:57.699577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-52a218a1-db90-4f43-bf97-4779c32a9cb1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:57.706571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52a218a1-db90-4f43-bf97-4779c32a9cb1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:57.707028 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52a218a1-db90-4f43-bf97-4779c32a9cb1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:57.707806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52a218a1-db90-4f43-bf97-4779c32a9cb1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:57.708266 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-52a218a1-db90-4f43-bf97-4779c32a9cb1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:57.723059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:57.854050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-52a218a1-db90-4f43-bf97-4779c32a9cb1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:57.862978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-52a218a1-db90-4f43-bf97-4779c32a9cb1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.168087 Jun 02 19:21:57.863554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1023/2052] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:57 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:58.556198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:58.556783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:58.564168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:58.564625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:58.565750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:58.566219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:58.632499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:58.641627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:58.643164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:58.644329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c15bb54a-be3b-4845-8abc-d3fff6f8d6dd tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092162 Jun 02 19:21:58.644854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1030/2053] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:21:58.880935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b49dc23c-8c3b-42b1-b039-1d8cccec1b72 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:58.881493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b49dc23c-8c3b-42b1-b039-1d8cccec1b72 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:58.889163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b49dc23c-8c3b-42b1-b039-1d8cccec1b72 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:58.889688 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b49dc23c-8c3b-42b1-b039-1d8cccec1b72 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:58.890608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b49dc23c-8c3b-42b1-b039-1d8cccec1b72 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:58.891157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b49dc23c-8c3b-42b1-b039-1d8cccec1b72 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:59.023023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b49dc23c-8c3b-42b1-b039-1d8cccec1b72 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:59.038463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b49dc23c-8c3b-42b1-b039-1d8cccec1b72 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160976 Jun 02 19:21:59.039622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1024/2054] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:21:58 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:21:59.662561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:21:59.663203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:21:59.665831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:59.672095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:59.672555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:59.673347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:21:59.673788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:21:59.738404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:59.747765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:59.749229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:21:59.750396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b162eb44-1680-49fa-bfdd-3ba9a64bcda1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091959 Jun 02 19:21:59.750987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1031/2055] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:21:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:00.057123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7f2b8e4f-ba10-4eb0-be90-bc1d69079f82 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:00.057785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7f2b8e4f-ba10-4eb0-be90-bc1d69079f82 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:00.064345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f2b8e4f-ba10-4eb0-be90-bc1d69079f82 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:00.064817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f2b8e4f-ba10-4eb0-be90-bc1d69079f82 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:00.065975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f2b8e4f-ba10-4eb0-be90-bc1d69079f82 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:00.066405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f2b8e4f-ba10-4eb0-be90-bc1d69079f82 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:00.204623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7f2b8e4f-ba10-4eb0-be90-bc1d69079f82 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:00.213082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7f2b8e4f-ba10-4eb0-be90-bc1d69079f82 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160063 Jun 02 19:22:00.213699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1025/2056] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:00 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:00.769107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:00.769689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:00.776840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:00.777361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:00.778198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:00.778767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:00.844905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:00.853605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:00.855427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:00.856591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b37b4eb4-795f-428f-90a6-d2c597e9e370 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091753 Jun 02 19:22:00.857168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1032/2057] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:00 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:01.230641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3ac4211-12ba-4310-a9d8-ba2ee0b1554d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:01.231259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c3ac4211-12ba-4310-a9d8-ba2ee0b1554d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:01.233598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:01.239103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3ac4211-12ba-4310-a9d8-ba2ee0b1554d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:01.239582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3ac4211-12ba-4310-a9d8-ba2ee0b1554d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:01.240364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3ac4211-12ba-4310-a9d8-ba2ee0b1554d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:01.240798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c3ac4211-12ba-4310-a9d8-ba2ee0b1554d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:01.374700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c3ac4211-12ba-4310-a9d8-ba2ee0b1554d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:01.383397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3ac4211-12ba-4310-a9d8-ba2ee0b1554d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.156774 Jun 02 19:22:01.383977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1026/2058] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:01 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:01.875451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:01.876045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:01.883055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:01.883515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:01.884294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:01.884741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:01.951463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:01.960239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:01.961785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:01.962963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1268e16e-c9db-4d26-99f1-e90f4abc53e0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091645 Jun 02 19:22:01.963524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1033/2059] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:02.400979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fadaaa2d-ed3f-4ae3-973e-30464e53c105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:02.401868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fadaaa2d-ed3f-4ae3-973e-30464e53c105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:02.408626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fadaaa2d-ed3f-4ae3-973e-30464e53c105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:02.409074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fadaaa2d-ed3f-4ae3-973e-30464e53c105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:02.409830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fadaaa2d-ed3f-4ae3-973e-30464e53c105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:02.410301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fadaaa2d-ed3f-4ae3-973e-30464e53c105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:02.546563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fadaaa2d-ed3f-4ae3-973e-30464e53c105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:02.554763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fadaaa2d-ed3f-4ae3-973e-30464e53c105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.157798 Jun 02 19:22:02.555365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1027/2060] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:02 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:22:02.981437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:02.982133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:02.989406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:02.989952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:02.990764 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:02.991205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:03.058896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:03.068547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:03.070078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:03.071311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-42ce6d2e-57c1-428e-86fd-c34197fdd81e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094306 Jun 02 19:22:03.071822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1034/2061] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:03.572482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd6cb0cc-2887-41dd-9a89-1c20febdc7a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:03.574006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fd6cb0cc-2887-41dd-9a89-1c20febdc7a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:03.581058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd6cb0cc-2887-41dd-9a89-1c20febdc7a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:03.581516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd6cb0cc-2887-41dd-9a89-1c20febdc7a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:03.582336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd6cb0cc-2887-41dd-9a89-1c20febdc7a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:03.582774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd6cb0cc-2887-41dd-9a89-1c20febdc7a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:03.727470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fd6cb0cc-2887-41dd-9a89-1c20febdc7a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:03.736313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd6cb0cc-2887-41dd-9a89-1c20febdc7a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167904 Jun 02 19:22:03.736896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1028/2062] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:03 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:04.089352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:04.090088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:04.096881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:04.097346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:04.098218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:04.098589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:04.166135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:04.171827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:04.180683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:04.183204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:04.184379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-140c4c1c-927c-4648-a5cc-81604cd244c6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099689 Jun 02 19:22:04.184962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1035/2063] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:04.754811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b5b2379b-d126-4392-821c-4efd283a5203 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:04.755394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b5b2379b-d126-4392-821c-4efd283a5203 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:04.762555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5b2379b-d126-4392-821c-4efd283a5203 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:04.763015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5b2379b-d126-4392-821c-4efd283a5203 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:04.763883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5b2379b-d126-4392-821c-4efd283a5203 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:04.764434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5b2379b-d126-4392-821c-4efd283a5203 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:04.902029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b5b2379b-d126-4392-821c-4efd283a5203 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:04.914104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b5b2379b-d126-4392-821c-4efd283a5203 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163412 Jun 02 19:22:04.914692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1029/2064] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:04 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:05.205560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:05.206368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:05.214247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:05.214710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:05.215494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:05.215970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:05.285723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:05.298628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:05.300499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:05.302174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6d4e2fcd-3b71-4b13-a07c-ee5899cecd1e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101288 Jun 02 19:22:05.302999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1036/2065] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:05.934325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-20a68549-7986-4096-91c8-08c248824196 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:05.935090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-20a68549-7986-4096-91c8-08c248824196 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:05.943658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20a68549-7986-4096-91c8-08c248824196 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:05.944107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20a68549-7986-4096-91c8-08c248824196 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:05.945037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20a68549-7986-4096-91c8-08c248824196 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:05.945623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20a68549-7986-4096-91c8-08c248824196 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:06.090863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-20a68549-7986-4096-91c8-08c248824196 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:06.100974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-20a68549-7986-4096-91c8-08c248824196 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171147 Jun 02 19:22:06.101671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1030/2066] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:05 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:06.322076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:06.322760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:06.331625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:06.332252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:06.333476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:06.334200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:06.400954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:06.410328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:06.411836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:06.412996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d74813ab-f3df-4771-93cb-a7db3e4bd11d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095360 Jun 02 19:22:06.413580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1037/2067] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:22:07.122584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fb9af167-0255-406b-ad67-72533b1e061e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:07.123522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fb9af167-0255-406b-ad67-72533b1e061e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:07.133419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb9af167-0255-406b-ad67-72533b1e061e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:07.134213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb9af167-0255-406b-ad67-72533b1e061e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:07.135019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb9af167-0255-406b-ad67-72533b1e061e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:07.135457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb9af167-0255-406b-ad67-72533b1e061e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:07.294205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fb9af167-0255-406b-ad67-72533b1e061e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:07.302818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fb9af167-0255-406b-ad67-72533b1e061e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.186631 Jun 02 19:22:07.303399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1031/2068] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:07 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:07.433376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:07.434118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:07.441404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:07.441910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:07.442755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:07.443190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:07.508410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:07.517565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:07.519109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:07.520271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a2b78bf0-6dd5-43d9-973a-163cd4e63b01 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092716 Jun 02 19:22:07.520829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1038/2069] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:08.324078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-efad8e46-6d43-4ff5-a3c9-e3b94fa1fb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:08.324787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-efad8e46-6d43-4ff5-a3c9-e3b94fa1fb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:08.332320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efad8e46-6d43-4ff5-a3c9-e3b94fa1fb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:08.332770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efad8e46-6d43-4ff5-a3c9-e3b94fa1fb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:08.333539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efad8e46-6d43-4ff5-a3c9-e3b94fa1fb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:08.334010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efad8e46-6d43-4ff5-a3c9-e3b94fa1fb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:08.470258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-efad8e46-6d43-4ff5-a3c9-e3b94fa1fb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:08.478856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-efad8e46-6d43-4ff5-a3c9-e3b94fa1fb8d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160755 Jun 02 19:22:08.479439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1032/2070] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:08 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:08.540992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:08.541608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:08.548873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:08.549333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:08.550155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:08.550591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:08.618370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:08.628841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:08.630393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:08.631555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e9b364a0-d1a5-4a68-98c0-244fb9d59ad6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094601 Jun 02 19:22:08.632122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1039/2071] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:09.502738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-27c2473d-0927-4836-ac10-089d8116c00b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:09.503704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-27c2473d-0927-4836-ac10-089d8116c00b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:09.514288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27c2473d-0927-4836-ac10-089d8116c00b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:09.515052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27c2473d-0927-4836-ac10-089d8116c00b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:09.516313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27c2473d-0927-4836-ac10-089d8116c00b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:09.517057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27c2473d-0927-4836-ac10-089d8116c00b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:09.650434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:09.651151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:09.655813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-27c2473d-0927-4836-ac10-089d8116c00b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:09.658127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:09.658580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:09.659362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:09.659799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:09.664056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-27c2473d-0927-4836-ac10-089d8116c00b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169163 Jun 02 19:22:09.664636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1033/2072] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:09 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:09.727236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:09.736043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:09.737599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:09.738782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-05dc96c6-6f1f-4f4c-8ed1-1dc0070ccd6e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092363 Jun 02 19:22:09.739350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1040/2073] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:10.686246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-900aaae3-e156-4551-b23e-8661579320ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:10.686842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-900aaae3-e156-4551-b23e-8661579320ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:10.694222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-900aaae3-e156-4551-b23e-8661579320ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:10.694672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-900aaae3-e156-4551-b23e-8661579320ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:10.695436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-900aaae3-e156-4551-b23e-8661579320ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:10.695868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-900aaae3-e156-4551-b23e-8661579320ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:10.756970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:10.757603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:10.764620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:10.765076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:10.765857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:10.766348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:10.840312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:10.849148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:10.850676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:10.851853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-55b9caf4-e43e-4167-ad07-1630fb919b63 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099102 Jun 02 19:22:10.852406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1041/2074] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:10 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:10.862245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-900aaae3-e156-4551-b23e-8661579320ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:10.874264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-900aaae3-e156-4551-b23e-8661579320ef tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.194281 Jun 02 19:22:10.874895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1034/2075] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:10 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:11.874283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:11.875311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:11.886155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:11.886892 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:11.888153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:11.888993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:11.893299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-70f7d551-9420-445e-8a66-de124eb6954e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:11.893944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-70f7d551-9420-445e-8a66-de124eb6954e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:11.900805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70f7d551-9420-445e-8a66-de124eb6954e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:11.901251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70f7d551-9420-445e-8a66-de124eb6954e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:11.902180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70f7d551-9420-445e-8a66-de124eb6954e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:11.902618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70f7d551-9420-445e-8a66-de124eb6954e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:11.961136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:11.970528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:11.972010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:11.973147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-daf3bba2-80ec-41e0-99a2-13f2a946bf1f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105703 Jun 02 19:22:11.973685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1042/2076] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:12.056701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-70f7d551-9420-445e-8a66-de124eb6954e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:12.067074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-70f7d551-9420-445e-8a66-de124eb6954e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.177671 Jun 02 19:22:12.067660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1035/2077] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:11 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:12.997050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:12.998151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:13.005620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:13.006121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:13.006884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:13.007314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:13.079531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:13.084560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-56f674d9-d4e0-4bf6-9bb8-7aa36ac32ca7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:13.085164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-56f674d9-d4e0-4bf6-9bb8-7aa36ac32ca7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:13.089013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:13.090581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:13.091885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-64dc79b3-c3ba-41a7-8ffb-6d8b01a124b4 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101442 Jun 02 19:22:13.092196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56f674d9-d4e0-4bf6-9bb8-7aa36ac32ca7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:13.092527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1043/2078] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:13.098053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56f674d9-d4e0-4bf6-9bb8-7aa36ac32ca7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:13.098920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56f674d9-d4e0-4bf6-9bb8-7aa36ac32ca7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:13.099362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56f674d9-d4e0-4bf6-9bb8-7aa36ac32ca7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:13.246265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-56f674d9-d4e0-4bf6-9bb8-7aa36ac32ca7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:13.255241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-56f674d9-d4e0-4bf6-9bb8-7aa36ac32ca7 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174563 Jun 02 19:22:13.255808 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1036/2079] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:13 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:14.112070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:14.112728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:14.120155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:14.120631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:14.121438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:14.121922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:14.201426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:14.215593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:14.218258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:14.220078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a3a593af-cb4e-4de1-8278-fbb0eb1b507c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.112414 Jun 02 19:22:14.220874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1044/2080] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:14.275401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aff9f580-0658-4297-9e04-e6f1c5101aaf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:14.276021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aff9f580-0658-4297-9e04-e6f1c5101aaf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:14.285570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aff9f580-0658-4297-9e04-e6f1c5101aaf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:14.286174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aff9f580-0658-4297-9e04-e6f1c5101aaf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:14.287240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aff9f580-0658-4297-9e04-e6f1c5101aaf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:14.287868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aff9f580-0658-4297-9e04-e6f1c5101aaf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:14.424468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aff9f580-0658-4297-9e04-e6f1c5101aaf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:14.433198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aff9f580-0658-4297-9e04-e6f1c5101aaf tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.164241 Jun 02 19:22:14.433776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1037/2081] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:14 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:15.243133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:15.243779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:15.250860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:15.251305 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:15.252147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:15.252583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:15.312986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:15.321958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:15.323445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:15.324574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6dacec6d-56d9-4cb0-9f4c-4a256417130b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.085605 Jun 02 19:22:15.325299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1045/2082] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:15.450737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-77c2b408-8161-4bbd-8796-0dd576abc06e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:15.451369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-77c2b408-8161-4bbd-8796-0dd576abc06e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:15.458576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77c2b408-8161-4bbd-8796-0dd576abc06e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:15.459881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77c2b408-8161-4bbd-8796-0dd576abc06e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:15.459881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77c2b408-8161-4bbd-8796-0dd576abc06e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:15.460202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-77c2b408-8161-4bbd-8796-0dd576abc06e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:15.606412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-77c2b408-8161-4bbd-8796-0dd576abc06e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:15.618863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-77c2b408-8161-4bbd-8796-0dd576abc06e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171805 Jun 02 19:22:15.619663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1038/2083] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:15 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:16.345896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:16.346831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:16.353683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:16.354172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:16.354948 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:16.355397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:16.419395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:16.428223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:16.429717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:16.430891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-626470a1-0f6b-4c81-bf34-578c76a54115 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091001 Jun 02 19:22:16.431450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1046/2084] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:16.643562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-472441b9-3a6d-4c9b-8fc0-495ddb0688df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:16.644200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-472441b9-3a6d-4c9b-8fc0-495ddb0688df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:16.651247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-472441b9-3a6d-4c9b-8fc0-495ddb0688df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:16.651723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-472441b9-3a6d-4c9b-8fc0-495ddb0688df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:16.652511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-472441b9-3a6d-4c9b-8fc0-495ddb0688df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:16.652949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-472441b9-3a6d-4c9b-8fc0-495ddb0688df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:16.806960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-472441b9-3a6d-4c9b-8fc0-495ddb0688df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:16.819353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-472441b9-3a6d-4c9b-8fc0-495ddb0688df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.182537 Jun 02 19:22:16.820147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1039/2085] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:16 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:17.448999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:17.449636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:17.457256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:17.457724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:17.458561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:17.459674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:17.532361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:17.541605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:17.543148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:17.544291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ef779ce5-a20f-467a-874c-b57e73e80bd1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099370 Jun 02 19:22:17.544886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1047/2086] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:17.840347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-21e47e7c-bfd2-4b63-8bf1-463d557aa60c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:17.840936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-21e47e7c-bfd2-4b63-8bf1-463d557aa60c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:17.848221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21e47e7c-bfd2-4b63-8bf1-463d557aa60c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:17.848679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21e47e7c-bfd2-4b63-8bf1-463d557aa60c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:17.849495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21e47e7c-bfd2-4b63-8bf1-463d557aa60c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:17.849960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21e47e7c-bfd2-4b63-8bf1-463d557aa60c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:17.852724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:17.984213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-21e47e7c-bfd2-4b63-8bf1-463d557aa60c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:17.992752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-21e47e7c-bfd2-4b63-8bf1-463d557aa60c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.156453 Jun 02 19:22:17.993298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1040/2087] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:17 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:18.562972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:18.563592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:18.571554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:18.572012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:18.572771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:18.573213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:18.645245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:18.654281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:18.655780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:18.656927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-570253c1-eabe-4f9a-a5f5-d87ab840e785 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097966 Jun 02 19:22:18.657462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1048/2088] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:19.017646 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6b3df2ed-b86a-4f6e-8f27-3a78359d6942 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:19.019117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6b3df2ed-b86a-4f6e-8f27-3a78359d6942 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:19.026466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b3df2ed-b86a-4f6e-8f27-3a78359d6942 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:19.026928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b3df2ed-b86a-4f6e-8f27-3a78359d6942 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:19.027693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b3df2ed-b86a-4f6e-8f27-3a78359d6942 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:19.028129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b3df2ed-b86a-4f6e-8f27-3a78359d6942 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:19.175728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6b3df2ed-b86a-4f6e-8f27-3a78359d6942 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:19.184943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6b3df2ed-b86a-4f6e-8f27-3a78359d6942 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173718 Jun 02 19:22:19.185521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1041/2089] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:19 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:19.675838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:19.676482 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:19.683661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:19.684193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:19.684963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:19.685397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:19.750864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:19.760007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:19.761761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:19.762944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-98d0947c-1fba-4f01-8ed6-e98e1b46337d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090998 Jun 02 19:22:19.763591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1049/2090] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:20.204273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-836b9a39-705b-4a16-bbc6-73a66337f222 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:20.205543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-836b9a39-705b-4a16-bbc6-73a66337f222 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:20.212729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-836b9a39-705b-4a16-bbc6-73a66337f222 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:20.213183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-836b9a39-705b-4a16-bbc6-73a66337f222 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:20.213993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-836b9a39-705b-4a16-bbc6-73a66337f222 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:20.214447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-836b9a39-705b-4a16-bbc6-73a66337f222 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:20.348356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-836b9a39-705b-4a16-bbc6-73a66337f222 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:20.357032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-836b9a39-705b-4a16-bbc6-73a66337f222 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.157697 Jun 02 19:22:20.357832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1042/2091] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:20 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:20.782267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:20.782902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:20.790475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:20.790867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:20.791654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:20.792102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:20.860245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:20.869701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:20.871243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:20.872403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1345d053-65d7-4e6f-afeb-32c2b71f646c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094577 Jun 02 19:22:20.872962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1050/2092] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:20 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:21.374946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3a1ca78e-8e10-4b95-94b3-5edd69d585b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:21.375527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3a1ca78e-8e10-4b95-94b3-5edd69d585b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:21.382863 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a1ca78e-8e10-4b95-94b3-5edd69d585b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:21.383313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a1ca78e-8e10-4b95-94b3-5edd69d585b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:21.384089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a1ca78e-8e10-4b95-94b3-5edd69d585b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:21.384516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a1ca78e-8e10-4b95-94b3-5edd69d585b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:21.525890 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3a1ca78e-8e10-4b95-94b3-5edd69d585b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:21.535567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3a1ca78e-8e10-4b95-94b3-5edd69d585b6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163814 Jun 02 19:22:21.535567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1043/2093] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:21 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:21.891289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:21.891894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:21.899223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:21.899679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:21.900460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:21.900896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:21.975363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:21.985015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:21.986892 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:21.988159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-91a1efd4-3b94-4cd2-b7ea-f552347a2cb6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101138 Jun 02 19:22:21.988743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1051/2094] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:22.553226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14aff18e-230a-4d5f-8532-2d6d76ace9df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:22.553884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14aff18e-230a-4d5f-8532-2d6d76ace9df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:22.560602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14aff18e-230a-4d5f-8532-2d6d76ace9df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:22.561057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14aff18e-230a-4d5f-8532-2d6d76ace9df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:22.561833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14aff18e-230a-4d5f-8532-2d6d76ace9df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:22.562330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14aff18e-230a-4d5f-8532-2d6d76ace9df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:22.701033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-14aff18e-230a-4d5f-8532-2d6d76ace9df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:22.710313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14aff18e-230a-4d5f-8532-2d6d76ace9df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161096 Jun 02 19:22:22.710864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1044/2095] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:22 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:23.008769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:23.009392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:23.016542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:23.017029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:23.017838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:23.018285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:23.039896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:23.085873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:23.094745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:23.096261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:23.098155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c445391a-6759-48f7-8e59-87b2a24bce15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093334 Jun 02 19:22:23.098740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1052/2096] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:23.731603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ce2fc614-bcdb-4499-8dda-16725f8546f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:23.732569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ce2fc614-bcdb-4499-8dda-16725f8546f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:23.741962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce2fc614-bcdb-4499-8dda-16725f8546f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:23.742416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce2fc614-bcdb-4499-8dda-16725f8546f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:23.743198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce2fc614-bcdb-4499-8dda-16725f8546f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:23.743633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce2fc614-bcdb-4499-8dda-16725f8546f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:23.883851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ce2fc614-bcdb-4499-8dda-16725f8546f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:23.896102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ce2fc614-bcdb-4499-8dda-16725f8546f4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171045 Jun 02 19:22:23.896710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1045/2097] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:23 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:24.116578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:24.117154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:24.124218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:24.124718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:24.125496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:24.125980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:24.206648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:24.219824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:24.222321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:24.223227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1a5757f1-23ad-4d3b-a708-94ce37a8953b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110696 Jun 02 19:22:24.223788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1053/2098] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:24.919881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1fd791cd-7a7b-47cb-bfb6-c7a0d870a88e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:24.920510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1fd791cd-7a7b-47cb-bfb6-c7a0d870a88e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:24.930388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fd791cd-7a7b-47cb-bfb6-c7a0d870a88e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:24.930834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fd791cd-7a7b-47cb-bfb6-c7a0d870a88e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:24.931617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fd791cd-7a7b-47cb-bfb6-c7a0d870a88e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:24.932043 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fd791cd-7a7b-47cb-bfb6-c7a0d870a88e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:25.070756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1fd791cd-7a7b-47cb-bfb6-c7a0d870a88e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:25.079331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1fd791cd-7a7b-47cb-bfb6-c7a0d870a88e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.164794 Jun 02 19:22:25.079912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1046/2099] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:24 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:25.241116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:25.241852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:25.252697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:25.253453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:25.254790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:25.255476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:25.329145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:25.341861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:25.344260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:25.346236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1c84ab3d-f6f5-4bf3-9d78-acea0d368b5a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.109041 Jun 02 19:22:25.347095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1054/2100] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:26.101542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d447231d-df4c-4f08-b39b-822784eeed21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:26.102210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d447231d-df4c-4f08-b39b-822784eeed21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:26.109456 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d447231d-df4c-4f08-b39b-822784eeed21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:26.110020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d447231d-df4c-4f08-b39b-822784eeed21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:26.110898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d447231d-df4c-4f08-b39b-822784eeed21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:26.111376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d447231d-df4c-4f08-b39b-822784eeed21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:26.365742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:26.366400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:26.373611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:26.374091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:26.374881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:26.375318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:26.476345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d447231d-df4c-4f08-b39b-822784eeed21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:26.485603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d447231d-df4c-4f08-b39b-822784eeed21 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.389210 Jun 02 19:22:26.486197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1047/2101] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:26 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:26.492797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:26.505715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:26.508203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:26.510168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bdcd2bdf-74df-4a05-9478-d03b949991e1 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.148939 Jun 02 19:22:26.511233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1055/2102] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:27.503725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3c298a6f-52eb-4182-a2a9-c2db11efa4af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:27.504400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3c298a6f-52eb-4182-a2a9-c2db11efa4af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:27.512044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c298a6f-52eb-4182-a2a9-c2db11efa4af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:27.512492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c298a6f-52eb-4182-a2a9-c2db11efa4af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:27.513251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c298a6f-52eb-4182-a2a9-c2db11efa4af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:27.513682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3c298a6f-52eb-4182-a2a9-c2db11efa4af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:27.536574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:27.537333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:27.544504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:27.544947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:27.545769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:27.546360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:27.625105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:27.637677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:27.639218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:27.640369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ac2e9bdc-3a8a-43ab-89e6-3cbf6e1685bb tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110286 Jun 02 19:22:27.640930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1056/2103] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:27.687841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3c298a6f-52eb-4182-a2a9-c2db11efa4af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:27.698005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3c298a6f-52eb-4182-a2a9-c2db11efa4af tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.198446 Jun 02 19:22:27.698604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1048/2104] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:27 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:28.661613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:28.662301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:28.673446 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:28.674072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:28.675232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:28.675881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:28.720864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-661df035-20f5-4b8a-877f-14d9c3284105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:28.721501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-661df035-20f5-4b8a-877f-14d9c3284105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:28.729403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-661df035-20f5-4b8a-877f-14d9c3284105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:28.729885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-661df035-20f5-4b8a-877f-14d9c3284105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:28.730670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-661df035-20f5-4b8a-877f-14d9c3284105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:28.731105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-661df035-20f5-4b8a-877f-14d9c3284105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:28.747290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:28.758069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:28.759680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:28.760854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ae5fc9a9-f4d3-4517-8816-9406e18e45e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105426 Jun 02 19:22:28.761496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1057/2105] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:28.878193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-661df035-20f5-4b8a-877f-14d9c3284105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:28.886846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-661df035-20f5-4b8a-877f-14d9c3284105 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171744 Jun 02 19:22:28.887432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1049/2106] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:28 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:29.779057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:29.779644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:29.782035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:29.787946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:29.788172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:29.788952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:29.789382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:29.861491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:29.870364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:29.871842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:29.872988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6b7f3b96-3af6-4bae-8ac5-a8be1e272fa3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097982 Jun 02 19:22:29.873527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1058/2107] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:29 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:29.904878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ac23c086-b996-456c-bbb3-f09e0fe24123 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:29.905481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ac23c086-b996-456c-bbb3-f09e0fe24123 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:29.912729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ac23c086-b996-456c-bbb3-f09e0fe24123 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:29.913194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ac23c086-b996-456c-bbb3-f09e0fe24123 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:29.914013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ac23c086-b996-456c-bbb3-f09e0fe24123 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:29.914452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ac23c086-b996-456c-bbb3-f09e0fe24123 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:30.050548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ac23c086-b996-456c-bbb3-f09e0fe24123 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:30.059393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ac23c086-b996-456c-bbb3-f09e0fe24123 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.158587 Jun 02 19:22:30.059994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1050/2108] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:29 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:30.891880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:30.892535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:30.900106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:30.900635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:30.901408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:30.901773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:30.969124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:30.979876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:30.981390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:30.982626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d28ef942-32ac-485e-9e83-2bcaeac03a8c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094812 Jun 02 19:22:30.983188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1059/2109] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:31.077326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9980075a-4304-475e-865e-039511cf289a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:31.078010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9980075a-4304-475e-865e-039511cf289a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:31.084963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9980075a-4304-475e-865e-039511cf289a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:31.085410 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9980075a-4304-475e-865e-039511cf289a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:31.086190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9980075a-4304-475e-865e-039511cf289a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:31.086765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9980075a-4304-475e-865e-039511cf289a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:31.234870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9980075a-4304-475e-865e-039511cf289a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:31.244204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9980075a-4304-475e-865e-039511cf289a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.170856 Jun 02 19:22:31.244958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1051/2110] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:31 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:32.001698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:32.002354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:32.009385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:32.009838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:32.010619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:32.011055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:32.083440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:32.092623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:32.094149 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:32.095306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-efce45ca-0a5f-40c2-8433-e0e23d17dd35 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097568 Jun 02 19:22:32.095871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1060/2111] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:32.266364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef324ad5-9b75-4c45-91dc-0d24a2c0363b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:32.267239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef324ad5-9b75-4c45-91dc-0d24a2c0363b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:32.270928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:32.277337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef324ad5-9b75-4c45-91dc-0d24a2c0363b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:32.277830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef324ad5-9b75-4c45-91dc-0d24a2c0363b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:32.278606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef324ad5-9b75-4c45-91dc-0d24a2c0363b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:32.279039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef324ad5-9b75-4c45-91dc-0d24a2c0363b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:32.417312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef324ad5-9b75-4c45-91dc-0d24a2c0363b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:32.425497 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef324ad5-9b75-4c45-91dc-0d24a2c0363b tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163829 Jun 02 19:22:32.426099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1052/2112] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:32 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:33.118637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:33.119244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:33.126402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:33.126857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:33.127879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:33.128345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:33.194877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:33.218794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:33.220922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:33.222736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b6eabc2f-7a6d-4658-a4f1-1f1afa1b8f81 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.108893 Jun 02 19:22:33.223575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1061/2113] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:33.445545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-565312fd-864d-4b88-8d10-153bb369b41d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:33.453523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-565312fd-864d-4b88-8d10-153bb369b41d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:33.460898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-565312fd-864d-4b88-8d10-153bb369b41d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:33.461563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-565312fd-864d-4b88-8d10-153bb369b41d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:33.462377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-565312fd-864d-4b88-8d10-153bb369b41d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:33.462809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-565312fd-864d-4b88-8d10-153bb369b41d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:33.606919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-565312fd-864d-4b88-8d10-153bb369b41d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:33.619377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-565312fd-864d-4b88-8d10-153bb369b41d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179712 Jun 02 19:22:33.620098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1053/2114] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:33 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:34.241545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:34.242283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:34.249470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:34.250013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:34.250816 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:34.251278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:34.315969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:34.325037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:34.326540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:34.327705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3544524f-e911-4358-862f-0b84588c65cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090405 Jun 02 19:22:34.328534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1062/2115] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:34.640797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-48fa93d8-2cb5-4575-99bd-e3af272cee08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:34.641416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-48fa93d8-2cb5-4575-99bd-e3af272cee08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:34.648921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48fa93d8-2cb5-4575-99bd-e3af272cee08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:34.649373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48fa93d8-2cb5-4575-99bd-e3af272cee08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:34.650167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48fa93d8-2cb5-4575-99bd-e3af272cee08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:34.650597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48fa93d8-2cb5-4575-99bd-e3af272cee08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:34.793085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-48fa93d8-2cb5-4575-99bd-e3af272cee08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:34.803937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-48fa93d8-2cb5-4575-99bd-e3af272cee08 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166993 Jun 02 19:22:34.804571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1054/2116] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:34 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:35.350551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:35.351525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:35.362662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:35.363427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:35.364700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:35.365437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:35.431040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:35.444462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:35.446995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:35.448858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d224f8f9-f315-4a9f-aa17-d916ecbc1423 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104650 Jun 02 19:22:35.449752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1063/2117] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:35.830115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7fb122e9-85e0-4869-a4f4-667ae45b3fb2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:35.831095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7fb122e9-85e0-4869-a4f4-667ae45b3fb2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:35.842098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7fb122e9-85e0-4869-a4f4-667ae45b3fb2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:35.842840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7fb122e9-85e0-4869-a4f4-667ae45b3fb2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:35.844101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7fb122e9-85e0-4869-a4f4-667ae45b3fb2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:35.844810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7fb122e9-85e0-4869-a4f4-667ae45b3fb2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:35.983420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7fb122e9-85e0-4869-a4f4-667ae45b3fb2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:35.997234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7fb122e9-85e0-4869-a4f4-667ae45b3fb2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173184 Jun 02 19:22:35.998200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1055/2118] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:35 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:36.556298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:36.557141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:36.566619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:36.567134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:36.568106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:36.568908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:36.633333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:36.642351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:36.643837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:36.644976 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-99ff903d-65f1-4efc-9479-6022940eca4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.176218 Jun 02 19:22:36.645567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1064/2119] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:37.018349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60817279-34e1-4c74-8608-c86c64267b42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:37.019061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-60817279-34e1-4c74-8608-c86c64267b42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:37.026752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60817279-34e1-4c74-8608-c86c64267b42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:37.027206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60817279-34e1-4c74-8608-c86c64267b42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:37.027963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60817279-34e1-4c74-8608-c86c64267b42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:37.028395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60817279-34e1-4c74-8608-c86c64267b42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:37.173982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-60817279-34e1-4c74-8608-c86c64267b42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:37.176257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:37.184279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-60817279-34e1-4c74-8608-c86c64267b42 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169772 Jun 02 19:22:37.185052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1056/2120] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:37 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:37.664573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:37.665200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:37.672644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:37.673104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:37.673910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:37.674354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:37.758690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:37.771066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:37.773076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:37.774257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-02d3f913-0b0d-49d6-8a47-057ac360f9fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.113809 Jun 02 19:22:37.774818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1065/2121] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:38.208155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-efdab3b9-4a39-49c9-8eb5-650aafd98726 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:38.209094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-efdab3b9-4a39-49c9-8eb5-650aafd98726 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:38.220202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efdab3b9-4a39-49c9-8eb5-650aafd98726 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:38.220987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efdab3b9-4a39-49c9-8eb5-650aafd98726 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:38.222227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efdab3b9-4a39-49c9-8eb5-650aafd98726 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:38.222987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efdab3b9-4a39-49c9-8eb5-650aafd98726 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:38.364722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-efdab3b9-4a39-49c9-8eb5-650aafd98726 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:38.373326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-efdab3b9-4a39-49c9-8eb5-650aafd98726 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172433 Jun 02 19:22:38.373911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1057/2122] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:38 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:38.794004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:38.794576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:38.803329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:38.803882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:38.804785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:38.805234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:38.878327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:38.887495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:38.889002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:38.890185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d63f6b4a-7df6-42ed-8df6-4ccedb094e68 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101179 Jun 02 19:22:38.890735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1066/2123] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:38 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:39.390810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd725d42-b9fa-4cc3-9f91-4e252e52d17e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:39.391532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fd725d42-b9fa-4cc3-9f91-4e252e52d17e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:39.398911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd725d42-b9fa-4cc3-9f91-4e252e52d17e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:39.399363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd725d42-b9fa-4cc3-9f91-4e252e52d17e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:39.400130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd725d42-b9fa-4cc3-9f91-4e252e52d17e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:39.400548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd725d42-b9fa-4cc3-9f91-4e252e52d17e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:39.548461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fd725d42-b9fa-4cc3-9f91-4e252e52d17e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:39.558780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd725d42-b9fa-4cc3-9f91-4e252e52d17e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171823 Jun 02 19:22:39.559424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1058/2124] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:39 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:39.913191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:39.914338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:39.925477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:39.926300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:39.927567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:39.928837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:39.992776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:40.001323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:40.002849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:40.003991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-97ce9220-67b3-486d-9863-08beee5c42ff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097684 Jun 02 19:22:40.004554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1067/2125] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:40.579466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a86237e8-2b66-46b2-9fab-c19a4a35ffb6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:40.580192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a86237e8-2b66-46b2-9fab-c19a4a35ffb6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:40.588046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a86237e8-2b66-46b2-9fab-c19a4a35ffb6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:40.588520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a86237e8-2b66-46b2-9fab-c19a4a35ffb6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:40.589575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a86237e8-2b66-46b2-9fab-c19a4a35ffb6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:40.590055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a86237e8-2b66-46b2-9fab-c19a4a35ffb6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:40.740169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a86237e8-2b66-46b2-9fab-c19a4a35ffb6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:40.749426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a86237e8-2b66-46b2-9fab-c19a4a35ffb6 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174287 Jun 02 19:22:40.750115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1059/2126] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:40 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:41.025774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:41.026398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:41.037152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:41.038096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:41.038735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:41.039158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:41.113252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:41.122660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:41.124180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:41.125402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-199caec2-2083-4596-99b5-07b43cf7dc13 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.106279 Jun 02 19:22:41.125977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1068/2127] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:41.769420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-31bad0d3-40c0-45e0-af9b-1c2e02120646 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:41.770104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-31bad0d3-40c0-45e0-af9b-1c2e02120646 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:41.778807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31bad0d3-40c0-45e0-af9b-1c2e02120646 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:41.779259 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31bad0d3-40c0-45e0-af9b-1c2e02120646 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:41.780033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31bad0d3-40c0-45e0-af9b-1c2e02120646 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:41.780467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31bad0d3-40c0-45e0-af9b-1c2e02120646 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:41.930652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-31bad0d3-40c0-45e0-af9b-1c2e02120646 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:41.944568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-31bad0d3-40c0-45e0-af9b-1c2e02120646 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.180744 Jun 02 19:22:41.945523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1060/2128] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:41 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:42.147658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:42.148275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:42.155218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:42.155670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:42.156450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:42.156882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:42.160919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:42.226589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:42.235822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:42.237319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:42.238588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f56a3ddd-5296-4928-8890-632967e0c5ae tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097200 Jun 02 19:22:42.239068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1069/2129] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:42.964327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c4be34fc-89a7-467e-810a-29ac13c080c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:42.964993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c4be34fc-89a7-467e-810a-29ac13c080c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:42.971771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4be34fc-89a7-467e-810a-29ac13c080c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:42.972217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4be34fc-89a7-467e-810a-29ac13c080c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:42.972969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4be34fc-89a7-467e-810a-29ac13c080c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:42.973401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4be34fc-89a7-467e-810a-29ac13c080c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:43.119442 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c4be34fc-89a7-467e-810a-29ac13c080c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:43.131810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c4be34fc-89a7-467e-810a-29ac13c080c4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.172143 Jun 02 19:22:43.132543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1061/2130] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:42 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:43.259908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:43.260585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:43.268785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:43.269266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:43.270117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:43.270582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:43.338292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:43.348440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:43.350358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:43.351765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e575e97-4486-4c3e-8bee-fdd65734dd2d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097088 Jun 02 19:22:43.352365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1070/2131] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:44.149379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14f76d37-23c4-4042-84a3-ac349deb7e57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:44.150023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14f76d37-23c4-4042-84a3-ac349deb7e57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:44.157294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14f76d37-23c4-4042-84a3-ac349deb7e57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:44.157758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14f76d37-23c4-4042-84a3-ac349deb7e57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:44.158555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14f76d37-23c4-4042-84a3-ac349deb7e57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:44.158994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14f76d37-23c4-4042-84a3-ac349deb7e57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:44.308966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-14f76d37-23c4-4042-84a3-ac349deb7e57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:44.318793 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14f76d37-23c4-4042-84a3-ac349deb7e57 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173779 Jun 02 19:22:44.319392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1062/2132] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:44 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:44.374234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:44.374838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:44.382501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:44.382501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:44.383302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:44.383712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:44.451411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:44.461296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:44.462980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:44.464151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-52e6fe3d-fa81-406b-8c63-19d49fea2973 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093935 Jun 02 19:22:44.464702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1071/2133] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:45.339123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-94585b50-3582-4b08-8fde-d4242bff5655 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:45.339772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-94585b50-3582-4b08-8fde-d4242bff5655 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:45.347139 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94585b50-3582-4b08-8fde-d4242bff5655 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:45.347588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94585b50-3582-4b08-8fde-d4242bff5655 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:45.348354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94585b50-3582-4b08-8fde-d4242bff5655 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:45.348788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94585b50-3582-4b08-8fde-d4242bff5655 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:45.482907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:45.483665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:45.492148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:45.492718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:45.493527 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:45.494100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:45.512479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-94585b50-3582-4b08-8fde-d4242bff5655 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:45.521905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-94585b50-3582-4b08-8fde-d4242bff5655 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.188367 Jun 02 19:22:45.522741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1063/2134] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:45 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:45.571579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:45.584394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:45.586333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:45.588078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ffed6397-8302-4721-a8b1-3b77b8e6d812 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.109578 Jun 02 19:22:45.589045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1072/2135] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:46.539746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-01197ccc-9e4e-4ceb-a2bc-210e749fc02a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:46.540361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-01197ccc-9e4e-4ceb-a2bc-210e749fc02a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:46.548337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-01197ccc-9e4e-4ceb-a2bc-210e749fc02a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:46.548780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-01197ccc-9e4e-4ceb-a2bc-210e749fc02a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:46.549545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-01197ccc-9e4e-4ceb-a2bc-210e749fc02a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:46.550015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-01197ccc-9e4e-4ceb-a2bc-210e749fc02a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:46.607362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:46.608141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:46.614708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:46.615154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:46.615923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:46.616362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:46.686708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:46.696193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:46.697705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:46.698877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-afd88137-8d3c-4870-8039-ba20ce78fa21 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095579 Jun 02 19:22:46.699473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1073/2136] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:46 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:22:46.710441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-01197ccc-9e4e-4ceb-a2bc-210e749fc02a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:46.718934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-01197ccc-9e4e-4ceb-a2bc-210e749fc02a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.183111 Jun 02 19:22:46.719510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1064/2137] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:46 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:47.717104 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:47.717769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:47.724857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:47.725323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:47.726145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:47.726739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:47.736586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7c38de77-2289-40c7-b26e-4d6464c8e971 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:47.737179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7c38de77-2289-40c7-b26e-4d6464c8e971 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:47.744621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c38de77-2289-40c7-b26e-4d6464c8e971 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:47.745077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c38de77-2289-40c7-b26e-4d6464c8e971 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:47.745858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c38de77-2289-40c7-b26e-4d6464c8e971 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:47.746327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c38de77-2289-40c7-b26e-4d6464c8e971 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:47.805077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:47.814710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:47.816200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:47.817387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-93dca339-5b4e-479f-bc57-2cf0cfeee4cf tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.104316 Jun 02 19:22:47.817977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1074/2138] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:47 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:47.899897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7c38de77-2289-40c7-b26e-4d6464c8e971 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:47.908215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7c38de77-2289-40c7-b26e-4d6464c8e971 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175512 Jun 02 19:22:47.908840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1065/2139] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:47 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:48.838117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:48.838738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:48.845379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:48.845843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:48.846631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:48.847069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:48.911522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:48.920682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:48.922225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:48.923381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-98ee13f5-2891-40eb-bc3f-924ccd6dd976 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090103 Jun 02 19:22:48.923935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1075/2140] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:48 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:48.930687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d28901b4-ff60-43ea-be11-ecf95eead6a8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:48.930687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d28901b4-ff60-43ea-be11-ecf95eead6a8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:48.934151 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d28901b4-ff60-43ea-be11-ecf95eead6a8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:48.934633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d28901b4-ff60-43ea-be11-ecf95eead6a8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:48.935427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d28901b4-ff60-43ea-be11-ecf95eead6a8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:48.935865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d28901b4-ff60-43ea-be11-ecf95eead6a8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:49.073555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d28901b4-ff60-43ea-be11-ecf95eead6a8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:49.082252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d28901b4-ff60-43ea-be11-ecf95eead6a8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.159765 Jun 02 19:22:49.082827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1066/2141] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:48 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:49.942866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:49.943491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:49.951119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:49.951587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:49.952416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:49.952862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:50.017090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:50.026619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:50.028137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:50.029322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d9bef903-646c-4c08-ba0e-53c436b57d15 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090799 Jun 02 19:22:50.029906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1076/2142] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:50.100366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4f9e6336-c471-4fbd-a1fb-bd4bdf25b9c8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:50.100984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4f9e6336-c471-4fbd-a1fb-bd4bdf25b9c8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:50.108317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f9e6336-c471-4fbd-a1fb-bd4bdf25b9c8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:50.108776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f9e6336-c471-4fbd-a1fb-bd4bdf25b9c8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:50.109556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f9e6336-c471-4fbd-a1fb-bd4bdf25b9c8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:50.110031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f9e6336-c471-4fbd-a1fb-bd4bdf25b9c8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:50.250102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4f9e6336-c471-4fbd-a1fb-bd4bdf25b9c8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:50.258603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4f9e6336-c471-4fbd-a1fb-bd4bdf25b9c8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162283 Jun 02 19:22:50.259149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1067/2143] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:50 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:51.049986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:51.051317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:51.060328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:51.060794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:51.061560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:51.062031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:51.133858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:51.143068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:51.144548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:51.145702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-03539c41-990a-426e-8e20-2f74dfb799ba tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101196 Jun 02 19:22:51.146284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1077/2144] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:51 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:51.277938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-477073e9-ecd5-4390-9b97-36f4376f56e1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:51.278593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-477073e9-ecd5-4390-9b97-36f4376f56e1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:51.285644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-477073e9-ecd5-4390-9b97-36f4376f56e1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:51.286130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-477073e9-ecd5-4390-9b97-36f4376f56e1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:51.286900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-477073e9-ecd5-4390-9b97-36f4376f56e1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:51.287352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-477073e9-ecd5-4390-9b97-36f4376f56e1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:51.427914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-477073e9-ecd5-4390-9b97-36f4376f56e1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:51.444932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-477073e9-ecd5-4390-9b97-36f4376f56e1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171296 Jun 02 19:22:51.445836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1068/2145] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:51 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:52.166530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:52.167242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:52.174209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:52.174668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:52.175446 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:52.175891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:52.240747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:52.249497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:52.251042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:52.252195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-022186b8-8d25-4dab-9122-066d246109ab tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091575 Jun 02 19:22:52.252763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1078/2146] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:52 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:52.472133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bf2ec7b4-3ef8-4b7e-8506-851abea4c93f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:52.473015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bf2ec7b4-3ef8-4b7e-8506-851abea4c93f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:52.484194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf2ec7b4-3ef8-4b7e-8506-851abea4c93f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:52.484938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf2ec7b4-3ef8-4b7e-8506-851abea4c93f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:52.486243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf2ec7b4-3ef8-4b7e-8506-851abea4c93f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:52.486955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf2ec7b4-3ef8-4b7e-8506-851abea4c93f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:52.624295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bf2ec7b4-3ef8-4b7e-8506-851abea4c93f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:52.632936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bf2ec7b4-3ef8-4b7e-8506-851abea4c93f tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167510 Jun 02 19:22:52.633502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1069/2147] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:52 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:53.274989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:53.275629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:53.282569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:53.283018 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:53.283775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:53.284210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:53.350644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:53.359727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:53.361250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:53.362431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-54797f2a-ac90-4606-b278-46ebd91f98d5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094172 Jun 02 19:22:53.362983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1079/2148] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:53 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:53.653972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eed3891c-7d1f-4105-a53c-bddfe6bb4921 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:53.654955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-eed3891c-7d1f-4105-a53c-bddfe6bb4921 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:53.666015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eed3891c-7d1f-4105-a53c-bddfe6bb4921 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:53.666504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eed3891c-7d1f-4105-a53c-bddfe6bb4921 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:53.667222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eed3891c-7d1f-4105-a53c-bddfe6bb4921 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:53.667683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eed3891c-7d1f-4105-a53c-bddfe6bb4921 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:53.812923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-eed3891c-7d1f-4105-a53c-bddfe6bb4921 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:53.821462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-eed3891c-7d1f-4105-a53c-bddfe6bb4921 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173924 Jun 02 19:22:53.822451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1070/2149] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:53 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:54.381244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:54.381909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:54.389364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:54.389823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:54.390615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:54.391050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:54.459654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:54.469504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:54.471518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:54.473419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a4d40b88-fae2-4450-bbae-84ed7e769e4c tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096004 Jun 02 19:22:54.474298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1080/2150] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:54 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:54.839537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-87ecb0c3-59d8-46b1-8f7c-a9755f60128e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:54.840184 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-87ecb0c3-59d8-46b1-8f7c-a9755f60128e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:54.847124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87ecb0c3-59d8-46b1-8f7c-a9755f60128e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:54.847544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87ecb0c3-59d8-46b1-8f7c-a9755f60128e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:54.848300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87ecb0c3-59d8-46b1-8f7c-a9755f60128e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:54.848729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87ecb0c3-59d8-46b1-8f7c-a9755f60128e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:54.978716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-87ecb0c3-59d8-46b1-8f7c-a9755f60128e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:54.987233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-87ecb0c3-59d8-46b1-8f7c-a9755f60128e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.151943 Jun 02 19:22:54.987806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1071/2151] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:54 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:55.491862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:55.492488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:55.500192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:55.500743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:55.501518 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:55.501972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:55.568386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:55.580951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:55.583075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:55.584268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8a8f45d2-31a3-4930-b892-f8cf534282d9 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096336 Jun 02 19:22:55.584820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1081/2152] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:55 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:56.004772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a4b222ab-d2f4-43f3-a7ec-d51f836a7370 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:56.005387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a4b222ab-d2f4-43f3-a7ec-d51f836a7370 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:56.012734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b222ab-d2f4-43f3-a7ec-d51f836a7370 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:56.013187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b222ab-d2f4-43f3-a7ec-d51f836a7370 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:56.014006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b222ab-d2f4-43f3-a7ec-d51f836a7370 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:56.014442 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b222ab-d2f4-43f3-a7ec-d51f836a7370 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:56.165132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a4b222ab-d2f4-43f3-a7ec-d51f836a7370 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:56.173823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a4b222ab-d2f4-43f3-a7ec-d51f836a7370 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173006 Jun 02 19:22:56.174399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1072/2153] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:55 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:56.604176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:56.604893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:56.612005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:56.612460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:56.613266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:56.613708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:56.679516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:56.688604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:56.690525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:56.691681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6b8e7ecd-4294-4f77-a62b-28f66bc5dca0 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092069 Jun 02 19:22:56.692246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1082/2154] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:56 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:57.191778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d6f41870-065f-4085-baa7-211cda211ff4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:57.192413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d6f41870-065f-4085-baa7-211cda211ff4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:57.199545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d6f41870-065f-4085-baa7-211cda211ff4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:57.199996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d6f41870-065f-4085-baa7-211cda211ff4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:57.200760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d6f41870-065f-4085-baa7-211cda211ff4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:57.201196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d6f41870-065f-4085-baa7-211cda211ff4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:57.216693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:57.336000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d6f41870-065f-4085-baa7-211cda211ff4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:57.344515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d6f41870-065f-4085-baa7-211cda211ff4 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.157028 Jun 02 19:22:57.345064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1073/2155] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:57 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:57.709217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:57.709880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:57.717071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:57.717530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:57.718340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:57.718783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:57.786326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:57.795517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:57.797030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:57.798239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-73d3f5b4-2071-4a06-bad1-e043f0dd7661 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093051 Jun 02 19:22:57.798809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1083/2156] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:57 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:58.361678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-463d0cdb-61a5-4965-9c62-9b94d3941e4d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:58.362341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-463d0cdb-61a5-4965-9c62-9b94d3941e4d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:58.369472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-463d0cdb-61a5-4965-9c62-9b94d3941e4d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:58.369645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-463d0cdb-61a5-4965-9c62-9b94d3941e4d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:58.370469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-463d0cdb-61a5-4965-9c62-9b94d3941e4d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:58.370938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-463d0cdb-61a5-4965-9c62-9b94d3941e4d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:58.528217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-463d0cdb-61a5-4965-9c62-9b94d3941e4d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:58.536475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-463d0cdb-61a5-4965-9c62-9b94d3941e4d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.178691 Jun 02 19:22:58.537052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1074/2157] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:58 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:58.817162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:58.817842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:58.824906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:58.825387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:58.826163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:58.826602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:58.891177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:58.899815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:58.901464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:58.902642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5451ce7c-6a38-4b85-9498-32598ac29cb8 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.089820 Jun 02 19:22:58.903210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1084/2158] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:58 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:22:59.554330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ddfe9c95-5746-43a9-92fb-cc3c1aec03a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:59.554928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ddfe9c95-5746-43a9-92fb-cc3c1aec03a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:59.561894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ddfe9c95-5746-43a9-92fb-cc3c1aec03a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:59.562352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ddfe9c95-5746-43a9-92fb-cc3c1aec03a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:59.563124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ddfe9c95-5746-43a9-92fb-cc3c1aec03a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:59.563561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ddfe9c95-5746-43a9-92fb-cc3c1aec03a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:59.708321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ddfe9c95-5746-43a9-92fb-cc3c1aec03a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:22:59.722406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ddfe9c95-5746-43a9-92fb-cc3c1aec03a0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171698 Jun 02 19:22:59.723332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1075/2159] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:22:59 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:22:59.921296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:22:59.921962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:22:59.924268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:59.930085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:59.930541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:22:59.931404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:22:59.931852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:00.003427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:00.007010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:00.015923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:00.018106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:00.019277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9de19ab8-c2de-45e7-8745-2b49124d80e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101996 Jun 02 19:23:00.019935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1085/2160] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:22:59 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:00.742401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dde5f9e4-d29d-4f73-b52f-545292bd9fd1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:00.743009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dde5f9e4-d29d-4f73-b52f-545292bd9fd1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:00.750190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dde5f9e4-d29d-4f73-b52f-545292bd9fd1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:00.750638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dde5f9e4-d29d-4f73-b52f-545292bd9fd1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:00.751395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dde5f9e4-d29d-4f73-b52f-545292bd9fd1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:00.751820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dde5f9e4-d29d-4f73-b52f-545292bd9fd1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:00.890942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dde5f9e4-d29d-4f73-b52f-545292bd9fd1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:00.900302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dde5f9e4-d29d-4f73-b52f-545292bd9fd1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161700 Jun 02 19:23:00.900955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1076/2161] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:00 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:01.039746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:01.040341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:01.048388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:01.048845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:01.049624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:01.050094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:01.118677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:01.128794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:01.130332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:01.131468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-37855311-c241-4343-ae5c-4e6a68f60425 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.095837 Jun 02 19:23:01.132031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1086/2162] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:01 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:01.917290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5a7d829d-c615-4397-ad98-0db6fa0fc962 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:01.917911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5a7d829d-c615-4397-ad98-0db6fa0fc962 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:01.924839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a7d829d-c615-4397-ad98-0db6fa0fc962 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:01.925283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a7d829d-c615-4397-ad98-0db6fa0fc962 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:01.926086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a7d829d-c615-4397-ad98-0db6fa0fc962 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:01.926513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a7d829d-c615-4397-ad98-0db6fa0fc962 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:02.064894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5a7d829d-c615-4397-ad98-0db6fa0fc962 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:02.074183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5a7d829d-c615-4397-ad98-0db6fa0fc962 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160823 Jun 02 19:23:02.074762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1077/2163] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:01 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:02.153265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:02.154020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:02.161048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:02.161499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:02.162301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:02.162733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:02.231893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:02.241037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:02.242636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:02.243847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f16ee66b-c59c-4c58-b70d-274991d1b633 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094915 Jun 02 19:23:02.244506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1087/2164] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:02 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:03.091292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5b5caf2b-f1b4-4b91-aa6d-95b77b471601 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:03.091926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5b5caf2b-f1b4-4b91-aa6d-95b77b471601 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:03.094333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:03.099845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b5caf2b-f1b4-4b91-aa6d-95b77b471601 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:03.100290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b5caf2b-f1b4-4b91-aa6d-95b77b471601 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:03.101059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b5caf2b-f1b4-4b91-aa6d-95b77b471601 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:03.101490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b5caf2b-f1b4-4b91-aa6d-95b77b471601 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:03.248142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5b5caf2b-f1b4-4b91-aa6d-95b77b471601 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:03.256632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5b5caf2b-f1b4-4b91-aa6d-95b77b471601 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.169536 Jun 02 19:23:03.257216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1078/2165] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:03 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:03.262261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:03.262874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:03.269833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:03.270286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:03.271050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:03.271484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:03.339195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:03.348578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:03.350117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:03.351286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8631081f-f60a-435d-b2c9-3c0f1126c2f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.093075 Jun 02 19:23:03.351822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1088/2166] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:03 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:04.274366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edf7c26d-96b4-4454-95fe-60ea7fb78420 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:04.275064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-edf7c26d-96b4-4454-95fe-60ea7fb78420 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:04.282771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edf7c26d-96b4-4454-95fe-60ea7fb78420 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:04.283224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edf7c26d-96b4-4454-95fe-60ea7fb78420 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:04.283997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edf7c26d-96b4-4454-95fe-60ea7fb78420 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:04.284428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edf7c26d-96b4-4454-95fe-60ea7fb78420 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:04.372788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:04.373878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:04.384045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:04.384635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:04.385590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:04.386275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:04.457049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-edf7c26d-96b4-4454-95fe-60ea7fb78420 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:04.469686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-edf7c26d-96b4-4454-95fe-60ea7fb78420 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.198993 Jun 02 19:23:04.470419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1079/2167] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:04 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:04.482128 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:04.488197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:04.489747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:04.490942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8c044e6a-ca74-4ec0-9c63-1b61fbab6099 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.125622 Jun 02 19:23:04.491550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1089/2168] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:04 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:05.488189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4de64173-8b0b-4ebb-8df9-b20a4b417f90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:05.488954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4de64173-8b0b-4ebb-8df9-b20a4b417f90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:05.496537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4de64173-8b0b-4ebb-8df9-b20a4b417f90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:05.496983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4de64173-8b0b-4ebb-8df9-b20a4b417f90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:05.497760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4de64173-8b0b-4ebb-8df9-b20a4b417f90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:05.498224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4de64173-8b0b-4ebb-8df9-b20a4b417f90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:05.509201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:05.510180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:05.518417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:05.518884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:05.519695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:05.520146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:05.602710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:05.612429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:05.614005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:05.615164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6fd88769-0ec2-466a-9f50-cf85100ad3ad tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110257 Jun 02 19:23:05.615949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1090/2169] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:05 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:05.668515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4de64173-8b0b-4ebb-8df9-b20a4b417f90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:05.677067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4de64173-8b0b-4ebb-8df9-b20a4b417f90 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.193095 Jun 02 19:23:05.677628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1080/2170] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:05 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:06.633380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:06.634029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:06.641324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:06.641779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:06.642598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:06.643034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:06.694700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-de07afcc-3ee2-4551-ab78-d84f40ec6686 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:06.695324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-de07afcc-3ee2-4551-ab78-d84f40ec6686 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:06.702516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de07afcc-3ee2-4551-ab78-d84f40ec6686 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:06.702964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de07afcc-3ee2-4551-ab78-d84f40ec6686 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:06.703724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de07afcc-3ee2-4551-ab78-d84f40ec6686 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:06.704159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de07afcc-3ee2-4551-ab78-d84f40ec6686 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:06.717007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:06.726320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:06.727842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:06.729031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7e8ab56f-f3a2-4ef9-a844-1b53114bc161 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.099604 Jun 02 19:23:06.729598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1091/2171] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:06 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:06.842151 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-de07afcc-3ee2-4551-ab78-d84f40ec6686 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:06.850533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-de07afcc-3ee2-4551-ab78-d84f40ec6686 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.159720 Jun 02 19:23:06.851111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1081/2172] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:06 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:07.747330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:07.747966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:07.754861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:07.757099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:07.757954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:07.758407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:07.836051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:07.845583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:07.847130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:07.848284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cac322a7-9239-43ba-a2c6-ffac6287580f tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105595 Jun 02 19:23:07.848845 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1092/2173] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:07 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:07.868292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ee0a2e2-47ca-4eb0-a860-1b58678f6ca9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:07.868901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ee0a2e2-47ca-4eb0-a860-1b58678f6ca9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:07.876729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ee0a2e2-47ca-4eb0-a860-1b58678f6ca9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:07.877251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ee0a2e2-47ca-4eb0-a860-1b58678f6ca9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:07.878414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ee0a2e2-47ca-4eb0-a860-1b58678f6ca9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:07.879000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ee0a2e2-47ca-4eb0-a860-1b58678f6ca9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:08.039610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0ee0a2e2-47ca-4eb0-a860-1b58678f6ca9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:08.049265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ee0a2e2-47ca-4eb0-a860-1b58678f6ca9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.184815 Jun 02 19:23:08.049871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1082/2174] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:07 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:08.867535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:08.868169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:08.875440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:08.876005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:08.876783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:08.877215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:08.940397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:08.949491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:08.951189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:08.952409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c8af32d2-97dd-4075-94c9-69516d76f276 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088772 Jun 02 19:23:08.952962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1093/2175] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:08 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:09.067431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b8c606e8-d48b-4c32-8d4e-a7030fb6deb8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:09.068034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b8c606e8-d48b-4c32-8d4e-a7030fb6deb8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:09.074967 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8c606e8-d48b-4c32-8d4e-a7030fb6deb8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:09.075424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8c606e8-d48b-4c32-8d4e-a7030fb6deb8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:09.076190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8c606e8-d48b-4c32-8d4e-a7030fb6deb8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:09.076625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8c606e8-d48b-4c32-8d4e-a7030fb6deb8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:09.207993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b8c606e8-d48b-4c32-8d4e-a7030fb6deb8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:09.216602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b8c606e8-d48b-4c32-8d4e-a7030fb6deb8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.153424 Jun 02 19:23:09.217187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1083/2176] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:09 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:09.970985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:09.971708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:09.978690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:09.979346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:09.980294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:09.980736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:10.048693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:10.058886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:10.060423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:10.061619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9d1138a8-6b2a-43ed-81c7-5b04c0ba2649 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094645 Jun 02 19:23:10.062209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1094/2177] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:09 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:10.234703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f32c1eda-5121-4a4b-927a-cb828bb59546 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:10.235285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f32c1eda-5121-4a4b-927a-cb828bb59546 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:10.242017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f32c1eda-5121-4a4b-927a-cb828bb59546 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:10.242468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f32c1eda-5121-4a4b-927a-cb828bb59546 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:10.243370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f32c1eda-5121-4a4b-927a-cb828bb59546 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:10.243745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f32c1eda-5121-4a4b-927a-cb828bb59546 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:10.384914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f32c1eda-5121-4a4b-927a-cb828bb59546 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:10.393104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f32c1eda-5121-4a4b-927a-cb828bb59546 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162529 Jun 02 19:23:10.393664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1084/2178] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:10 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:11.082480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:11.083126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:11.091679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:11.092310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:11.093191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:11.093667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:11.158352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:11.168820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:11.170362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:11.171519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-339cd89b-de34-45ef-92f7-d58558283a86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094548 Jun 02 19:23:11.172085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1095/2179] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:11 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:11.410810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-617efc60-3153-40aa-afc7-c4b436508e64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:11.411371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-617efc60-3153-40aa-afc7-c4b436508e64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:11.418720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-617efc60-3153-40aa-afc7-c4b436508e64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:11.419186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-617efc60-3153-40aa-afc7-c4b436508e64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:11.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-617efc60-3153-40aa-afc7-c4b436508e64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:11.420390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-617efc60-3153-40aa-afc7-c4b436508e64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:11.564393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-617efc60-3153-40aa-afc7-c4b436508e64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:11.573260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-617efc60-3153-40aa-afc7-c4b436508e64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166065 Jun 02 19:23:11.573858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1085/2180] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:11 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:12.192300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:12.192930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:12.201229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:12.201675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:12.202476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:12.202910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:12.269745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:12.279066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:12.280697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:12.282454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e31338bd-94ca-4d16-9366-5aa2182408e3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094372 Jun 02 19:23:12.283036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1096/2181] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:12 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:12.591411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2a75ad72-5120-407f-be85-7cfdbc051b20 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:12.592167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2a75ad72-5120-407f-be85-7cfdbc051b20 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:12.599703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a75ad72-5120-407f-be85-7cfdbc051b20 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:12.600240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a75ad72-5120-407f-be85-7cfdbc051b20 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:12.601427 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a75ad72-5120-407f-be85-7cfdbc051b20 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:12.601873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a75ad72-5120-407f-be85-7cfdbc051b20 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:12.739000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2a75ad72-5120-407f-be85-7cfdbc051b20 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:12.747834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2a75ad72-5120-407f-be85-7cfdbc051b20 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.160383 Jun 02 19:23:12.748392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1086/2182] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:12 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:13.300868 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:13.301591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:13.309174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:13.309624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:13.310424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:13.310853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:13.379448 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:13.388542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:13.390069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:13.391219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8b64b286-31b9-406b-a1bf-e035872d9b65 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094321 Jun 02 19:23:13.391773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1097/2183] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:13 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:13.770518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0cad12b5-6756-493f-833a-fe0c2508ab64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:13.771358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0cad12b5-6756-493f-833a-fe0c2508ab64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:13.778949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0cad12b5-6756-493f-833a-fe0c2508ab64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:13.779396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0cad12b5-6756-493f-833a-fe0c2508ab64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:13.780165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0cad12b5-6756-493f-833a-fe0c2508ab64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:13.780597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0cad12b5-6756-493f-833a-fe0c2508ab64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:13.936668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0cad12b5-6756-493f-833a-fe0c2508ab64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:13.945195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0cad12b5-6756-493f-833a-fe0c2508ab64 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.179702 Jun 02 19:23:13.945741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1087/2184] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:13 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:14.412181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:14.412814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:14.421381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:14.421968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:14.422779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:14.423217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:14.493490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:14.502960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:14.504478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:14.506350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5f91784e-a9ec-48ee-910f-9a8a375c2b8e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.097983 Jun 02 19:23:14.507181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1098/2185] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:14 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:14.963006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-11a4cdcd-d848-410a-ab34-e1efe17807da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:14.963854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-11a4cdcd-d848-410a-ab34-e1efe17807da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:14.970887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11a4cdcd-d848-410a-ab34-e1efe17807da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:14.971341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11a4cdcd-d848-410a-ab34-e1efe17807da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:14.972118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11a4cdcd-d848-410a-ab34-e1efe17807da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:14.972550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11a4cdcd-d848-410a-ab34-e1efe17807da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:15.112404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-11a4cdcd-d848-410a-ab34-e1efe17807da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:15.123931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-11a4cdcd-d848-410a-ab34-e1efe17807da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.164682 Jun 02 19:23:15.124580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1088/2186] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:14 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:15.271493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:23:15.271807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:23:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:23:15.526235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:15.527509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:15.535138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:15.535717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:15.536863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:15.537555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:15.609520 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:15.619090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:15.620979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:15.622229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-134d17a0-8bff-4019-a6b2-87b65eb52df5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100573 Jun 02 19:23:15.622742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1099/2187] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:15 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:16.141020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7d409327-3d47-4d50-9aca-7f79f764fae0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:16.141648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7d409327-3d47-4d50-9aca-7f79f764fae0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:16.149137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d409327-3d47-4d50-9aca-7f79f764fae0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:16.149594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d409327-3d47-4d50-9aca-7f79f764fae0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:16.150379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d409327-3d47-4d50-9aca-7f79f764fae0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:16.150803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d409327-3d47-4d50-9aca-7f79f764fae0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:16.290298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d409327-3d47-4d50-9aca-7f79f764fae0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:16.299230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7d409327-3d47-4d50-9aca-7f79f764fae0 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.162079 Jun 02 19:23:16.299814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1089/2188] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:16 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:16.644356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:16.645289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:16.656196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:16.656645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:16.657419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:16.657881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:16.733396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:16.744522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:16.746500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:16.747723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d6489167-eff9-4df1-9c5c-d4dc33b4d665 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.110018 Jun 02 19:23:16.748393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1100/2189] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:16 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:17.318840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d4a6ffaa-c940-42cf-a60f-f7112c814216 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:17.319475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d4a6ffaa-c940-42cf-a60f-f7112c814216 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:17.330261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4a6ffaa-c940-42cf-a60f-f7112c814216 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:17.330986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4a6ffaa-c940-42cf-a60f-f7112c814216 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:17.332219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4a6ffaa-c940-42cf-a60f-f7112c814216 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:17.332655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4a6ffaa-c940-42cf-a60f-f7112c814216 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:17.336522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:17.479920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d4a6ffaa-c940-42cf-a60f-f7112c814216 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:17.489419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d4a6ffaa-c940-42cf-a60f-f7112c814216 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174210 Jun 02 19:23:17.490039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1090/2190] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:17 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:17.769709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:17.770387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:17.777960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:17.778417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:17.779201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:17.779639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:17.855823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:17.865068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:17.866590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:17.867725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-312e5a63-fd52-4838-a180-62b99c73a226 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.102065 Jun 02 19:23:17.868610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1101/2191] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:17 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:18.511560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4686da9e-c39e-4d96-9191-1d2bc34d65ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:18.512222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4686da9e-c39e-4d96-9191-1d2bc34d65ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:18.519473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4686da9e-c39e-4d96-9191-1d2bc34d65ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:18.519926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4686da9e-c39e-4d96-9191-1d2bc34d65ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:18.520703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4686da9e-c39e-4d96-9191-1d2bc34d65ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:18.521139 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4686da9e-c39e-4d96-9191-1d2bc34d65ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:18.674369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4686da9e-c39e-4d96-9191-1d2bc34d65ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:18.683536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4686da9e-c39e-4d96-9191-1d2bc34d65ba tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.175784 Jun 02 19:23:18.684324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1091/2192] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:18 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:18.887424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:18.888070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:18.895317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:18.895778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:18.896549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:18.897013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:18.917729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:18.969065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:18.979539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:18.981595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:18.982834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b5019662-506c-486b-92fe-e73e0cfe739b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100078 Jun 02 19:23:18.983393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1102/2193] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:18 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:19.705188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-253134f5-d7f3-402d-9069-a2a5b22d677e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:19.705883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-253134f5-d7f3-402d-9069-a2a5b22d677e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:19.718619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-253134f5-d7f3-402d-9069-a2a5b22d677e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:19.719065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-253134f5-d7f3-402d-9069-a2a5b22d677e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:19.719844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-253134f5-d7f3-402d-9069-a2a5b22d677e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:19.720273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-253134f5-d7f3-402d-9069-a2a5b22d677e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:19.865959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-253134f5-d7f3-402d-9069-a2a5b22d677e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:19.874732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-253134f5-d7f3-402d-9069-a2a5b22d677e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.173431 Jun 02 19:23:19.875320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1092/2194] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:19 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:20.002214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:20.002855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:20.009898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:20.010388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:20.011575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:20.011828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:20.097410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:20.108201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:20.110144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:20.111775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d4cc22bf-8aa7-4778-b74a-5b6823c95843 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.113392 Jun 02 19:23:20.112507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1103/2195] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:19 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:20.894195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d650cc15-2040-4e61-bf53-e466deec93da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:20.894825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d650cc15-2040-4e61-bf53-e466deec93da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:20.901914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d650cc15-2040-4e61-bf53-e466deec93da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:20.902716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d650cc15-2040-4e61-bf53-e466deec93da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:20.903502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d650cc15-2040-4e61-bf53-e466deec93da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:20.903942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d650cc15-2040-4e61-bf53-e466deec93da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:21.047901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d650cc15-2040-4e61-bf53-e466deec93da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:21.056431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d650cc15-2040-4e61-bf53-e466deec93da tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.167271 Jun 02 19:23:21.057013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1093/2196] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:20 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:21.130525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:21.131139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:21.138919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:21.139370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:21.140165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:21.140634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:21.208963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:21.218097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:21.219597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:21.220754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-aa2bcf39-77d8-42e8-8036-8c430cc2b92e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094223 Jun 02 19:23:21.221336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1104/2197] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:21 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:22.075528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-95ebb0c4-1735-47de-b98e-e4c001220d3e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:22.076723 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-95ebb0c4-1735-47de-b98e-e4c001220d3e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:22.084135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95ebb0c4-1735-47de-b98e-e4c001220d3e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:22.084639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95ebb0c4-1735-47de-b98e-e4c001220d3e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:22.085344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95ebb0c4-1735-47de-b98e-e4c001220d3e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:22.085773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95ebb0c4-1735-47de-b98e-e4c001220d3e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:22.241355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:22.242506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:22.253848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:22.254851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:22.255285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-95ebb0c4-1735-47de-b98e-e4c001220d3e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:22.256137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:22.256893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:22.266639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-95ebb0c4-1735-47de-b98e-e4c001220d3e tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.195312 Jun 02 19:23:22.267267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1094/2198] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:22 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:22.332322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:22.345586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:22.347490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:22.348964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f46f738a-7587-4bb9-8bac-97bfc066e05d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.112315 Jun 02 19:23:22.349741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1105/2199] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:22 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:23.291340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-15ecca33-65b6-48d3-9a33-ba3ad17aeec2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:23.291986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-15ecca33-65b6-48d3-9a33-ba3ad17aeec2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:23.299329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15ecca33-65b6-48d3-9a33-ba3ad17aeec2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:23.299784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15ecca33-65b6-48d3-9a33-ba3ad17aeec2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:23.300555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15ecca33-65b6-48d3-9a33-ba3ad17aeec2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:23.300987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15ecca33-65b6-48d3-9a33-ba3ad17aeec2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:23.367462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:23.368120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:23.376856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:23.377336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:23.378167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:23.378609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:23.456620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:23.466135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:23.467654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:23.468848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1226fa4c-da10-4340-9cd1-ec5faa50ad86 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105384 Jun 02 19:23:23.469053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-15ecca33-65b6-48d3-9a33-ba3ad17aeec2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:23.469432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1106/2200] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:23 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:23.477840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-15ecca33-65b6-48d3-9a33-ba3ad17aeec2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.191907 Jun 02 19:23:23.478397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1095/2201] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:23 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:24.487473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:24.488110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:24.495107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:24.495379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1812f25-ba27-471c-b332-9095c8269ab2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:24.495822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d1812f25-ba27-471c-b332-9095c8269ab2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:24.496346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:24.497969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:24.498453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:24.502705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1812f25-ba27-471c-b332-9095c8269ab2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:24.503228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1812f25-ba27-471c-b332-9095c8269ab2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:24.504024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1812f25-ba27-471c-b332-9095c8269ab2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:24.504599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1812f25-ba27-471c-b332-9095c8269ab2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:24.576753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:24.585880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:24.587375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:24.588535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2518cd63-2580-4f41-a93f-d42a3abee3f3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.105059 Jun 02 19:23:24.589071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1107/2202] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:24 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:24.670319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1812f25-ba27-471c-b332-9095c8269ab2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:24.678927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d1812f25-ba27-471c-b332-9095c8269ab2 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.188015 Jun 02 19:23:24.679481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1096/2203] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:24 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:25.607140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:25.607762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:25.614980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:25.615429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:25.616199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:25.616627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:25.681965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:25.691844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:25.693368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:25.694560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-610d50a6-894b-46c7-941e-98cb4ebf164b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091524 Jun 02 19:23:25.695088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1108/2204] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:25 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:25.696033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0a0ea7c0-38bf-4f42-8c82-201e08bbca5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:25.696650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0a0ea7c0-38bf-4f42-8c82-201e08bbca5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:25.704213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0ea7c0-38bf-4f42-8c82-201e08bbca5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:25.704662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0ea7c0-38bf-4f42-8c82-201e08bbca5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:25.705434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0ea7c0-38bf-4f42-8c82-201e08bbca5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:25.705945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0ea7c0-38bf-4f42-8c82-201e08bbca5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:25.849661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0a0ea7c0-38bf-4f42-8c82-201e08bbca5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:25.859230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0a0ea7c0-38bf-4f42-8c82-201e08bbca5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.166879 Jun 02 19:23:25.859851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1097/2205] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:25 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:26.713587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:26.714320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:26.721092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:26.721533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:26.722312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:26.722740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:26.795535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:26.805236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:26.806833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:26.808004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a34a3985-b7bc-46e2-8ba8-0e4f4cbcc686 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098397 Jun 02 19:23:26.808516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1109/2206] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:26 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:26.878033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-857e9fdd-1ec3-468b-ad99-4bd5fe1f87f8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:26.878662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-857e9fdd-1ec3-468b-ad99-4bd5fe1f87f8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:26.885829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-857e9fdd-1ec3-468b-ad99-4bd5fe1f87f8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:26.886311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-857e9fdd-1ec3-468b-ad99-4bd5fe1f87f8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:26.887082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-857e9fdd-1ec3-468b-ad99-4bd5fe1f87f8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:26.887676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-857e9fdd-1ec3-468b-ad99-4bd5fe1f87f8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:27.038241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-857e9fdd-1ec3-468b-ad99-4bd5fe1f87f8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:27.048361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-857e9fdd-1ec3-468b-ad99-4bd5fe1f87f8 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.174587 Jun 02 19:23:27.048822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1098/2207] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:26 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:27.830780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:27.831508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:27.840137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:27.840754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:27.841735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:27.842332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:27.914031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:27.923226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:27.924773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:27.925960 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-84314a2e-f960-479f-a514-d583cc8aa6fe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101164 Jun 02 19:23:27.926563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1110/2208] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:27 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:28.066843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-444ddabf-b95c-422f-919c-50b097f324cd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:28.067478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-444ddabf-b95c-422f-919c-50b097f324cd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:28.077286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-444ddabf-b95c-422f-919c-50b097f324cd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:28.078061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-444ddabf-b95c-422f-919c-50b097f324cd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:28.078901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-444ddabf-b95c-422f-919c-50b097f324cd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:28.079364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-444ddabf-b95c-422f-919c-50b097f324cd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:28.249517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-444ddabf-b95c-422f-919c-50b097f324cd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:28.257836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-444ddabf-b95c-422f-919c-50b097f324cd tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.196141 Jun 02 19:23:28.258434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1099/2209] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:28 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:28.951669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:28.952299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:28.959394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:28.959843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:28.960604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:28.961038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:29.027330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:29.036726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:29.038272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:29.039437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a330dd09-8bd9-4cea-a6ec-97b5c0997b02 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092012 Jun 02 19:23:29.040007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1111/2210] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:28 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:29.276654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-91f2f2ea-6e9a-4f68-93c0-ffe224334024 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:29.277519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-91f2f2ea-6e9a-4f68-93c0-ffe224334024 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:29.285832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91f2f2ea-6e9a-4f68-93c0-ffe224334024 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:29.286337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91f2f2ea-6e9a-4f68-93c0-ffe224334024 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:29.287142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91f2f2ea-6e9a-4f68-93c0-ffe224334024 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:29.287574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91f2f2ea-6e9a-4f68-93c0-ffe224334024 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:29.637706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-91f2f2ea-6e9a-4f68-93c0-ffe224334024 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:29.651837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-91f2f2ea-6e9a-4f68-93c0-ffe224334024 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.379203 Jun 02 19:23:29.652655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1100/2211] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:29 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:30.063030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:30.064395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:30.067281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:30.075600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:30.076054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:30.076819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:30.077249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:30.142174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:30.151655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:30.153260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:30.154522 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d6504b1e-191c-4429-976c-7b284c1f27be tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.098351 Jun 02 19:23:30.155080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1112/2212] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:30 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:30.674499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1e693edb-4b7b-40a3-a6f3-88c3cdb1f20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:30.675221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1e693edb-4b7b-40a3-a6f3-88c3cdb1f20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:30.684072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e693edb-4b7b-40a3-a6f3-88c3cdb1f20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:30.685345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e693edb-4b7b-40a3-a6f3-88c3cdb1f20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:30.686382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e693edb-4b7b-40a3-a6f3-88c3cdb1f20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:30.686955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e693edb-4b7b-40a3-a6f3-88c3cdb1f20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:30.831405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e693edb-4b7b-40a3-a6f3-88c3cdb1f20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:30.840188 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1e693edb-4b7b-40a3-a6f3-88c3cdb1f20c tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.171518 Jun 02 19:23:30.840835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1101/2213] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:30 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:30.977221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:23:30.977452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:23:31.176160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:31.176972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:31.186757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:31.187194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:31.187949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:31.188368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:31.260723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:31.270567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:31.272182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:31.273355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f5dff222-c38b-4bc7-ab15-5223294e3770 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103239 Jun 02 19:23:31.273933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1113/2214] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:31 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:31.863082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-998fda41-c4f3-477f-a7b1-e0273f708604 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:31.863677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-998fda41-c4f3-477f-a7b1-e0273f708604 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:31.870528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-998fda41-c4f3-477f-a7b1-e0273f708604 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:31.870948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-998fda41-c4f3-477f-a7b1-e0273f708604 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:31.871714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-998fda41-c4f3-477f-a7b1-e0273f708604 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:31.872665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-998fda41-c4f3-477f-a7b1-e0273f708604 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:32.013614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-998fda41-c4f3-477f-a7b1-e0273f708604 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:32.022528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-998fda41-c4f3-477f-a7b1-e0273f708604 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.163279 Jun 02 19:23:32.023121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1102/2215] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:31 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:32.292531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:32.293162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:32.300831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:32.301323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:32.302317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:32.302761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:32.368528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:32.377865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:32.379420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:32.380590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bacf341c-21b0-4fa6-9f46-22fb6da27c4e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092097 Jun 02 19:23:32.381190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1114/2216] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:32 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:33.041113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ce731749-87e9-41f3-921c-a9beb4047c23 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:33.041744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ce731749-87e9-41f3-921c-a9beb4047c23 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:33.049187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce731749-87e9-41f3-921c-a9beb4047c23 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:33.049631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce731749-87e9-41f3-921c-a9beb4047c23 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:33.050420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce731749-87e9-41f3-921c-a9beb4047c23 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:33.050850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce731749-87e9-41f3-921c-a9beb4047c23 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:33.187555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ce731749-87e9-41f3-921c-a9beb4047c23 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:33.196479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ce731749-87e9-41f3-921c-a9beb4047c23 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.159341 Jun 02 19:23:33.197085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1103/2217] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:33 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:33.399195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:33.399803 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:33.407087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:33.407546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:33.408318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:33.408761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:33.472460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:33.481360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:33.483511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:33.484668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-126b642f-e764-43df-a5ea-cfe42cc57893 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.089467 Jun 02 19:23:33.485219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1115/2218] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:33 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:34.214049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b80e1d9a-7c5d-4f04-b7e9-a36110511c74 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:34.214670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b80e1d9a-7c5d-4f04-b7e9-a36110511c74 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:34.217105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:34.223193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b80e1d9a-7c5d-4f04-b7e9-a36110511c74 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:34.223639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b80e1d9a-7c5d-4f04-b7e9-a36110511c74 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:34.224426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b80e1d9a-7c5d-4f04-b7e9-a36110511c74 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:34.224859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b80e1d9a-7c5d-4f04-b7e9-a36110511c74 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:34.363707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b80e1d9a-7c5d-4f04-b7e9-a36110511c74 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:34.371871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b80e1d9a-7c5d-4f04-b7e9-a36110511c74 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.161787 Jun 02 19:23:34.372446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1104/2219] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:34 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:34.502996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:34.503602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:34.510487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:34.510953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:34.511736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:34.512215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:34.579847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:34.588415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:34.589971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:34.591303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6feaebbd-d1d4-4aad-aa71-0f57f38e997d tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.092264 Jun 02 19:23:34.591863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1116/2220] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:34 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:35.504856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-94d69534-e9c7-41ac-a1c3-4c1098184a5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:35.505471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-94d69534-e9c7-41ac-a1c3-4c1098184a5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:35.511675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94d69534-e9c7-41ac-a1c3-4c1098184a5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:35.512122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94d69534-e9c7-41ac-a1c3-4c1098184a5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:35.513022 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94d69534-e9c7-41ac-a1c3-4c1098184a5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:35.513455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94d69534-e9c7-41ac-a1c3-4c1098184a5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:35.609728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:35.610422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:35.617113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:35.617564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:35.618365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:35.618797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:35.707423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-94d69534-e9c7-41ac-a1c3-4c1098184a5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:35.716481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-94d69534-e9c7-41ac-a1c3-4c1098184a5d tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.331302 Jun 02 19:23:35.717115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1105/2221] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:35 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:35.737377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:35.746200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:35.747761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:35.748915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2f1fdb57-c06d-4a86-9819-85f973eb0407 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.143221 Jun 02 19:23:35.749459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1117/2222] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:35 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:23:36.733772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-04c82736-199b-4d3f-8b28-f116db60e4c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:36.734380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-04c82736-199b-4d3f-8b28-f116db60e4c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: d55119d3-172d-4b7c-87ad-7423adea1aba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:36.741391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04c82736-199b-4d3f-8b28-f116db60e4c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:36.741840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04c82736-199b-4d3f-8b28-f116db60e4c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:36.742929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04c82736-199b-4d3f-8b28-f116db60e4c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:36.743360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04c82736-199b-4d3f-8b28-f116db60e4c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:36.767712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:36.768435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:36.775277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:36.775728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:36.776536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:36.776973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:36.855592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:36.864659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:36.866188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:36.867351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d7ac882-f7dd-4def-93a5-e8e7cb9d507e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.103620 Jun 02 19:23:36.868288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1118/2223] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:36 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:36.920316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-04c82736-199b-4d3f-8b28-f116db60e4c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:36.922558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:36.929587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-04c82736-199b-4d3f-8b28-f116db60e4c9 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba" status: 200 len: 1735 microversion: 2.1 time: 0.199809 Jun 02 19:23:36.930190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1106/2224] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:36 2022] GET /compute/v2.1/servers/d55119d3-172d-4b7c-87ad-7423adea1aba => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:36.946007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-64639c16-04ac-4d4a-8c92-9603db9a5530 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '.version_select at 0x7f5b7e069ee0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:36.968779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-64639c16-04ac-4d4a-8c92-9603db9a5530 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-762648889" status: 202 len: 0 microversion: 2.1 time: 0.026626 Jun 02 19:23:36.969344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1119/2225] 10.222.0.15 () {58 vars in 1217 bytes} [Thu Jun 2 19:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-762648889 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 19:23:37.892865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:37.895701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:37.907769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:37.908225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:37.909008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:37.909440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:37.967974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-bbd00b7a-d515-493c-bfff-75c914ccda76 req-367cb6ee-abfc-46d0-9c42-6f4cfaf47802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55119d3-172d-4b7c-87ad-7423adea1aba", "tag": "029f6b36-13f6-4804-b5ae-07f754bd87bb"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:23:37.977109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-bbd00b7a-d515-493c-bfff-75c914ccda76 req-367cb6ee-abfc-46d0-9c42-6f4cfaf47802 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:37.977563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-bbd00b7a-d515-493c-bfff-75c914ccda76 req-367cb6ee-abfc-46d0-9c42-6f4cfaf47802 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:37.981815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:37.985555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:37.992980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-bbd00b7a-d515-493c-bfff-75c914ccda76 req-367cb6ee-abfc-46d0-9c42-6f4cfaf47802 service nova] Creating event network-changed:029f6b36-13f6-4804-b5ae-07f754bd87bb for instance d55119d3-172d-4b7c-87ad-7423adea1aba on hv-cinder-79760 Jun 02 19:23:37.994348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:37.996071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:37.997871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9c1a4267-c76c-4353-8f07-f7ef75162cd2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.109127 Jun 02 19:23:37.998891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-bbd00b7a-d515-493c-bfff-75c914ccda76 req-367cb6ee-abfc-46d0-9c42-6f4cfaf47802 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091445 Jun 02 19:23:37.999466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1107/2226] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:37 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:38.000484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1120/2227] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:23:39.017685 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:39.018316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:39.025424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:39.025913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:39.026678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:39.027110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:39.103289 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:39.112536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:39.114229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:39.115396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1cb61a26-11f6-44c6-b925-bd4bbeb735cc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.101766 Jun 02 19:23:39.115951 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1108/2228] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:39 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:40.135078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:40.135776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:40.142873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:40.143354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:40.144126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:40.144566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:40.208926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:40.218345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:40.219858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:40.221002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cf1837ea-2c47-4496-b1e7-c77be031e6b6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.090881 Jun 02 19:23:40.221562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1121/2229] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:40 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:41.241641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:41.242502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:41.251665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:41.252164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:41.253184 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:41.253651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:41.318425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:41.327525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:41.328998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:41.330163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8c4f6be0-1bf2-42b7-9e58-99cdc9244573 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.094570 Jun 02 19:23:41.330726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1109/2230] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:41 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:42.350152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:42.350826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:42.358265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:42.358722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:42.359490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:42.359910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:42.425321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:42.434497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:42.436017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:42.437160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-29d85f65-ece5-438e-83a4-61d61d042fec tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.091714 Jun 02 19:23:42.437718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1122/2231] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:42 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:43.459014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:43.459936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:43.469027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:43.469477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:43.470276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:43.470704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:43.535209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:43.546419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:43.547906 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:43.549029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-66d6154b-ca44-45df-bceb-2686d38e9b41 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.096537 Jun 02 19:23:43.549605 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1110/2232] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:43 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:44.570340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:44.570987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:44.578213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:44.578702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:44.579481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:44.579925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:44.642850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:44.651987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:44.653706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:44.654898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4b45212f-0a5b-47d6-aa43-19562ce8c897 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.088587 Jun 02 19:23:44.655450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1123/2233] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:44 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:45.673558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:45.674228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:45.681039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:45.681674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:45.682895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:45.683547 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:45.756568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:45.766175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:45.767677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:45.769054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81daef33-3ee8-4b8c-a6ea-2b4755d75fe3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 200 len: 1443 microversion: 2.20 time: 0.100435 Jun 02 19:23:45.769619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1111/2234] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:45 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:45.788223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d44b3adb-bcf2-4c53-8883-7fc1516174a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '.version_select at 0x7f5b7dfc2790>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:45.809332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d44b3adb-bcf2-4c53-8883-7fc1516174a5 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989001248" status: 204 len: 0 microversion: 2.20 time: 0.025369 Jun 02 19:23:45.810079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1124/2235] 10.222.0.15 () {60 vars in 1258 bytes} [Thu Jun 2 19:23:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989001248 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 19:23:46.650679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd257c24-6b5f-4605-826d-3e394135381e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Action: 'create', calling method: .version_select at 0x7f5b78697820>, body: {"keypair": {"name": "tempest-keypair-480491547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDISPXR/wp9lCbR9O9zOQn/IkbHTpfbg4zu3vJW0xfx4x5PSGpqiCvZeV2IkEK+pExBmeb6x7QNMyiPYzhZkD2iTQJzzs5v8fFElVnUo5h0Jn/MiIciyYz9dsDEW9QqY4g=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:23:46.666619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-bd257c24-6b5f-4605-826d-3e394135381e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Getting quotas for project a23ef70d937643f8a1c8597a8cfac596. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:23:46.671992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-bd257c24-6b5f-4605-826d-3e394135381e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Getting quotas for user cef7ac127d2f4284a1808c580148c9e0 and project a23ef70d937643f8a1c8597a8cfac596. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:23:46.698516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bd257c24-6b5f-4605-826d-3e394135381e tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052353 Jun 02 19:23:46.699462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1112/2236] 10.222.0.15 () {62 vars in 1199 bytes} [Thu Jun 2 19:23:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 19:23:47.701490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-784cbae1-9401-489a-be11-86567eda458f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:47.704870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-784cbae1-9401-489a-be11-86567eda458f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:47.713214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-784cbae1-9401-489a-be11-86567eda458f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:47.713870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-784cbae1-9401-489a-be11-86567eda458f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:47.715048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-784cbae1-9401-489a-be11-86567eda458f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:47.715629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-784cbae1-9401-489a-be11-86567eda458f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:47.748077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-784cbae1-9401-489a-be11-86567eda458f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:23:47.865103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4fa60757-3e62-477d-9a56-64a0ffb1a873 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:47.866798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4fa60757-3e62-477d-9a56-64a0ffb1a873 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:47.874530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fa60757-3e62-477d-9a56-64a0ffb1a873 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:47.877014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fa60757-3e62-477d-9a56-64a0ffb1a873 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:47.879130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fa60757-3e62-477d-9a56-64a0ffb1a873 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:47.879773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fa60757-3e62-477d-9a56-64a0ffb1a873 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:47.891450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-784cbae1-9401-489a-be11-86567eda458f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 204 len: 0 microversion: 2.1 time: 0.197287 Jun 02 19:23:47.896325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1125/2237] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:23:47 2022] DELETE /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:23:47.911327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6483384f-f8a7-4d2e-acea-408c4ae87517 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:47.912215 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6483384f-f8a7-4d2e-acea-408c4ae87517 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:47.923112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6483384f-f8a7-4d2e-acea-408c4ae87517 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:47.925106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6483384f-f8a7-4d2e-acea-408c4ae87517 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:47.928435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6483384f-f8a7-4d2e-acea-408c4ae87517 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:47.928982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6483384f-f8a7-4d2e-acea-408c4ae87517 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:47.945365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4fa60757-3e62-477d-9a56-64a0ffb1a873 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:23:48.058728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4fa60757-3e62-477d-9a56-64a0ffb1a873 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 204 len: 0 microversion: 2.1 time: 0.196947 Jun 02 19:23:48.060476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1113/2238] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:23:47 2022] DELETE /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:23:48.069722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0c347bd0-e294-40ff-8f75-fc0fc36d444b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:48.070441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0c347bd0-e294-40ff-8f75-fc0fc36d444b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:48.080192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c347bd0-e294-40ff-8f75-fc0fc36d444b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:48.080600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c347bd0-e294-40ff-8f75-fc0fc36d444b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:48.081734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c347bd0-e294-40ff-8f75-fc0fc36d444b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:48.082361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c347bd0-e294-40ff-8f75-fc0fc36d444b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:48.185925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6483384f-f8a7-4d2e-acea-408c4ae87517 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:48.194820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6483384f-f8a7-4d2e-acea-408c4ae87517 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.296775 Jun 02 19:23:48.195480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1126/2239] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:48.205241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a85e1fa4-8ea2-46ee-ade3-8a907cd564b6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] Calling method '.version_select at 0x7f5b7e013280>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:48.229970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a85e1fa4-8ea2-46ee-ade3-8a907cd564b6 tempest-TestVolumeBootPattern-78835927 tempest-TestVolumeBootPattern-78835927-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2119598037" status: 202 len: 0 microversion: 2.1 time: 0.032813 Jun 02 19:23:48.230815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1127/2240] 10.222.0.15 () {58 vars in 1262 bytes} [Thu Jun 2 19:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2119598037 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:23:48.287729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2077415907", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0bab12a-826d-423a-95fa-da9a185f22b6"}], "security_groups": [{"name": "tempest-securitygroup--941761544"}], "key_name": "tempest-keypair-480491547", "user_data": "}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:23:48.294408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0c347bd0-e294-40ff-8f75-fc0fc36d444b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:48.305518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0c347bd0-e294-40ff-8f75-fc0fc36d444b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.240312 Jun 02 19:23:48.306821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1114/2241] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:48 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:48.407355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] validate_networks() for [('e0bab12a-826d-423a-95fa-da9a185f22b6', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:23:48.873210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:23:48.874140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:23:48.874140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:23:48.874741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:23:48.875160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:23:48.887015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:48.887715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:48.888642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:48.889129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:48.911890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Getting quotas for project a23ef70d937643f8a1c8597a8cfac596. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:23:48.916645 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Getting quotas for user cef7ac127d2f4284a1808c580148c9e0 and project a23ef70d937643f8a1c8597a8cfac596. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:23:48.930540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:23:48.932869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:23:48.989182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-035d9f10-f7a1-474c-81df-b3579a8a9331 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.705495 Jun 02 19:23:48.990282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1128/2242] 10.222.0.15 () {62 vars in 1187 bytes} [Thu Jun 2 19:23:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 02 19:23:49.002014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f51b657f-cd76-47a8-a6bb-0e63490e1b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:49.003240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f51b657f-cd76-47a8-a6bb-0e63490e1b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:49.078911 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f51b657f-cd76-47a8-a6bb-0e63490e1b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:49.088424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f51b657f-cd76-47a8-a6bb-0e63490e1b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:49.089964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f51b657f-cd76-47a8-a6bb-0e63490e1b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:49.091423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f51b657f-cd76-47a8-a6bb-0e63490e1b6b tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1281 microversion: 2.20 time: 0.094084 Jun 02 19:23:49.092362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1115/2243] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:48 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:23:49.212604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e2029a04-03ea-4779-8d84-11ab6074b7de tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:49.213228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e2029a04-03ea-4779-8d84-11ab6074b7de tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:49.219841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2029a04-03ea-4779-8d84-11ab6074b7de tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:49.220301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2029a04-03ea-4779-8d84-11ab6074b7de tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:49.221087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2029a04-03ea-4779-8d84-11ab6074b7de tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:49.221526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2029a04-03ea-4779-8d84-11ab6074b7de tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:49.325539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3d64d2e0-745d-4442-9707-980a07befb63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:49.326382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3d64d2e0-745d-4442-9707-980a07befb63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:49.340437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3d64d2e0-745d-4442-9707-980a07befb63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:49.341163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3d64d2e0-745d-4442-9707-980a07befb63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:49.342050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3d64d2e0-745d-4442-9707-980a07befb63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:49.342562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3d64d2e0-745d-4442-9707-980a07befb63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:49.388795 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e2029a04-03ea-4779-8d84-11ab6074b7de tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:49.398666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e2029a04-03ea-4779-8d84-11ab6074b7de tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.189857 Jun 02 19:23:49.409011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1129/2244] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:49.520014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3d64d2e0-745d-4442-9707-980a07befb63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:49.530313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3d64d2e0-745d-4442-9707-980a07befb63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.210285 Jun 02 19:23:49.530951 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1116/2245] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:49 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:50.110378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:50.111780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:50.121525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:50.122208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:50.123042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:50.123699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:50.234957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:50.249696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:50.256649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:50.258743 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-07a78de6-b33e-4481-ad11-b7aafbfba81a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1341 microversion: 2.20 time: 0.153816 Jun 02 19:23:50.259575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1130/2246] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:50 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:50.416584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6ba1330f-69ad-4473-a309-58e444c3639e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:50.418207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6ba1330f-69ad-4473-a309-58e444c3639e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:50.428313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ba1330f-69ad-4473-a309-58e444c3639e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:50.429082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ba1330f-69ad-4473-a309-58e444c3639e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:50.430569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ba1330f-69ad-4473-a309-58e444c3639e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:50.431674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ba1330f-69ad-4473-a309-58e444c3639e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:50.547640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-09cb043d-0693-4b9d-ad88-f3fb3c33ef9a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:50.548536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-09cb043d-0693-4b9d-ad88-f3fb3c33ef9a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:50.555301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09cb043d-0693-4b9d-ad88-f3fb3c33ef9a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:50.556044 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09cb043d-0693-4b9d-ad88-f3fb3c33ef9a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:50.557006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09cb043d-0693-4b9d-ad88-f3fb3c33ef9a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:50.557443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-09cb043d-0693-4b9d-ad88-f3fb3c33ef9a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:50.787666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6ba1330f-69ad-4473-a309-58e444c3639e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:50.797640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6ba1330f-69ad-4473-a309-58e444c3639e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.384828 Jun 02 19:23:50.798399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1117/2247] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:50.855889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-09cb043d-0693-4b9d-ad88-f3fb3c33ef9a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:50.864882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-09cb043d-0693-4b9d-ad88-f3fb3c33ef9a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.321634 Jun 02 19:23:50.865534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1131/2248] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:50 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:23:51.278941 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:51.279656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:51.288670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:51.289177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:51.290031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:51.290669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:51.668614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:51.678888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:51.680662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:51.681824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c867e086-dd16-4051-a195-fc58a2115767 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1406 microversion: 2.20 time: 0.408032 Jun 02 19:23:51.682473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1118/2249] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:51 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:51.816199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b6a1bf5d-9f08-4173-beb4-518a677701f1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:51.816791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b6a1bf5d-9f08-4173-beb4-518a677701f1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:51.823608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6a1bf5d-9f08-4173-beb4-518a677701f1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:51.824071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6a1bf5d-9f08-4173-beb4-518a677701f1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:51.825092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6a1bf5d-9f08-4173-beb4-518a677701f1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:51.827573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6a1bf5d-9f08-4173-beb4-518a677701f1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:51.884602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-987c5cda-61a4-4d15-83f1-5cd815095603 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:51.886800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-987c5cda-61a4-4d15-83f1-5cd815095603 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:51.896451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-987c5cda-61a4-4d15-83f1-5cd815095603 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:51.896894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-987c5cda-61a4-4d15-83f1-5cd815095603 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:51.897674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-987c5cda-61a4-4d15-83f1-5cd815095603 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:51.902407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-987c5cda-61a4-4d15-83f1-5cd815095603 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:52.031152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b6a1bf5d-9f08-4173-beb4-518a677701f1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:52.040425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b6a1bf5d-9f08-4173-beb4-518a677701f1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.228359 Jun 02 19:23:52.041296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1132/2250] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:52.092161 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-987c5cda-61a4-4d15-83f1-5cd815095603 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:52.108472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-987c5cda-61a4-4d15-83f1-5cd815095603 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.228247 Jun 02 19:23:52.109395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1119/2251] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:51 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:23:52.487602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-5026b9e2-8013-4345-bbad-ca755e8d34fd req-cd11fafb-8636-4999-b689-1786c0e837c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968d6e4a-b6f7-4e04-a771-afcd71d03539", "tag": "82177338-a233-4fe5-804d-6002dfc43f81"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:23:52.499924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-5026b9e2-8013-4345-bbad-ca755e8d34fd req-cd11fafb-8636-4999-b689-1786c0e837c7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:52.500742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-5026b9e2-8013-4345-bbad-ca755e8d34fd req-cd11fafb-8636-4999-b689-1786c0e837c7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:52.534980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-5026b9e2-8013-4345-bbad-ca755e8d34fd req-cd11fafb-8636-4999-b689-1786c0e837c7 service nova] Creating event network-changed:82177338-a233-4fe5-804d-6002dfc43f81 for instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 on hv-cinder-79760 Jun 02 19:23:52.540561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-5026b9e2-8013-4345-bbad-ca755e8d34fd req-cd11fafb-8636-4999-b689-1786c0e837c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149068 Jun 02 19:23:52.541726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1133/2252] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:23:52.701361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:52.702203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:52.709639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:52.717569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:52.720790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:52.720790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:52.977431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:52.986782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:52.988804 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:52.990500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a2e5622c-ef45-476a-8e38-27370492811a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1406 microversion: 2.20 time: 0.293790 Jun 02 19:23:52.991214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1120/2253] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:52 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:53.059862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bbc1aadb-cc60-4445-a7d4-94ad062d5070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:53.060613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bbc1aadb-cc60-4445-a7d4-94ad062d5070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:53.071648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbc1aadb-cc60-4445-a7d4-94ad062d5070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:53.071648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbc1aadb-cc60-4445-a7d4-94ad062d5070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:53.072125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbc1aadb-cc60-4445-a7d4-94ad062d5070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:53.072764 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbc1aadb-cc60-4445-a7d4-94ad062d5070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:53.128082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dab3784d-ae7c-4f40-979f-a8634c4dbc90 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:53.128775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dab3784d-ae7c-4f40-979f-a8634c4dbc90 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:53.135226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dab3784d-ae7c-4f40-979f-a8634c4dbc90 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:53.135670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dab3784d-ae7c-4f40-979f-a8634c4dbc90 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:53.136653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dab3784d-ae7c-4f40-979f-a8634c4dbc90 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:53.137213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dab3784d-ae7c-4f40-979f-a8634c4dbc90 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:53.370746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bbc1aadb-cc60-4445-a7d4-94ad062d5070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:53.380415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bbc1aadb-cc60-4445-a7d4-94ad062d5070 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.325080 Jun 02 19:23:53.381018 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1134/2254] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:53.417528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dab3784d-ae7c-4f40-979f-a8634c4dbc90 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:53.426327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dab3784d-ae7c-4f40-979f-a8634c4dbc90 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.302461 Jun 02 19:23:53.426926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1121/2255] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:53 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:54.008998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:54.011313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:54.021097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:54.021553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:54.022392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:54.022901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:54.247065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:54.256092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:54.257621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:54.258812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e48b2397-d8bd-4ea2-96d6-0ef32260eb32 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1406 microversion: 2.20 time: 0.254010 Jun 02 19:23:54.259360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1135/2256] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:54 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:54.398239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4d1c782f-9c58-4286-beaf-c6b99eaa8d8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:54.399075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4d1c782f-9c58-4286-beaf-c6b99eaa8d8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:54.407072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d1c782f-9c58-4286-beaf-c6b99eaa8d8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:54.407677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d1c782f-9c58-4286-beaf-c6b99eaa8d8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:54.408558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d1c782f-9c58-4286-beaf-c6b99eaa8d8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:54.409119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d1c782f-9c58-4286-beaf-c6b99eaa8d8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:54.445588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1660d19b-a0b7-4836-9631-2f7eee84ed0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:54.446849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1660d19b-a0b7-4836-9631-2f7eee84ed0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:54.454770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1660d19b-a0b7-4836-9631-2f7eee84ed0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:54.455590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1660d19b-a0b7-4836-9631-2f7eee84ed0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:54.456367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1660d19b-a0b7-4836-9631-2f7eee84ed0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:54.456995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1660d19b-a0b7-4836-9631-2f7eee84ed0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:54.941726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4d1c782f-9c58-4286-beaf-c6b99eaa8d8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:54.952589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4d1c782f-9c58-4286-beaf-c6b99eaa8d8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.558334 Jun 02 19:23:54.953646 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1122/2257] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:54.972341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1660d19b-a0b7-4836-9631-2f7eee84ed0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:54.981208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1660d19b-a0b7-4836-9631-2f7eee84ed0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.540393 Jun 02 19:23:54.982096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1136/2258] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:54 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:55.280417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:55.281341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:55.288011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:55.288466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:55.289326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:55.289736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:55.439391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:55.441828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:55.449789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:55.451598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:55.452741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-76576668-8de6-4a89-9222-14033f5d652a tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1406 microversion: 2.20 time: 0.180000 Jun 02 19:23:55.453635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1123/2259] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:55 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:55.970555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-36a04ff2-bdf8-499d-8aaa-dea0d03e46be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:55.971177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-36a04ff2-bdf8-499d-8aaa-dea0d03e46be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:55.978042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36a04ff2-bdf8-499d-8aaa-dea0d03e46be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:55.978494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36a04ff2-bdf8-499d-8aaa-dea0d03e46be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:55.979258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36a04ff2-bdf8-499d-8aaa-dea0d03e46be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:55.979694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-36a04ff2-bdf8-499d-8aaa-dea0d03e46be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:56.000502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-032b4c46-b13c-4572-bf57-4d8d50eec351 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:56.001309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-032b4c46-b13c-4572-bf57-4d8d50eec351 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:56.009154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-032b4c46-b13c-4572-bf57-4d8d50eec351 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:56.009612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-032b4c46-b13c-4572-bf57-4d8d50eec351 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:56.010889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-032b4c46-b13c-4572-bf57-4d8d50eec351 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:56.011467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-032b4c46-b13c-4572-bf57-4d8d50eec351 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:56.194173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-36a04ff2-bdf8-499d-8aaa-dea0d03e46be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:56.205727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-36a04ff2-bdf8-499d-8aaa-dea0d03e46be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.239074 Jun 02 19:23:56.206539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1137/2260] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:56.223798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-032b4c46-b13c-4572-bf57-4d8d50eec351 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:56.232957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-032b4c46-b13c-4572-bf57-4d8d50eec351 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.238030 Jun 02 19:23:56.233542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1124/2261] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:55 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:56.473858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:56.475010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:56.483504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:56.484435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:56.485253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:56.486121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:56.663139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:56.673226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:56.675048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:56.676210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-652fa449-65d9-4a08-a8ce-055184bb2aff tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1406 microversion: 2.20 time: 0.207144 Jun 02 19:23:56.676772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1138/2262] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:56 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:57.223945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a74abdc7-03dc-445b-87a1-a8e3d9193291 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:57.224692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a74abdc7-03dc-445b-87a1-a8e3d9193291 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:57.232045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a74abdc7-03dc-445b-87a1-a8e3d9193291 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:57.232606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a74abdc7-03dc-445b-87a1-a8e3d9193291 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:57.233734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a74abdc7-03dc-445b-87a1-a8e3d9193291 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:57.234278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a74abdc7-03dc-445b-87a1-a8e3d9193291 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:57.258126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92845d55-93a4-4922-bd47-b29a34008718 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:57.259462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92845d55-93a4-4922-bd47-b29a34008718 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:57.267350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92845d55-93a4-4922-bd47-b29a34008718 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:57.267898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92845d55-93a4-4922-bd47-b29a34008718 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:57.268749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92845d55-93a4-4922-bd47-b29a34008718 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:57.269255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92845d55-93a4-4922-bd47-b29a34008718 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:57.274252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:57.442929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a74abdc7-03dc-445b-87a1-a8e3d9193291 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:57.453112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a74abdc7-03dc-445b-87a1-a8e3d9193291 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.233148 Jun 02 19:23:57.453672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1125/2263] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:57.459669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92845d55-93a4-4922-bd47-b29a34008718 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:57.473360 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92845d55-93a4-4922-bd47-b29a34008718 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.221249 Jun 02 19:23:57.474289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1139/2264] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:57 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:57.695219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:57.695822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:57.702422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:57.702886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:57.703654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:57.704088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:57.849477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:57.858466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:57.859973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:57.861100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bf764978-93b3-4e11-ae1b-bb2ca8f4aafe tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1406 microversion: 2.20 time: 0.169904 Jun 02 19:23:57.861671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1126/2265] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:57 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:58.473616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-da9611e0-d77b-4a85-b7da-b37497a28599 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:58.474887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-da9611e0-d77b-4a85-b7da-b37497a28599 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:58.486942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da9611e0-d77b-4a85-b7da-b37497a28599 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:58.487700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da9611e0-d77b-4a85-b7da-b37497a28599 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:58.488952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da9611e0-d77b-4a85-b7da-b37497a28599 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:58.489678 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-da9611e0-d77b-4a85-b7da-b37497a28599 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:58.651859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-da9611e0-d77b-4a85-b7da-b37497a28599 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:58.660185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-da9611e0-d77b-4a85-b7da-b37497a28599 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.192448 Jun 02 19:23:58.660757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1140/2266] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:58.665437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-52b7f522-4518-4edb-b7df-e054964d3f61 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:58.665910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-52b7f522-4518-4edb-b7df-e054964d3f61 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:58.672565 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52b7f522-4518-4edb-b7df-e054964d3f61 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:58.673011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52b7f522-4518-4edb-b7df-e054964d3f61 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:58.673774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52b7f522-4518-4edb-b7df-e054964d3f61 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:58.674236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52b7f522-4518-4edb-b7df-e054964d3f61 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:58.704645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-94501c7e-a492-4b66-90d6-5430c49fc95d req-80bf4f96-86fa-42c4-96fa-e863f2b5550d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968d6e4a-b6f7-4e04-a771-afcd71d03539", "name": "network-vif-plugged", "status": "completed", "tag": "82177338-a233-4fe5-804d-6002dfc43f81"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:23:58.713011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-94501c7e-a492-4b66-90d6-5430c49fc95d req-80bf4f96-86fa-42c4-96fa-e863f2b5550d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:58.713455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-94501c7e-a492-4b66-90d6-5430c49fc95d req-80bf4f96-86fa-42c4-96fa-e863f2b5550d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:58.725359 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-94501c7e-a492-4b66-90d6-5430c49fc95d req-80bf4f96-86fa-42c4-96fa-e863f2b5550d service nova] Creating event network-vif-plugged:82177338-a233-4fe5-804d-6002dfc43f81 for instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 on hv-cinder-79760 Jun 02 19:23:58.730619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-94501c7e-a492-4b66-90d6-5430c49fc95d req-80bf4f96-86fa-42c4-96fa-e863f2b5550d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259598 Jun 02 19:23:58.731564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1127/2267] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:23:58.816910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-52b7f522-4518-4edb-b7df-e054964d3f61 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:58.826836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-52b7f522-4518-4edb-b7df-e054964d3f61 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164961 Jun 02 19:23:58.827504 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1141/2268] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:58 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:58.880886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:58.881852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:58.888463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:58.888915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:58.889689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:58.890153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:59.033824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:59.042673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:59.044384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:59.045534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-420fa028-f617-449c-b4e7-a82617424393 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1406 microversion: 2.20 time: 0.169787 Jun 02 19:23:59.046094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1128/2269] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:23:58 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:23:59.677396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b929b0c7-fa7c-483b-9df9-c4eb5bbb97ca tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:59.678038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b929b0c7-fa7c-483b-9df9-c4eb5bbb97ca tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:59.679884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:59.680516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:59.687570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b929b0c7-fa7c-483b-9df9-c4eb5bbb97ca tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:59.688035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b929b0c7-fa7c-483b-9df9-c4eb5bbb97ca tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:59.689130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b929b0c7-fa7c-483b-9df9-c4eb5bbb97ca tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:59.689562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b929b0c7-fa7c-483b-9df9-c4eb5bbb97ca tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:59.830591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b929b0c7-fa7c-483b-9df9-c4eb5bbb97ca tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:23:59.838796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b929b0c7-fa7c-483b-9df9-c4eb5bbb97ca tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.165356 Jun 02 19:23:59.839370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1142/2270] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:23:59.845432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b52e4815-0f6b-4150-8f8c-b9a69cf0e42e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:23:59.846075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b52e4815-0f6b-4150-8f8c-b9a69cf0e42e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:23:59.848056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:59.853339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b52e4815-0f6b-4150-8f8c-b9a69cf0e42e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:59.853787 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b52e4815-0f6b-4150-8f8c-b9a69cf0e42e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:23:59.854596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b52e4815-0f6b-4150-8f8c-b9a69cf0e42e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:23:59.855024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b52e4815-0f6b-4150-8f8c-b9a69cf0e42e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:00.014248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b52e4815-0f6b-4150-8f8c-b9a69cf0e42e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:00.022803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b52e4815-0f6b-4150-8f8c-b9a69cf0e42e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.181854 Jun 02 19:24:00.023301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1129/2271] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:23:59 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:00.064311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:00.064946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:00.071289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:00.071742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:00.072513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:00.072941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:00.214680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:00.223302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:00.224799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:00.225991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-084f17c3-4a5e-4b48-a966-b0f3084e7dbc tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1598 microversion: 2.20 time: 0.165928 Jun 02 19:24:00.226555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1143/2272] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:24:00 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:24:00.243352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fe11ccbd-1eff-4834-910f-a501d894f376 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:00.243841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fe11ccbd-1eff-4834-910f-a501d894f376 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:00.250515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe11ccbd-1eff-4834-910f-a501d894f376 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:00.250958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe11ccbd-1eff-4834-910f-a501d894f376 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:00.251705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe11ccbd-1eff-4834-910f-a501d894f376 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:00.252134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe11ccbd-1eff-4834-910f-a501d894f376 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:00.332292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fe11ccbd-1eff-4834-910f-a501d894f376 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092787 Jun 02 19:24:00.332896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1130/2273] 10.222.0.15 () {60 vars in 1315 bytes} [Thu Jun 2 19:24:00 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:24:00.857621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-07a138c5-ef86-479f-a519-75286f879a80 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:00.858259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-07a138c5-ef86-479f-a519-75286f879a80 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:00.860692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:00.866390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a138c5-ef86-479f-a519-75286f879a80 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:00.866839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a138c5-ef86-479f-a519-75286f879a80 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:00.867638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a138c5-ef86-479f-a519-75286f879a80 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:00.868075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07a138c5-ef86-479f-a519-75286f879a80 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:01.041246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7382c471-c3b4-46f4-bb73-9c14e4d48ad0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:01.041870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7382c471-c3b4-46f4-bb73-9c14e4d48ad0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:01.048884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7382c471-c3b4-46f4-bb73-9c14e4d48ad0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:01.049307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7382c471-c3b4-46f4-bb73-9c14e4d48ad0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:01.050140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7382c471-c3b4-46f4-bb73-9c14e4d48ad0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:01.050572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7382c471-c3b4-46f4-bb73-9c14e4d48ad0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:01.083016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-07a138c5-ef86-479f-a519-75286f879a80 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:01.091408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-07a138c5-ef86-479f-a519-75286f879a80 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.238479 Jun 02 19:24:01.092254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1144/2274] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:01.269010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7382c471-c3b4-46f4-bb73-9c14e4d48ad0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:01.277263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7382c471-c3b4-46f4-bb73-9c14e4d48ad0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.240644 Jun 02 19:24:01.278066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1131/2275] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:01 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:01.423967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-94390449-6537-4b0c-9b34-8fdfabddde56 req-415d58ee-5f3e-4906-9daf-4c999656fa16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968d6e4a-b6f7-4e04-a771-afcd71d03539", "tag": "82177338-a233-4fe5-804d-6002dfc43f81"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:24:01.432710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-94390449-6537-4b0c-9b34-8fdfabddde56 req-415d58ee-5f3e-4906-9daf-4c999656fa16 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:01.433157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-94390449-6537-4b0c-9b34-8fdfabddde56 req-415d58ee-5f3e-4906-9daf-4c999656fa16 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:01.445660 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-94390449-6537-4b0c-9b34-8fdfabddde56 req-415d58ee-5f3e-4906-9daf-4c999656fa16 service nova] Creating event network-changed:82177338-a233-4fe5-804d-6002dfc43f81 for instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 on hv-cinder-79760 Jun 02 19:24:01.451067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-94390449-6537-4b0c-9b34-8fdfabddde56 req-415d58ee-5f3e-4906-9daf-4c999656fa16 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030754 Jun 02 19:24:01.451841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1145/2276] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:24:02.108648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6d6a17fc-b0c3-4d8d-b144-e0fd66b49a9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:02.110027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6d6a17fc-b0c3-4d8d-b144-e0fd66b49a9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:02.117574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6a17fc-b0c3-4d8d-b144-e0fd66b49a9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:02.118503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6a17fc-b0c3-4d8d-b144-e0fd66b49a9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:02.119553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6a17fc-b0c3-4d8d-b144-e0fd66b49a9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:02.120225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d6a17fc-b0c3-4d8d-b144-e0fd66b49a9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:02.268495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6d6a17fc-b0c3-4d8d-b144-e0fd66b49a9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:02.277298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6d6a17fc-b0c3-4d8d-b144-e0fd66b49a9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.172372 Jun 02 19:24:02.277877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1132/2277] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:02.295956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6bcd25e9-565d-4d16-860f-e42f18ed4074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:02.296662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6bcd25e9-565d-4d16-860f-e42f18ed4074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:02.303733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcd25e9-565d-4d16-860f-e42f18ed4074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:02.304191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcd25e9-565d-4d16-860f-e42f18ed4074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:02.304967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcd25e9-565d-4d16-860f-e42f18ed4074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:02.305407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bcd25e9-565d-4d16-860f-e42f18ed4074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:02.451353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6bcd25e9-565d-4d16-860f-e42f18ed4074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:02.459729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6bcd25e9-565d-4d16-860f-e42f18ed4074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168519 Jun 02 19:24:02.460287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1146/2278] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:02 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:03.295352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad10263f-b279-4434-b5b3-7bf59213ea0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:03.295932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad10263f-b279-4434-b5b3-7bf59213ea0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:03.303026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad10263f-b279-4434-b5b3-7bf59213ea0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:03.303480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad10263f-b279-4434-b5b3-7bf59213ea0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:03.304244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad10263f-b279-4434-b5b3-7bf59213ea0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:03.304676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad10263f-b279-4434-b5b3-7bf59213ea0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:03.435813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad10263f-b279-4434-b5b3-7bf59213ea0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:03.444928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad10263f-b279-4434-b5b3-7bf59213ea0b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.153633 Jun 02 19:24:03.446777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1133/2279] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:03.476628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-555c05be-2414-4121-9c86-2e45066ac399 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:03.477274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-555c05be-2414-4121-9c86-2e45066ac399 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:03.484415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-555c05be-2414-4121-9c86-2e45066ac399 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:03.484865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-555c05be-2414-4121-9c86-2e45066ac399 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:03.485627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-555c05be-2414-4121-9c86-2e45066ac399 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:03.486094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-555c05be-2414-4121-9c86-2e45066ac399 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:03.629654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-555c05be-2414-4121-9c86-2e45066ac399 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:03.638417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-555c05be-2414-4121-9c86-2e45066ac399 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165673 Jun 02 19:24:03.638991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1147/2280] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:03 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:04.463116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-73309545-2b32-4dfa-9362-5045414b0c71 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:04.463743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-73309545-2b32-4dfa-9362-5045414b0c71 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:04.466175 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:04.472737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73309545-2b32-4dfa-9362-5045414b0c71 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:04.473244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73309545-2b32-4dfa-9362-5045414b0c71 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:04.473710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73309545-2b32-4dfa-9362-5045414b0c71 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:04.474094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73309545-2b32-4dfa-9362-5045414b0c71 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:04.615444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73309545-2b32-4dfa-9362-5045414b0c71 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:04.626317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-73309545-2b32-4dfa-9362-5045414b0c71 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.167090 Jun 02 19:24:04.626880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1134/2281] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:04.657890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-23bc3b7b-6eac-4bf6-91c5-4c11ff4aebcd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:04.658943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-23bc3b7b-6eac-4bf6-91c5-4c11ff4aebcd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:04.667848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-23bc3b7b-6eac-4bf6-91c5-4c11ff4aebcd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:04.668336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-23bc3b7b-6eac-4bf6-91c5-4c11ff4aebcd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:04.669211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-23bc3b7b-6eac-4bf6-91c5-4c11ff4aebcd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:04.669694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-23bc3b7b-6eac-4bf6-91c5-4c11ff4aebcd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:04.807143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-23bc3b7b-6eac-4bf6-91c5-4c11ff4aebcd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:04.815894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-23bc3b7b-6eac-4bf6-91c5-4c11ff4aebcd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.163748 Jun 02 19:24:04.816503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1148/2282] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:04 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:05.644949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f06b10ab-9e6f-4607-9861-a44373f91813 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:05.645735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f06b10ab-9e6f-4607-9861-a44373f91813 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:05.657147 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f06b10ab-9e6f-4607-9861-a44373f91813 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:05.657590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f06b10ab-9e6f-4607-9861-a44373f91813 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:05.658388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f06b10ab-9e6f-4607-9861-a44373f91813 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:05.658816 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f06b10ab-9e6f-4607-9861-a44373f91813 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:05.807242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f06b10ab-9e6f-4607-9861-a44373f91813 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:05.816946 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f06b10ab-9e6f-4607-9861-a44373f91813 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.176037 Jun 02 19:24:05.817520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1135/2283] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:05.832876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ce051a0d-8fe8-4d82-b6d1-0ad26ddc29c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:05.833548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ce051a0d-8fe8-4d82-b6d1-0ad26ddc29c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:05.840915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce051a0d-8fe8-4d82-b6d1-0ad26ddc29c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:05.841366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce051a0d-8fe8-4d82-b6d1-0ad26ddc29c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:05.842374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce051a0d-8fe8-4d82-b6d1-0ad26ddc29c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:05.842810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce051a0d-8fe8-4d82-b6d1-0ad26ddc29c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:05.988488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ce051a0d-8fe8-4d82-b6d1-0ad26ddc29c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:05.996780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ce051a0d-8fe8-4d82-b6d1-0ad26ddc29c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167919 Jun 02 19:24:05.997390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1149/2284] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:05 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:06.834473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-004e280d-3414-4018-87ce-409838456609 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:06.835040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-004e280d-3414-4018-87ce-409838456609 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:06.842183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-004e280d-3414-4018-87ce-409838456609 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:06.842628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-004e280d-3414-4018-87ce-409838456609 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:06.843399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-004e280d-3414-4018-87ce-409838456609 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:06.843832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-004e280d-3414-4018-87ce-409838456609 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:07.014780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a073ee32-f065-4295-a1c2-11b0b1dcfe84 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:07.015392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a073ee32-f065-4295-a1c2-11b0b1dcfe84 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:07.022859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a073ee32-f065-4295-a1c2-11b0b1dcfe84 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:07.023386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a073ee32-f065-4295-a1c2-11b0b1dcfe84 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:07.024428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a073ee32-f065-4295-a1c2-11b0b1dcfe84 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:07.024779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a073ee32-f065-4295-a1c2-11b0b1dcfe84 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:07.228629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-004e280d-3414-4018-87ce-409838456609 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:07.238073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-004e280d-3414-4018-87ce-409838456609 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.407405 Jun 02 19:24:07.238734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1136/2285] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:07.329942 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a073ee32-f065-4295-a1c2-11b0b1dcfe84 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:07.338267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a073ee32-f065-4295-a1c2-11b0b1dcfe84 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.327778 Jun 02 19:24:07.338810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1150/2286] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:07 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:08.258371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2296471a-6ce0-4487-9b37-3664eff5b326 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:08.259119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2296471a-6ce0-4487-9b37-3664eff5b326 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:08.266454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2296471a-6ce0-4487-9b37-3664eff5b326 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:08.266923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2296471a-6ce0-4487-9b37-3664eff5b326 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:08.267705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2296471a-6ce0-4487-9b37-3664eff5b326 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:08.268140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2296471a-6ce0-4487-9b37-3664eff5b326 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:08.358610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4d23a7d1-492b-435c-aee3-bac952231b4a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:08.359236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4d23a7d1-492b-435c-aee3-bac952231b4a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:08.366162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d23a7d1-492b-435c-aee3-bac952231b4a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:08.366615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d23a7d1-492b-435c-aee3-bac952231b4a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:08.367391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d23a7d1-492b-435c-aee3-bac952231b4a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:08.367829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d23a7d1-492b-435c-aee3-bac952231b4a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:08.442044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2296471a-6ce0-4487-9b37-3664eff5b326 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:08.450290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2296471a-6ce0-4487-9b37-3664eff5b326 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.195985 Jun 02 19:24:08.450877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1137/2287] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:08.520901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4d23a7d1-492b-435c-aee3-bac952231b4a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:08.530454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4d23a7d1-492b-435c-aee3-bac952231b4a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.177924 Jun 02 19:24:08.531034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1151/2288] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:08 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:24:09.468374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7719cab3-82bf-4fd2-9ec2-455639bc97bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:09.469008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7719cab3-82bf-4fd2-9ec2-455639bc97bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:09.476325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7719cab3-82bf-4fd2-9ec2-455639bc97bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:09.476781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7719cab3-82bf-4fd2-9ec2-455639bc97bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:09.477542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7719cab3-82bf-4fd2-9ec2-455639bc97bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:09.478019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7719cab3-82bf-4fd2-9ec2-455639bc97bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:09.548601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6550d33f-98ec-431d-a000-6c52cfcd918d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:09.549254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6550d33f-98ec-431d-a000-6c52cfcd918d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:09.556346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6550d33f-98ec-431d-a000-6c52cfcd918d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:09.557132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6550d33f-98ec-431d-a000-6c52cfcd918d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:09.557572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6550d33f-98ec-431d-a000-6c52cfcd918d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:09.558062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6550d33f-98ec-431d-a000-6c52cfcd918d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:09.641956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7719cab3-82bf-4fd2-9ec2-455639bc97bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:09.650269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7719cab3-82bf-4fd2-9ec2-455639bc97bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.185847 Jun 02 19:24:09.650851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1138/2289] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:09.711379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6550d33f-98ec-431d-a000-6c52cfcd918d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:09.719907 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6550d33f-98ec-431d-a000-6c52cfcd918d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.175712 Jun 02 19:24:09.720428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1152/2290] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:09 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:10.669859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-356a2f00-ca74-45f1-8971-817f3b56f970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:10.670816 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-356a2f00-ca74-45f1-8971-817f3b56f970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:10.677761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-356a2f00-ca74-45f1-8971-817f3b56f970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:10.678282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-356a2f00-ca74-45f1-8971-817f3b56f970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:10.679075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-356a2f00-ca74-45f1-8971-817f3b56f970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:10.679527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-356a2f00-ca74-45f1-8971-817f3b56f970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:10.736746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f88270ca-e5e3-4015-ab07-383fd16caf46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:10.737369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f88270ca-e5e3-4015-ab07-383fd16caf46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:10.744222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f88270ca-e5e3-4015-ab07-383fd16caf46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:10.744682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f88270ca-e5e3-4015-ab07-383fd16caf46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:10.745466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f88270ca-e5e3-4015-ab07-383fd16caf46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:10.745952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f88270ca-e5e3-4015-ab07-383fd16caf46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:10.856221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-356a2f00-ca74-45f1-8971-817f3b56f970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:10.864929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-356a2f00-ca74-45f1-8971-817f3b56f970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.199109 Jun 02 19:24:10.865504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1139/2291] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:10.908688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f88270ca-e5e3-4015-ab07-383fd16caf46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:10.919596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f88270ca-e5e3-4015-ab07-383fd16caf46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.186771 Jun 02 19:24:10.920140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1153/2292] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:10 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:11.882380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-34695f87-b68b-40c7-be00-7bbdf198d864 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:11.882988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-34695f87-b68b-40c7-be00-7bbdf198d864 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:11.890448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34695f87-b68b-40c7-be00-7bbdf198d864 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:11.890897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34695f87-b68b-40c7-be00-7bbdf198d864 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:11.891659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34695f87-b68b-40c7-be00-7bbdf198d864 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:11.892095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34695f87-b68b-40c7-be00-7bbdf198d864 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:11.938946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ffc081eb-8c3f-4414-bcce-9272dd0f94d8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:11.939683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ffc081eb-8c3f-4414-bcce-9272dd0f94d8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:11.946603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffc081eb-8c3f-4414-bcce-9272dd0f94d8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:11.947039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffc081eb-8c3f-4414-bcce-9272dd0f94d8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:11.947821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffc081eb-8c3f-4414-bcce-9272dd0f94d8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:11.948274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ffc081eb-8c3f-4414-bcce-9272dd0f94d8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:12.085310 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-34695f87-b68b-40c7-be00-7bbdf198d864 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:12.093942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-34695f87-b68b-40c7-be00-7bbdf198d864 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.215386 Jun 02 19:24:12.094742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1140/2293] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:12.114486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ffc081eb-8c3f-4414-bcce-9272dd0f94d8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:12.122804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ffc081eb-8c3f-4414-bcce-9272dd0f94d8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.189305 Jun 02 19:24:12.123362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1154/2294] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:11 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:13.112182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d0659aa2-b86b-4926-b308-ec0c220edca9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:13.112806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d0659aa2-b86b-4926-b308-ec0c220edca9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:13.120102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d0659aa2-b86b-4926-b308-ec0c220edca9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:13.120698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d0659aa2-b86b-4926-b308-ec0c220edca9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:13.121309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d0659aa2-b86b-4926-b308-ec0c220edca9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:13.121736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d0659aa2-b86b-4926-b308-ec0c220edca9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:13.140191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:13.140612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-11232a42-70c3-4e4b-a8ad-8640962d6d7b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:13.141234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-11232a42-70c3-4e4b-a8ad-8640962d6d7b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:13.148086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11232a42-70c3-4e4b-a8ad-8640962d6d7b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:13.148549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11232a42-70c3-4e4b-a8ad-8640962d6d7b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:13.149710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11232a42-70c3-4e4b-a8ad-8640962d6d7b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:13.150196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11232a42-70c3-4e4b-a8ad-8640962d6d7b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:13.316115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d0659aa2-b86b-4926-b308-ec0c220edca9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:13.324998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d0659aa2-b86b-4926-b308-ec0c220edca9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.217345 Jun 02 19:24:13.325582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1141/2295] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:13.351039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-11232a42-70c3-4e4b-a8ad-8640962d6d7b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:13.361459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-11232a42-70c3-4e4b-a8ad-8640962d6d7b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.224427 Jun 02 19:24:13.362399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1155/2296] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:13 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:24:14.344979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2032aef6-7ee5-45ce-8dac-f7ea0784889b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:14.345649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2032aef6-7ee5-45ce-8dac-f7ea0784889b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:14.352721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2032aef6-7ee5-45ce-8dac-f7ea0784889b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:14.353173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2032aef6-7ee5-45ce-8dac-f7ea0784889b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:14.353967 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2032aef6-7ee5-45ce-8dac-f7ea0784889b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:14.354437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2032aef6-7ee5-45ce-8dac-f7ea0784889b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:14.382827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e17abed-ff2e-4231-8577-b32bb9bdc992 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:14.383435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e17abed-ff2e-4231-8577-b32bb9bdc992 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:14.390872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e17abed-ff2e-4231-8577-b32bb9bdc992 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:14.391323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e17abed-ff2e-4231-8577-b32bb9bdc992 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:14.392113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e17abed-ff2e-4231-8577-b32bb9bdc992 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:14.392550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e17abed-ff2e-4231-8577-b32bb9bdc992 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:14.415569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:14.554569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2032aef6-7ee5-45ce-8dac-f7ea0784889b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:14.565718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2032aef6-7ee5-45ce-8dac-f7ea0784889b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.224956 Jun 02 19:24:14.566353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1142/2297] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:14.598703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5e17abed-ff2e-4231-8577-b32bb9bdc992 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:14.607200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e17abed-ff2e-4231-8577-b32bb9bdc992 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.228219 Jun 02 19:24:14.607860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1156/2298] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:14 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:15.582762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2d98a574-575b-4680-99bb-3b4c4958d955 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:15.583395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2d98a574-575b-4680-99bb-3b4c4958d955 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:15.590499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d98a574-575b-4680-99bb-3b4c4958d955 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:15.590944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d98a574-575b-4680-99bb-3b4c4958d955 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:15.591695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d98a574-575b-4680-99bb-3b4c4958d955 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:15.592216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d98a574-575b-4680-99bb-3b4c4958d955 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:15.628991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a6f76bb4-1c5e-4673-a969-e8452ffe5074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:15.629641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a6f76bb4-1c5e-4673-a969-e8452ffe5074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:15.636485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6f76bb4-1c5e-4673-a969-e8452ffe5074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:15.637073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6f76bb4-1c5e-4673-a969-e8452ffe5074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:15.637725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6f76bb4-1c5e-4673-a969-e8452ffe5074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:15.638207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6f76bb4-1c5e-4673-a969-e8452ffe5074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:15.739739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2d98a574-575b-4680-99bb-3b4c4958d955 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:15.749497 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2d98a574-575b-4680-99bb-3b4c4958d955 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.169826 Jun 02 19:24:15.750265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1143/2299] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:15.954046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a6f76bb4-1c5e-4673-a969-e8452ffe5074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:15.962357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a6f76bb4-1c5e-4673-a969-e8452ffe5074 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.337204 Jun 02 19:24:15.962955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1157/2300] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:15 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:16.767833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3946a53c-d829-446e-8a3c-242f67bb5c96 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:16.768473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3946a53c-d829-446e-8a3c-242f67bb5c96 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:16.775352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3946a53c-d829-446e-8a3c-242f67bb5c96 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:16.775799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3946a53c-d829-446e-8a3c-242f67bb5c96 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:16.776555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3946a53c-d829-446e-8a3c-242f67bb5c96 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:16.776976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3946a53c-d829-446e-8a3c-242f67bb5c96 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:16.932049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3946a53c-d829-446e-8a3c-242f67bb5c96 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:16.940872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3946a53c-d829-446e-8a3c-242f67bb5c96 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.177360 Jun 02 19:24:16.941439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1144/2301] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:16.979768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fbfb0198-5a5a-424a-b955-605f12476838 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:16.980368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fbfb0198-5a5a-424a-b955-605f12476838 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:16.987605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbfb0198-5a5a-424a-b955-605f12476838 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:16.988069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbfb0198-5a5a-424a-b955-605f12476838 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:16.988844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbfb0198-5a5a-424a-b955-605f12476838 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:16.989289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbfb0198-5a5a-424a-b955-605f12476838 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:17.125019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fbfb0198-5a5a-424a-b955-605f12476838 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:17.134073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fbfb0198-5a5a-424a-b955-605f12476838 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.158188 Jun 02 19:24:17.134639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1158/2302] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:16 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:17.958671 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6e3248a7-4ade-4648-a98c-893ed508b880 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:17.959315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6e3248a7-4ade-4648-a98c-893ed508b880 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:17.966236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e3248a7-4ade-4648-a98c-893ed508b880 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:17.966684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e3248a7-4ade-4648-a98c-893ed508b880 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:17.968023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e3248a7-4ade-4648-a98c-893ed508b880 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:17.968460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e3248a7-4ade-4648-a98c-893ed508b880 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:18.113294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6e3248a7-4ade-4648-a98c-893ed508b880 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:18.121960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6e3248a7-4ade-4648-a98c-893ed508b880 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.167168 Jun 02 19:24:18.122544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1145/2303] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:18.151571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-865887f1-8196-4023-aeef-d944bc806d77 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:18.152168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-865887f1-8196-4023-aeef-d944bc806d77 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:18.159030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-865887f1-8196-4023-aeef-d944bc806d77 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:18.159484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-865887f1-8196-4023-aeef-d944bc806d77 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:18.160307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-865887f1-8196-4023-aeef-d944bc806d77 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:18.160746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-865887f1-8196-4023-aeef-d944bc806d77 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:18.308530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-865887f1-8196-4023-aeef-d944bc806d77 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:18.318169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-865887f1-8196-4023-aeef-d944bc806d77 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.170323 Jun 02 19:24:18.318741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1159/2304] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:18 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:19.140398 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b8cdd846-3476-4cea-b573-8625dea3c53e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:19.141016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b8cdd846-3476-4cea-b573-8625dea3c53e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:19.147855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8cdd846-3476-4cea-b573-8625dea3c53e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:19.148322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8cdd846-3476-4cea-b573-8625dea3c53e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:19.149067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8cdd846-3476-4cea-b573-8625dea3c53e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:19.149493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8cdd846-3476-4cea-b573-8625dea3c53e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:19.290257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b8cdd846-3476-4cea-b573-8625dea3c53e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:19.298617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b8cdd846-3476-4cea-b573-8625dea3c53e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.162512 Jun 02 19:24:19.299183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1146/2305] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:19.335750 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d18a8f4d-06dc-4d91-b2c2-3ec0d6ad43ed tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:19.336333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d18a8f4d-06dc-4d91-b2c2-3ec0d6ad43ed tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:19.343579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d18a8f4d-06dc-4d91-b2c2-3ec0d6ad43ed tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:19.344026 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d18a8f4d-06dc-4d91-b2c2-3ec0d6ad43ed tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:19.344787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d18a8f4d-06dc-4d91-b2c2-3ec0d6ad43ed tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:19.345220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d18a8f4d-06dc-4d91-b2c2-3ec0d6ad43ed tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:19.474160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d18a8f4d-06dc-4d91-b2c2-3ec0d6ad43ed tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:19.482533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d18a8f4d-06dc-4d91-b2c2-3ec0d6ad43ed tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.150637 Jun 02 19:24:19.483152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1160/2306] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:19 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:20.316707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1fe99072-68c4-4abf-8c25-8dea573ed7b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:20.317352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1fe99072-68c4-4abf-8c25-8dea573ed7b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:20.324908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fe99072-68c4-4abf-8c25-8dea573ed7b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:20.325361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fe99072-68c4-4abf-8c25-8dea573ed7b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:20.326303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fe99072-68c4-4abf-8c25-8dea573ed7b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:20.326943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fe99072-68c4-4abf-8c25-8dea573ed7b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:20.469731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1fe99072-68c4-4abf-8c25-8dea573ed7b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:20.477999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1fe99072-68c4-4abf-8c25-8dea573ed7b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.165509 Jun 02 19:24:20.478573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1147/2307] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:20.500414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b3ecc0ec-f7e7-404f-8dc1-449c1daf815c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:20.500965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b3ecc0ec-f7e7-404f-8dc1-449c1daf815c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:20.508055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b3ecc0ec-f7e7-404f-8dc1-449c1daf815c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:20.508513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b3ecc0ec-f7e7-404f-8dc1-449c1daf815c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:20.509284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b3ecc0ec-f7e7-404f-8dc1-449c1daf815c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:20.509726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b3ecc0ec-f7e7-404f-8dc1-449c1daf815c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:20.644277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b3ecc0ec-f7e7-404f-8dc1-449c1daf815c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:20.652641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b3ecc0ec-f7e7-404f-8dc1-449c1daf815c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156277 Jun 02 19:24:20.653207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1161/2308] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:20 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:21.496373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1decf808-dfaa-40cd-9294-3199ccaad62f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:21.497007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1decf808-dfaa-40cd-9294-3199ccaad62f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:21.504375 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1decf808-dfaa-40cd-9294-3199ccaad62f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:21.505054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1decf808-dfaa-40cd-9294-3199ccaad62f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:21.506212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1decf808-dfaa-40cd-9294-3199ccaad62f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:21.506948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1decf808-dfaa-40cd-9294-3199ccaad62f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:21.656881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1decf808-dfaa-40cd-9294-3199ccaad62f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:21.665415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1decf808-dfaa-40cd-9294-3199ccaad62f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.173258 Jun 02 19:24:21.666097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1148/2309] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:21.673488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5acca6ba-4217-4a8c-8cc3-62a3c7d1c219 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:21.675778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5acca6ba-4217-4a8c-8cc3-62a3c7d1c219 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:21.686000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5acca6ba-4217-4a8c-8cc3-62a3c7d1c219 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:21.686000 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5acca6ba-4217-4a8c-8cc3-62a3c7d1c219 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:21.687116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5acca6ba-4217-4a8c-8cc3-62a3c7d1c219 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:21.687579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5acca6ba-4217-4a8c-8cc3-62a3c7d1c219 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:21.831697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5acca6ba-4217-4a8c-8cc3-62a3c7d1c219 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:21.844722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5acca6ba-4217-4a8c-8cc3-62a3c7d1c219 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.177228 Jun 02 19:24:21.845306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1162/2310] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:21 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:22.685066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-85071013-5637-4fff-83a7-87b715f3f87f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:22.686385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-85071013-5637-4fff-83a7-87b715f3f87f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:22.693824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85071013-5637-4fff-83a7-87b715f3f87f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:22.694329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85071013-5637-4fff-83a7-87b715f3f87f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:22.695091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85071013-5637-4fff-83a7-87b715f3f87f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:22.695518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85071013-5637-4fff-83a7-87b715f3f87f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:22.839472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85071013-5637-4fff-83a7-87b715f3f87f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:22.847873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-85071013-5637-4fff-83a7-87b715f3f87f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.166725 Jun 02 19:24:22.848449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1149/2311] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:24:22.866738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-caae510f-4b5f-42ae-a62c-4f20ed9bb942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:22.867356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-caae510f-4b5f-42ae-a62c-4f20ed9bb942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:22.874559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-caae510f-4b5f-42ae-a62c-4f20ed9bb942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:22.875019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-caae510f-4b5f-42ae-a62c-4f20ed9bb942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:22.875824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-caae510f-4b5f-42ae-a62c-4f20ed9bb942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:22.876261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-caae510f-4b5f-42ae-a62c-4f20ed9bb942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:23.032926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-caae510f-4b5f-42ae-a62c-4f20ed9bb942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:23.041326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-caae510f-4b5f-42ae-a62c-4f20ed9bb942 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.182282 Jun 02 19:24:23.041967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1163/2312] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:22 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:23.865433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b75dfa9b-258f-49eb-8e62-e8c4f950e60f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:23.866048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b75dfa9b-258f-49eb-8e62-e8c4f950e60f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:23.872888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b75dfa9b-258f-49eb-8e62-e8c4f950e60f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:23.873422 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b75dfa9b-258f-49eb-8e62-e8c4f950e60f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:23.874209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b75dfa9b-258f-49eb-8e62-e8c4f950e60f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:23.874641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b75dfa9b-258f-49eb-8e62-e8c4f950e60f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:24.006070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b75dfa9b-258f-49eb-8e62-e8c4f950e60f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:24.015942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b75dfa9b-258f-49eb-8e62-e8c4f950e60f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.154414 Jun 02 19:24:24.016505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1150/2313] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:24.059291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e0bd3a2d-0f6a-4fe4-bb00-1c1e3317eb27 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:24.059911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e0bd3a2d-0f6a-4fe4-bb00-1c1e3317eb27 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:24.067832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0bd3a2d-0f6a-4fe4-bb00-1c1e3317eb27 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:24.068289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0bd3a2d-0f6a-4fe4-bb00-1c1e3317eb27 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:24.069129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0bd3a2d-0f6a-4fe4-bb00-1c1e3317eb27 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:24.069566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0bd3a2d-0f6a-4fe4-bb00-1c1e3317eb27 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:24.205064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e0bd3a2d-0f6a-4fe4-bb00-1c1e3317eb27 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:24.213074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e0bd3a2d-0f6a-4fe4-bb00-1c1e3317eb27 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.157758 Jun 02 19:24:24.213634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1164/2314] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:24 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:25.034292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3de235a6-fe9c-4505-8472-63453eebd992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:25.035033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3de235a6-fe9c-4505-8472-63453eebd992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:25.041825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3de235a6-fe9c-4505-8472-63453eebd992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:25.042285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3de235a6-fe9c-4505-8472-63453eebd992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:25.043050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3de235a6-fe9c-4505-8472-63453eebd992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:25.043484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3de235a6-fe9c-4505-8472-63453eebd992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:25.190392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3de235a6-fe9c-4505-8472-63453eebd992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:25.198827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3de235a6-fe9c-4505-8472-63453eebd992 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.169028 Jun 02 19:24:25.199400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1151/2315] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:25.230717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-922353a2-5b9e-48ae-83d4-95db7e112915 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:25.231354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-922353a2-5b9e-48ae-83d4-95db7e112915 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:25.239174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-922353a2-5b9e-48ae-83d4-95db7e112915 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:25.239631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-922353a2-5b9e-48ae-83d4-95db7e112915 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:25.240415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-922353a2-5b9e-48ae-83d4-95db7e112915 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:25.240847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-922353a2-5b9e-48ae-83d4-95db7e112915 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:25.385256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-922353a2-5b9e-48ae-83d4-95db7e112915 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:25.393777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-922353a2-5b9e-48ae-83d4-95db7e112915 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167012 Jun 02 19:24:25.394368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1165/2316] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:25 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:26.216948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-57ce2f0d-aa92-4388-9257-542995735f8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:26.217645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-57ce2f0d-aa92-4388-9257-542995735f8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:26.224556 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57ce2f0d-aa92-4388-9257-542995735f8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:26.224998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57ce2f0d-aa92-4388-9257-542995735f8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:26.225748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57ce2f0d-aa92-4388-9257-542995735f8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:26.226245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57ce2f0d-aa92-4388-9257-542995735f8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:26.356875 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-57ce2f0d-aa92-4388-9257-542995735f8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:26.365732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-57ce2f0d-aa92-4388-9257-542995735f8c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.152907 Jun 02 19:24:26.366343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1152/2317] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:26.411233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f8ed4b51-d4cd-4a80-8a42-57a17c054a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:26.411830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f8ed4b51-d4cd-4a80-8a42-57a17c054a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:26.418835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8ed4b51-d4cd-4a80-8a42-57a17c054a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:26.419296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8ed4b51-d4cd-4a80-8a42-57a17c054a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:26.420162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8ed4b51-d4cd-4a80-8a42-57a17c054a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:26.420591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f8ed4b51-d4cd-4a80-8a42-57a17c054a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:26.558601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f8ed4b51-d4cd-4a80-8a42-57a17c054a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:26.567751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f8ed4b51-d4cd-4a80-8a42-57a17c054a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160461 Jun 02 19:24:26.568327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1166/2318] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:26 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:27.383278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-94363a29-93e5-4d70-94ec-f95509c98cf3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:27.383878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-94363a29-93e5-4d70-94ec-f95509c98cf3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:27.391123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94363a29-93e5-4d70-94ec-f95509c98cf3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:27.391576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94363a29-93e5-4d70-94ec-f95509c98cf3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:27.392339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94363a29-93e5-4d70-94ec-f95509c98cf3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:27.392770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94363a29-93e5-4d70-94ec-f95509c98cf3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:27.530248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-94363a29-93e5-4d70-94ec-f95509c98cf3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:27.538408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-94363a29-93e5-4d70-94ec-f95509c98cf3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.159070 Jun 02 19:24:27.538964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1153/2319] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:27.585293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7517683c-77b1-4a8f-8f10-fbbb469f5ef9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:27.585922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7517683c-77b1-4a8f-8f10-fbbb469f5ef9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:27.592878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7517683c-77b1-4a8f-8f10-fbbb469f5ef9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:27.593323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7517683c-77b1-4a8f-8f10-fbbb469f5ef9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:27.594116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7517683c-77b1-4a8f-8f10-fbbb469f5ef9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:27.594553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7517683c-77b1-4a8f-8f10-fbbb469f5ef9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:27.731385 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7517683c-77b1-4a8f-8f10-fbbb469f5ef9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:27.739532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7517683c-77b1-4a8f-8f10-fbbb469f5ef9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.158146 Jun 02 19:24:27.740093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1167/2320] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:27 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:28.556932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4ce881b7-e668-4bbe-b0c0-ac34afe73979 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:28.557606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4ce881b7-e668-4bbe-b0c0-ac34afe73979 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:28.566073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ce881b7-e668-4bbe-b0c0-ac34afe73979 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:28.566516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ce881b7-e668-4bbe-b0c0-ac34afe73979 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:28.567297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ce881b7-e668-4bbe-b0c0-ac34afe73979 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:28.567729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ce881b7-e668-4bbe-b0c0-ac34afe73979 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:28.705329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4ce881b7-e668-4bbe-b0c0-ac34afe73979 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:28.713770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4ce881b7-e668-4bbe-b0c0-ac34afe73979 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.160973 Jun 02 19:24:28.714437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1154/2321] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:28.757307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-070e831d-0293-40e0-b5e1-21cd9d031f43 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:28.757974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-070e831d-0293-40e0-b5e1-21cd9d031f43 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:28.764827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-070e831d-0293-40e0-b5e1-21cd9d031f43 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:28.765280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-070e831d-0293-40e0-b5e1-21cd9d031f43 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:28.766077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-070e831d-0293-40e0-b5e1-21cd9d031f43 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:28.766517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-070e831d-0293-40e0-b5e1-21cd9d031f43 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:28.907427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-070e831d-0293-40e0-b5e1-21cd9d031f43 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:28.918661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-070e831d-0293-40e0-b5e1-21cd9d031f43 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165212 Jun 02 19:24:28.919406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1168/2322] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:28 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:29.731091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e8dba7ef-aa3e-482f-b235-b622a08c5f1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:29.731722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e8dba7ef-aa3e-482f-b235-b622a08c5f1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:29.738546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8dba7ef-aa3e-482f-b235-b622a08c5f1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:29.738998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8dba7ef-aa3e-482f-b235-b622a08c5f1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:29.739862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8dba7ef-aa3e-482f-b235-b622a08c5f1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:29.740299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e8dba7ef-aa3e-482f-b235-b622a08c5f1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:29.887780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e8dba7ef-aa3e-482f-b235-b622a08c5f1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:29.901105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e8dba7ef-aa3e-482f-b235-b622a08c5f1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.173579 Jun 02 19:24:29.902118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1155/2323] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:29.941904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7eafd75a-44e7-4572-82b7-4f0dec793239 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:29.942507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7eafd75a-44e7-4572-82b7-4f0dec793239 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:29.949898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7eafd75a-44e7-4572-82b7-4f0dec793239 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:29.950463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7eafd75a-44e7-4572-82b7-4f0dec793239 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:29.951603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7eafd75a-44e7-4572-82b7-4f0dec793239 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:29.952184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7eafd75a-44e7-4572-82b7-4f0dec793239 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:30.087039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7eafd75a-44e7-4572-82b7-4f0dec793239 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:30.095823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7eafd75a-44e7-4572-82b7-4f0dec793239 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.158239 Jun 02 19:24:30.096402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1169/2324] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:29 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:30.922675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-79b08c8f-a677-4add-9f32-870d34546091 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:30.923344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-79b08c8f-a677-4add-9f32-870d34546091 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:30.930361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79b08c8f-a677-4add-9f32-870d34546091 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:30.930808 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79b08c8f-a677-4add-9f32-870d34546091 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:30.931564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79b08c8f-a677-4add-9f32-870d34546091 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:30.932481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79b08c8f-a677-4add-9f32-870d34546091 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:31.074044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-79b08c8f-a677-4add-9f32-870d34546091 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:31.082909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-79b08c8f-a677-4add-9f32-870d34546091 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.165437 Jun 02 19:24:31.083449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1156/2325] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:31.113499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-260c2f54-228f-4a6d-83ce-0208394f5c57 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:31.114179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-260c2f54-228f-4a6d-83ce-0208394f5c57 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:31.116646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=52 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:31.122278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-260c2f54-228f-4a6d-83ce-0208394f5c57 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:31.122781 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-260c2f54-228f-4a6d-83ce-0208394f5c57 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:31.123558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-260c2f54-228f-4a6d-83ce-0208394f5c57 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:31.124021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-260c2f54-228f-4a6d-83ce-0208394f5c57 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:31.260505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-260c2f54-228f-4a6d-83ce-0208394f5c57 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:31.268968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-260c2f54-228f-4a6d-83ce-0208394f5c57 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159318 Jun 02 19:24:31.269531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1170/2326] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:31 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:32.102485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edc1ac55-21b0-422c-8d81-5e99a879eb50 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:32.103213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-edc1ac55-21b0-422c-8d81-5e99a879eb50 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:32.113360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc1ac55-21b0-422c-8d81-5e99a879eb50 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:32.114174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc1ac55-21b0-422c-8d81-5e99a879eb50 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:32.115483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc1ac55-21b0-422c-8d81-5e99a879eb50 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:32.116201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc1ac55-21b0-422c-8d81-5e99a879eb50 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:32.253219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-edc1ac55-21b0-422c-8d81-5e99a879eb50 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:32.261544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-edc1ac55-21b0-422c-8d81-5e99a879eb50 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.164661 Jun 02 19:24:32.262120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1157/2327] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:32.288972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57d9bf50-2b51-4b8f-8967-41803ff9f542 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:32.289631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-57d9bf50-2b51-4b8f-8967-41803ff9f542 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:32.298933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57d9bf50-2b51-4b8f-8967-41803ff9f542 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:32.299387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57d9bf50-2b51-4b8f-8967-41803ff9f542 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:32.300146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57d9bf50-2b51-4b8f-8967-41803ff9f542 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:32.300603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57d9bf50-2b51-4b8f-8967-41803ff9f542 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:32.442486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57d9bf50-2b51-4b8f-8967-41803ff9f542 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:32.450638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-57d9bf50-2b51-4b8f-8967-41803ff9f542 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167675 Jun 02 19:24:32.451650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1171/2328] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:32 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:33.282450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dff982b2-6564-4788-8b8a-f8df958ffb75 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:33.283180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dff982b2-6564-4788-8b8a-f8df958ffb75 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:33.293019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dff982b2-6564-4788-8b8a-f8df958ffb75 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:33.293471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dff982b2-6564-4788-8b8a-f8df958ffb75 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:33.294271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dff982b2-6564-4788-8b8a-f8df958ffb75 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:33.294761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dff982b2-6564-4788-8b8a-f8df958ffb75 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:33.297531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:33.438304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dff982b2-6564-4788-8b8a-f8df958ffb75 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:33.446759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dff982b2-6564-4788-8b8a-f8df958ffb75 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.169874 Jun 02 19:24:33.447331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1158/2329] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:33.468684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-83666999-0bb5-42cc-ad3e-830b0c1c647f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:33.469256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-83666999-0bb5-42cc-ad3e-830b0c1c647f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:33.476218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83666999-0bb5-42cc-ad3e-830b0c1c647f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:33.476673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83666999-0bb5-42cc-ad3e-830b0c1c647f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:33.477432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83666999-0bb5-42cc-ad3e-830b0c1c647f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:33.477873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83666999-0bb5-42cc-ad3e-830b0c1c647f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:33.614391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-83666999-0bb5-42cc-ad3e-830b0c1c647f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:33.622909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-83666999-0bb5-42cc-ad3e-830b0c1c647f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.158012 Jun 02 19:24:33.623426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1172/2330] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:33 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:34.466504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f36ff1e8-5d48-4e4c-9db1-f753219c28d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:34.468293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f36ff1e8-5d48-4e4c-9db1-f753219c28d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:34.478087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f36ff1e8-5d48-4e4c-9db1-f753219c28d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:34.479300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f36ff1e8-5d48-4e4c-9db1-f753219c28d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:34.480621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f36ff1e8-5d48-4e4c-9db1-f753219c28d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:34.481452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f36ff1e8-5d48-4e4c-9db1-f753219c28d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:34.623560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f36ff1e8-5d48-4e4c-9db1-f753219c28d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:34.631891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f36ff1e8-5d48-4e4c-9db1-f753219c28d2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.170137 Jun 02 19:24:34.632461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1159/2331] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:34.640242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-00407080-c5c4-46d0-b1a6-ead44faf3669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:34.640930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-00407080-c5c4-46d0-b1a6-ead44faf3669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:34.647538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00407080-c5c4-46d0-b1a6-ead44faf3669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:34.647984 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00407080-c5c4-46d0-b1a6-ead44faf3669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:34.648736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00407080-c5c4-46d0-b1a6-ead44faf3669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:34.649167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00407080-c5c4-46d0-b1a6-ead44faf3669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:34.653151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:34.789556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-00407080-c5c4-46d0-b1a6-ead44faf3669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:34.798191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-00407080-c5c4-46d0-b1a6-ead44faf3669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161811 Jun 02 19:24:34.798778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1173/2332] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:34 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:35.650811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d675e378-6360-4591-bf67-059c7b2eb4fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:35.651446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d675e378-6360-4591-bf67-059c7b2eb4fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:35.653821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:35.660226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d675e378-6360-4591-bf67-059c7b2eb4fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:35.661021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d675e378-6360-4591-bf67-059c7b2eb4fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:35.662332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d675e378-6360-4591-bf67-059c7b2eb4fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:35.663062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d675e378-6360-4591-bf67-059c7b2eb4fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:35.802185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d675e378-6360-4591-bf67-059c7b2eb4fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:35.812078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d675e378-6360-4591-bf67-059c7b2eb4fe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.165220 Jun 02 19:24:35.812662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1160/2333] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:35.815569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6568f9b9-88a1-4455-a095-9e701be096dc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:35.817526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6568f9b9-88a1-4455-a095-9e701be096dc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:35.823221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6568f9b9-88a1-4455-a095-9e701be096dc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:35.823690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6568f9b9-88a1-4455-a095-9e701be096dc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:35.824475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6568f9b9-88a1-4455-a095-9e701be096dc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:35.824919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6568f9b9-88a1-4455-a095-9e701be096dc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:35.962715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6568f9b9-88a1-4455-a095-9e701be096dc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:35.970979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6568f9b9-88a1-4455-a095-9e701be096dc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159758 Jun 02 19:24:35.971557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1174/2334] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:35 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:24:36.383361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6522a123-2786-4d5c-93d4-d4a4f7b94dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:36.383845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6522a123-2786-4d5c-93d4-d4a4f7b94dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:36.390599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6522a123-2786-4d5c-93d4-d4a4f7b94dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:36.391048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6522a123-2786-4d5c-93d4-d4a4f7b94dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:36.391809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6522a123-2786-4d5c-93d4-d4a4f7b94dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:36.392241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6522a123-2786-4d5c-93d4-d4a4f7b94dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:36.416089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6522a123-2786-4d5c-93d4-d4a4f7b94dd7 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539/ips" status: 200 len: 152 microversion: 2.20 time: 0.036685 Jun 02 19:24:36.416661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1161/2335] 10.222.0.15 () {60 vars in 1288 bytes} [Thu Jun 2 19:24:36 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 19:24:36.830551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e47c8c6d-1db8-472e-8df4-d92873d55325 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:36.831155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e47c8c6d-1db8-472e-8df4-d92873d55325 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:36.838094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e47c8c6d-1db8-472e-8df4-d92873d55325 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:36.838559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e47c8c6d-1db8-472e-8df4-d92873d55325 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:36.839334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e47c8c6d-1db8-472e-8df4-d92873d55325 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:36.839777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e47c8c6d-1db8-472e-8df4-d92873d55325 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:36.981015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e47c8c6d-1db8-472e-8df4-d92873d55325 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:36.988403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14861944-24c3-443f-ab44-406ff78d1dad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:36.988978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14861944-24c3-443f-ab44-406ff78d1dad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:36.990033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e47c8c6d-1db8-472e-8df4-d92873d55325 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.163467 Jun 02 19:24:36.990838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1175/2336] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:36.995659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14861944-24c3-443f-ab44-406ff78d1dad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:36.996097 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14861944-24c3-443f-ab44-406ff78d1dad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:36.996844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14861944-24c3-443f-ab44-406ff78d1dad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:36.997287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14861944-24c3-443f-ab44-406ff78d1dad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:37.127509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-14861944-24c3-443f-ab44-406ff78d1dad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:37.135984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14861944-24c3-443f-ab44-406ff78d1dad tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.151433 Jun 02 19:24:37.136552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1162/2337] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:36 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:24:38.007970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-274f95aa-598f-4ca0-8b81-216eda5d4df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:38.008602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-274f95aa-598f-4ca0-8b81-216eda5d4df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:38.015841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-274f95aa-598f-4ca0-8b81-216eda5d4df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:38.016299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-274f95aa-598f-4ca0-8b81-216eda5d4df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:38.017070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-274f95aa-598f-4ca0-8b81-216eda5d4df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:38.017512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-274f95aa-598f-4ca0-8b81-216eda5d4df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:38.154912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-274f95aa-598f-4ca0-8b81-216eda5d4df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:38.156570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dc5fbd9a-d53a-4ca4-9f87-bfeebc7ddfd4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:38.157177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dc5fbd9a-d53a-4ca4-9f87-bfeebc7ddfd4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:38.163323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-274f95aa-598f-4ca0-8b81-216eda5d4df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.159277 Jun 02 19:24:38.163908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1176/2338] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:38.164183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc5fbd9a-d53a-4ca4-9f87-bfeebc7ddfd4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:38.164467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc5fbd9a-d53a-4ca4-9f87-bfeebc7ddfd4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:38.165233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc5fbd9a-d53a-4ca4-9f87-bfeebc7ddfd4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:38.165658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc5fbd9a-d53a-4ca4-9f87-bfeebc7ddfd4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:38.299440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dc5fbd9a-d53a-4ca4-9f87-bfeebc7ddfd4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:38.307519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dc5fbd9a-d53a-4ca4-9f87-bfeebc7ddfd4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.155085 Jun 02 19:24:38.308053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1163/2339] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:38 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:39.180858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-22863658-e317-4e3c-8f54-22352431fd07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:39.181486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-22863658-e317-4e3c-8f54-22352431fd07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:39.188856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22863658-e317-4e3c-8f54-22352431fd07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:39.189313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22863658-e317-4e3c-8f54-22352431fd07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:39.190184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22863658-e317-4e3c-8f54-22352431fd07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:39.190557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22863658-e317-4e3c-8f54-22352431fd07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:39.320988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-22863658-e317-4e3c-8f54-22352431fd07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:39.325133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1000533a-7b75-488e-bea1-dfd132d5b065 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:39.326365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1000533a-7b75-488e-bea1-dfd132d5b065 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:39.329580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-22863658-e317-4e3c-8f54-22352431fd07 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.152711 Jun 02 19:24:39.330194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1177/2340] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:39.333267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1000533a-7b75-488e-bea1-dfd132d5b065 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:39.333716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1000533a-7b75-488e-bea1-dfd132d5b065 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:39.334666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1000533a-7b75-488e-bea1-dfd132d5b065 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:39.335395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1000533a-7b75-488e-bea1-dfd132d5b065 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:39.468927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1000533a-7b75-488e-bea1-dfd132d5b065 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:39.477360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1000533a-7b75-488e-bea1-dfd132d5b065 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156241 Jun 02 19:24:39.477966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1164/2341] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:39 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:40.348519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15e0e5bf-7bb1-4bc1-a678-a7e362a0c54e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:40.349190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-15e0e5bf-7bb1-4bc1-a678-a7e362a0c54e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:40.356606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e0e5bf-7bb1-4bc1-a678-a7e362a0c54e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:40.357065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e0e5bf-7bb1-4bc1-a678-a7e362a0c54e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:40.357909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e0e5bf-7bb1-4bc1-a678-a7e362a0c54e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:40.358425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e0e5bf-7bb1-4bc1-a678-a7e362a0c54e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:40.496189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ed2b4adb-b3df-46dd-a76b-f7b5cab9123c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:40.496791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ed2b4adb-b3df-46dd-a76b-f7b5cab9123c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:40.499985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-15e0e5bf-7bb1-4bc1-a678-a7e362a0c54e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:40.503644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed2b4adb-b3df-46dd-a76b-f7b5cab9123c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:40.504189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed2b4adb-b3df-46dd-a76b-f7b5cab9123c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:40.505015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed2b4adb-b3df-46dd-a76b-f7b5cab9123c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:40.505519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed2b4adb-b3df-46dd-a76b-f7b5cab9123c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:40.508312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15e0e5bf-7bb1-4bc1-a678-a7e362a0c54e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.163883 Jun 02 19:24:40.508882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1178/2342] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:40.638222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ed2b4adb-b3df-46dd-a76b-f7b5cab9123c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:40.646615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ed2b4adb-b3df-46dd-a76b-f7b5cab9123c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.155345 Jun 02 19:24:40.647179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1165/2343] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:40 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:24:41.527066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b6c7624f-3818-4499-94a0-f0eec3af79f5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:41.527691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b6c7624f-3818-4499-94a0-f0eec3af79f5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:41.536456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6c7624f-3818-4499-94a0-f0eec3af79f5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:41.536456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6c7624f-3818-4499-94a0-f0eec3af79f5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:41.537623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6c7624f-3818-4499-94a0-f0eec3af79f5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:41.538332 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b6c7624f-3818-4499-94a0-f0eec3af79f5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:41.664225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-37f80cfb-8ab7-4b98-8991-743acda1e81c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:41.664835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-37f80cfb-8ab7-4b98-8991-743acda1e81c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:41.672025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37f80cfb-8ab7-4b98-8991-743acda1e81c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:41.672455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37f80cfb-8ab7-4b98-8991-743acda1e81c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:41.672666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b6c7624f-3818-4499-94a0-f0eec3af79f5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:41.673260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37f80cfb-8ab7-4b98-8991-743acda1e81c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:41.673700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37f80cfb-8ab7-4b98-8991-743acda1e81c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:41.680895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b6c7624f-3818-4499-94a0-f0eec3af79f5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.158320 Jun 02 19:24:41.681737 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1179/2344] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:41.804986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-37f80cfb-8ab7-4b98-8991-743acda1e81c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:41.813544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-37f80cfb-8ab7-4b98-8991-743acda1e81c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.153216 Jun 02 19:24:41.814109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1166/2345] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:41 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:42.699291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0aeda70e-3e63-48cf-914a-4bac56925c68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:42.699879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0aeda70e-3e63-48cf-914a-4bac56925c68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:42.707006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0aeda70e-3e63-48cf-914a-4bac56925c68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:42.707457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0aeda70e-3e63-48cf-914a-4bac56925c68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:42.708218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0aeda70e-3e63-48cf-914a-4bac56925c68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:42.708653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0aeda70e-3e63-48cf-914a-4bac56925c68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:42.831079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a0973463-f542-4ef1-aae2-1a6d3185d567 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:42.831821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a0973463-f542-4ef1-aae2-1a6d3185d567 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:42.838565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a0973463-f542-4ef1-aae2-1a6d3185d567 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:42.839010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a0973463-f542-4ef1-aae2-1a6d3185d567 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:42.839785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a0973463-f542-4ef1-aae2-1a6d3185d567 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:42.840219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a0973463-f542-4ef1-aae2-1a6d3185d567 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:42.841694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0aeda70e-3e63-48cf-914a-4bac56925c68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:42.850466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0aeda70e-3e63-48cf-914a-4bac56925c68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.155125 Jun 02 19:24:42.851013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1180/2346] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:42.970406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a0973463-f542-4ef1-aae2-1a6d3185d567 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:42.978774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a0973463-f542-4ef1-aae2-1a6d3185d567 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.151763 Jun 02 19:24:42.979325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1167/2347] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:42 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:43.868301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-03da0f2e-f09b-4f7b-9f68-e6b9bc575ae3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:43.868883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-03da0f2e-f09b-4f7b-9f68-e6b9bc575ae3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:43.875865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03da0f2e-f09b-4f7b-9f68-e6b9bc575ae3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:43.876318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03da0f2e-f09b-4f7b-9f68-e6b9bc575ae3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:43.877078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03da0f2e-f09b-4f7b-9f68-e6b9bc575ae3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:43.877513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03da0f2e-f09b-4f7b-9f68-e6b9bc575ae3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:43.996130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ed0489c2-d548-49a5-aaa8-9a72f80a4ac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:43.996748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ed0489c2-d548-49a5-aaa8-9a72f80a4ac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:44.003562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed0489c2-d548-49a5-aaa8-9a72f80a4ac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:44.004004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed0489c2-d548-49a5-aaa8-9a72f80a4ac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:44.004730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed0489c2-d548-49a5-aaa8-9a72f80a4ac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:44.005157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed0489c2-d548-49a5-aaa8-9a72f80a4ac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:44.012135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-03da0f2e-f09b-4f7b-9f68-e6b9bc575ae3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:44.020705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-03da0f2e-f09b-4f7b-9f68-e6b9bc575ae3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.156397 Jun 02 19:24:44.021361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1181/2348] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:44.136655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ed0489c2-d548-49a5-aaa8-9a72f80a4ac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:44.145154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ed0489c2-d548-49a5-aaa8-9a72f80a4ac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.152933 Jun 02 19:24:44.145729 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1168/2349] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:43 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:24:45.038934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e20b64a7-41e3-4861-90f4-4d2d8e64de1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:45.039528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e20b64a7-41e3-4861-90f4-4d2d8e64de1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:45.046586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e20b64a7-41e3-4861-90f4-4d2d8e64de1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:45.047073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e20b64a7-41e3-4861-90f4-4d2d8e64de1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:45.047830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e20b64a7-41e3-4861-90f4-4d2d8e64de1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:45.048262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e20b64a7-41e3-4861-90f4-4d2d8e64de1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:45.163019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-72e51b71-e8c0-4ccf-8b8c-8f7729d3e316 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:45.163645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-72e51b71-e8c0-4ccf-8b8c-8f7729d3e316 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:45.171640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72e51b71-e8c0-4ccf-8b8c-8f7729d3e316 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:45.172089 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72e51b71-e8c0-4ccf-8b8c-8f7729d3e316 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:45.172873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72e51b71-e8c0-4ccf-8b8c-8f7729d3e316 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:45.173304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72e51b71-e8c0-4ccf-8b8c-8f7729d3e316 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:45.183738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e20b64a7-41e3-4861-90f4-4d2d8e64de1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:45.192974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e20b64a7-41e3-4861-90f4-4d2d8e64de1e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.157995 Jun 02 19:24:45.193780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1182/2350] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:45.315922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-72e51b71-e8c0-4ccf-8b8c-8f7729d3e316 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:45.324466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-72e51b71-e8c0-4ccf-8b8c-8f7729d3e316 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165407 Jun 02 19:24:45.325047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1169/2351] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:45 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:46.210784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e23e3dff-4f88-447a-bde5-d2ac8dba42da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:46.211389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e23e3dff-4f88-447a-bde5-d2ac8dba42da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:46.218317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e23e3dff-4f88-447a-bde5-d2ac8dba42da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:46.218766 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e23e3dff-4f88-447a-bde5-d2ac8dba42da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:46.219560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e23e3dff-4f88-447a-bde5-d2ac8dba42da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:46.219990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e23e3dff-4f88-447a-bde5-d2ac8dba42da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:46.342248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3e63a078-6f0e-4b62-83e1-0bc42e36b532 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:46.342819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3e63a078-6f0e-4b62-83e1-0bc42e36b532 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:46.349735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e63a078-6f0e-4b62-83e1-0bc42e36b532 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:46.350117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e63a078-6f0e-4b62-83e1-0bc42e36b532 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:46.350886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e63a078-6f0e-4b62-83e1-0bc42e36b532 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:46.351318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e63a078-6f0e-4b62-83e1-0bc42e36b532 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:46.351475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e23e3dff-4f88-447a-bde5-d2ac8dba42da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:46.360300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e23e3dff-4f88-447a-bde5-d2ac8dba42da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.153332 Jun 02 19:24:46.361114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1183/2352] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:46.505984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3e63a078-6f0e-4b62-83e1-0bc42e36b532 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:46.514423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3e63a078-6f0e-4b62-83e1-0bc42e36b532 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.176324 Jun 02 19:24:46.515006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1170/2353] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:46 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:47.509391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a97292e9-93f1-41b7-bc9b-044ea8ab7c85 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:47.510044 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a97292e9-93f1-41b7-bc9b-044ea8ab7c85 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:47.516543 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a97292e9-93f1-41b7-bc9b-044ea8ab7c85 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:47.517142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a97292e9-93f1-41b7-bc9b-044ea8ab7c85 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:47.518011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a97292e9-93f1-41b7-bc9b-044ea8ab7c85 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:47.518622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a97292e9-93f1-41b7-bc9b-044ea8ab7c85 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:47.533258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cf54c08b-5469-490f-b324-57066661e9f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:47.534689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cf54c08b-5469-490f-b324-57066661e9f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:47.541437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf54c08b-5469-490f-b324-57066661e9f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:47.546059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf54c08b-5469-490f-b324-57066661e9f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:47.546848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf54c08b-5469-490f-b324-57066661e9f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:47.547287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cf54c08b-5469-490f-b324-57066661e9f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:47.731479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a97292e9-93f1-41b7-bc9b-044ea8ab7c85 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:47.736650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cf54c08b-5469-490f-b324-57066661e9f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:47.741029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a97292e9-93f1-41b7-bc9b-044ea8ab7c85 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.366085 Jun 02 19:24:47.741913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1184/2354] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:47.745038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cf54c08b-5469-490f-b324-57066661e9f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.216189 Jun 02 19:24:47.745587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1171/2355] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:47 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:48.760704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b1ca54fd-9c85-45ad-ba2d-ab38b9d113dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:48.762046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b1ca54fd-9c85-45ad-ba2d-ab38b9d113dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:48.765809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fc6cfd64-4a4e-4c2d-b757-459c03c23042 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:48.767376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fc6cfd64-4a4e-4c2d-b757-459c03c23042 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:48.769719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b1ca54fd-9c85-45ad-ba2d-ab38b9d113dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:48.770206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b1ca54fd-9c85-45ad-ba2d-ab38b9d113dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:48.771005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b1ca54fd-9c85-45ad-ba2d-ab38b9d113dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:48.771447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b1ca54fd-9c85-45ad-ba2d-ab38b9d113dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:48.774211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc6cfd64-4a4e-4c2d-b757-459c03c23042 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:48.774657 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc6cfd64-4a4e-4c2d-b757-459c03c23042 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:48.775426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc6cfd64-4a4e-4c2d-b757-459c03c23042 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:48.775852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc6cfd64-4a4e-4c2d-b757-459c03c23042 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:48.987484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b1ca54fd-9c85-45ad-ba2d-ab38b9d113dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:48.991210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fc6cfd64-4a4e-4c2d-b757-459c03c23042 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:48.996700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b1ca54fd-9c85-45ad-ba2d-ab38b9d113dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.240024 Jun 02 19:24:48.997277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1185/2356] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:48.999737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fc6cfd64-4a4e-4c2d-b757-459c03c23042 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.237888 Jun 02 19:24:49.000291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1172/2357] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:48 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:50.016144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-83e35565-c31a-469d-a51c-ea35811e8be2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:50.016789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-83e35565-c31a-469d-a51c-ea35811e8be2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:50.017287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1608761b-e107-4a18-9378-ca891903af30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:50.017996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1608761b-e107-4a18-9378-ca891903af30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:50.023790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83e35565-c31a-469d-a51c-ea35811e8be2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:50.024220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83e35565-c31a-469d-a51c-ea35811e8be2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:50.024913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1608761b-e107-4a18-9378-ca891903af30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:50.025083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83e35565-c31a-469d-a51c-ea35811e8be2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:50.025442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-83e35565-c31a-469d-a51c-ea35811e8be2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:50.025896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1608761b-e107-4a18-9378-ca891903af30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:50.026664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1608761b-e107-4a18-9378-ca891903af30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:50.027115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1608761b-e107-4a18-9378-ca891903af30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:50.228009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1608761b-e107-4a18-9378-ca891903af30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:50.231692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-83e35565-c31a-469d-a51c-ea35811e8be2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:50.236627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1608761b-e107-4a18-9378-ca891903af30 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.223655 Jun 02 19:24:50.237205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1173/2358] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:50 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:50.240755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-83e35565-c31a-469d-a51c-ea35811e8be2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.229432 Jun 02 19:24:50.241298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1186/2359] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:51.254477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4044e0c3-5b66-43bf-87ad-7687f2285463 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:51.255056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4044e0c3-5b66-43bf-87ad-7687f2285463 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:51.257927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-65af3d33-80a7-4d2a-b88e-5de28bac4ee1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:51.258553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-65af3d33-80a7-4d2a-b88e-5de28bac4ee1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:51.262021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4044e0c3-5b66-43bf-87ad-7687f2285463 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:51.262506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4044e0c3-5b66-43bf-87ad-7687f2285463 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:51.263740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4044e0c3-5b66-43bf-87ad-7687f2285463 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:51.264149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4044e0c3-5b66-43bf-87ad-7687f2285463 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:51.265574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-65af3d33-80a7-4d2a-b88e-5de28bac4ee1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:51.266072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-65af3d33-80a7-4d2a-b88e-5de28bac4ee1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:51.266843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-65af3d33-80a7-4d2a-b88e-5de28bac4ee1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:51.267284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-65af3d33-80a7-4d2a-b88e-5de28bac4ee1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:51.459663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4044e0c3-5b66-43bf-87ad-7687f2285463 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:51.462558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-65af3d33-80a7-4d2a-b88e-5de28bac4ee1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:51.468777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4044e0c3-5b66-43bf-87ad-7687f2285463 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.218259 Jun 02 19:24:51.469361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1174/2360] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:51 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:51.470936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-65af3d33-80a7-4d2a-b88e-5de28bac4ee1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.216885 Jun 02 19:24:51.471508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1187/2361] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:52.486880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-005d9da4-e166-4d08-98b9-675861a534c5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:52.487531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-005d9da4-e166-4d08-98b9-675861a534c5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:52.488164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eee34f9a-41e6-4fbe-a215-642f0d2ff335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:52.488784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-eee34f9a-41e6-4fbe-a215-642f0d2ff335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:52.494756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-005d9da4-e166-4d08-98b9-675861a534c5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:52.495204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-005d9da4-e166-4d08-98b9-675861a534c5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:52.495853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eee34f9a-41e6-4fbe-a215-642f0d2ff335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:52.496010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-005d9da4-e166-4d08-98b9-675861a534c5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:52.496318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eee34f9a-41e6-4fbe-a215-642f0d2ff335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:52.496488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-005d9da4-e166-4d08-98b9-675861a534c5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:52.497244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eee34f9a-41e6-4fbe-a215-642f0d2ff335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:52.497686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eee34f9a-41e6-4fbe-a215-642f0d2ff335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:52.499327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:52.725576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eee34f9a-41e6-4fbe-a215-642f0d2ff335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:52.728747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-005d9da4-e166-4d08-98b9-675861a534c5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:52.734081 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eee34f9a-41e6-4fbe-a215-642f0d2ff335 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.249723 Jun 02 19:24:52.734732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1188/2362] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:52.737676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-005d9da4-e166-4d08-98b9-675861a534c5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.254631 Jun 02 19:24:52.738223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1175/2363] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:52 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:53.756361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2dca49aa-cb28-4529-8a92-c59e9f9c8b6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:53.757372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2dca49aa-cb28-4529-8a92-c59e9f9c8b6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:53.758594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bafd4220-9d21-4d09-b3ed-03959f58d458 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:53.759590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bafd4220-9d21-4d09-b3ed-03959f58d458 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:53.766738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dca49aa-cb28-4529-8a92-c59e9f9c8b6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:53.767196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dca49aa-cb28-4529-8a92-c59e9f9c8b6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:53.767759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bafd4220-9d21-4d09-b3ed-03959f58d458 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:53.767944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dca49aa-cb28-4529-8a92-c59e9f9c8b6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:53.768207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bafd4220-9d21-4d09-b3ed-03959f58d458 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:53.768370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2dca49aa-cb28-4529-8a92-c59e9f9c8b6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:53.768955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bafd4220-9d21-4d09-b3ed-03959f58d458 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:53.769377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bafd4220-9d21-4d09-b3ed-03959f58d458 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:53.963831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2dca49aa-cb28-4529-8a92-c59e9f9c8b6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:53.967234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bafd4220-9d21-4d09-b3ed-03959f58d458 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:53.967509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:53.973182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2dca49aa-cb28-4529-8a92-c59e9f9c8b6f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.223935 Jun 02 19:24:53.973736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1189/2364] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:53.976639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bafd4220-9d21-4d09-b3ed-03959f58d458 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.223309 Jun 02 19:24:53.976639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1176/2365] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:53 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:54.992153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fe7a1ba7-c12c-4867-a5ef-2e73e8dcb787 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:54.992752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fe7a1ba7-c12c-4867-a5ef-2e73e8dcb787 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:54.993939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-11f1955e-7a2a-40f8-865a-cfd6a2653d23 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:54.994568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-11f1955e-7a2a-40f8-865a-cfd6a2653d23 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:55.000250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe7a1ba7-c12c-4867-a5ef-2e73e8dcb787 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:55.000672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe7a1ba7-c12c-4867-a5ef-2e73e8dcb787 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:55.001482 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe7a1ba7-c12c-4867-a5ef-2e73e8dcb787 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:55.001948 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe7a1ba7-c12c-4867-a5ef-2e73e8dcb787 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:55.002396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11f1955e-7a2a-40f8-865a-cfd6a2653d23 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:55.002831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11f1955e-7a2a-40f8-865a-cfd6a2653d23 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:55.003612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11f1955e-7a2a-40f8-865a-cfd6a2653d23 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:55.004051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11f1955e-7a2a-40f8-865a-cfd6a2653d23 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:55.193255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fe7a1ba7-c12c-4867-a5ef-2e73e8dcb787 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:55.196825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-11f1955e-7a2a-40f8-865a-cfd6a2653d23 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:55.201892 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fe7a1ba7-c12c-4867-a5ef-2e73e8dcb787 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.214089 Jun 02 19:24:55.202410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1190/2366] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:55.205363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-11f1955e-7a2a-40f8-865a-cfd6a2653d23 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.215429 Jun 02 19:24:55.206061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1177/2367] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:54 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:56.220072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e106d047-f260-4e41-af8a-f34afe6fa613 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:56.220670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e106d047-f260-4e41-af8a-f34afe6fa613 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:56.222498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ab01dc4c-2589-4452-bde7-17f76fc2fc6b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:56.223107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ab01dc4c-2589-4452-bde7-17f76fc2fc6b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:56.227888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e106d047-f260-4e41-af8a-f34afe6fa613 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:56.228346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e106d047-f260-4e41-af8a-f34afe6fa613 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:56.229124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e106d047-f260-4e41-af8a-f34afe6fa613 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:56.229562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e106d047-f260-4e41-af8a-f34afe6fa613 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:56.229718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab01dc4c-2589-4452-bde7-17f76fc2fc6b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:56.230146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab01dc4c-2589-4452-bde7-17f76fc2fc6b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:56.230884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab01dc4c-2589-4452-bde7-17f76fc2fc6b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:56.231305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab01dc4c-2589-4452-bde7-17f76fc2fc6b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:56.424894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e106d047-f260-4e41-af8a-f34afe6fa613 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:56.428158 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ab01dc4c-2589-4452-bde7-17f76fc2fc6b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:56.433537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e106d047-f260-4e41-af8a-f34afe6fa613 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.217420 Jun 02 19:24:56.434250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1191/2368] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:56.436628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ab01dc4c-2589-4452-bde7-17f76fc2fc6b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.217912 Jun 02 19:24:56.437200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1178/2369] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:56 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:57.451600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-143d64c1-f460-4119-8f4a-83e0b11449c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:57.452229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-143d64c1-f460-4119-8f4a-83e0b11449c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:57.454517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd7b9dc5-dbe2-46ce-976d-c18728ef9b7d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:57.454972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bd7b9dc5-dbe2-46ce-976d-c18728ef9b7d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:57.459359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-143d64c1-f460-4119-8f4a-83e0b11449c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:57.459818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-143d64c1-f460-4119-8f4a-83e0b11449c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:57.460904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-143d64c1-f460-4119-8f4a-83e0b11449c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:57.461347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-143d64c1-f460-4119-8f4a-83e0b11449c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:57.461916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd7b9dc5-dbe2-46ce-976d-c18728ef9b7d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:57.462366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd7b9dc5-dbe2-46ce-976d-c18728ef9b7d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:57.463129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd7b9dc5-dbe2-46ce-976d-c18728ef9b7d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:57.463558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd7b9dc5-dbe2-46ce-976d-c18728ef9b7d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:57.654805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-143d64c1-f460-4119-8f4a-83e0b11449c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:57.657561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bd7b9dc5-dbe2-46ce-976d-c18728ef9b7d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:57.665674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-143d64c1-f460-4119-8f4a-83e0b11449c3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.217975 Jun 02 19:24:57.666034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bd7b9dc5-dbe2-46ce-976d-c18728ef9b7d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.215413 Jun 02 19:24:57.666270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1192/2370] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:57.666583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1179/2371] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:57 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:58.683269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92491478-7c04-45eb-bf2c-b52b39be4e79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:58.683905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-905349a4-a244-4d9e-a859-8cf0ec1f55c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:58.684282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92491478-7c04-45eb-bf2c-b52b39be4e79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:58.684391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-905349a4-a244-4d9e-a859-8cf0ec1f55c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:58.691291 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92491478-7c04-45eb-bf2c-b52b39be4e79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:58.691541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-905349a4-a244-4d9e-a859-8cf0ec1f55c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:58.691760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92491478-7c04-45eb-bf2c-b52b39be4e79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:58.691926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-905349a4-a244-4d9e-a859-8cf0ec1f55c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:58.692576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92491478-7c04-45eb-bf2c-b52b39be4e79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:58.692722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-905349a4-a244-4d9e-a859-8cf0ec1f55c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:58.693088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-905349a4-a244-4d9e-a859-8cf0ec1f55c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:58.693365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92491478-7c04-45eb-bf2c-b52b39be4e79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:58.887676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-905349a4-a244-4d9e-a859-8cf0ec1f55c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:58.890394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92491478-7c04-45eb-bf2c-b52b39be4e79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:24:58.896156 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-905349a4-a244-4d9e-a859-8cf0ec1f55c0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.216649 Jun 02 19:24:58.896817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1180/2372] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:58 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:58.899102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92491478-7c04-45eb-bf2c-b52b39be4e79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.219787 Jun 02 19:24:58.899670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1193/2373] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:24:59.914490 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ee6f9cab-32e2-4682-ad31-8a022e116759 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:59.915072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ee6f9cab-32e2-4682-ad31-8a022e116759 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:59.916817 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a7cb784c-4fae-4efe-a610-f12d3f391d53 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:24:59.917255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a7cb784c-4fae-4efe-a610-f12d3f391d53 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:24:59.921470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee6f9cab-32e2-4682-ad31-8a022e116759 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:59.921960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee6f9cab-32e2-4682-ad31-8a022e116759 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:59.922713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee6f9cab-32e2-4682-ad31-8a022e116759 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:59.923143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee6f9cab-32e2-4682-ad31-8a022e116759 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:59.924234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7cb784c-4fae-4efe-a610-f12d3f391d53 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:59.924721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7cb784c-4fae-4efe-a610-f12d3f391d53 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:24:59.925488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7cb784c-4fae-4efe-a610-f12d3f391d53 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:24:59.925966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7cb784c-4fae-4efe-a610-f12d3f391d53 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:00.335601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ee6f9cab-32e2-4682-ad31-8a022e116759 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:00.340005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a7cb784c-4fae-4efe-a610-f12d3f391d53 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:00.344016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ee6f9cab-32e2-4682-ad31-8a022e116759 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.433592 Jun 02 19:25:00.344644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1181/2374] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:59 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:00.348393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a7cb784c-4fae-4efe-a610-f12d3f391d53 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.435752 Jun 02 19:25:00.348925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1194/2375] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:24:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:01.362236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5141aa0b-ec9d-4969-880a-37d0992a56c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:01.362809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5141aa0b-ec9d-4969-880a-37d0992a56c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:01.365592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-00469ba4-4e87-4565-b9aa-06b6f598efd1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:01.366235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-00469ba4-4e87-4565-b9aa-06b6f598efd1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:01.368578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=50 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:01.369703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5141aa0b-ec9d-4969-880a-37d0992a56c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:01.370210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5141aa0b-ec9d-4969-880a-37d0992a56c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:01.371020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5141aa0b-ec9d-4969-880a-37d0992a56c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:01.371445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5141aa0b-ec9d-4969-880a-37d0992a56c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:01.373769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00469ba4-4e87-4565-b9aa-06b6f598efd1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:01.374252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00469ba4-4e87-4565-b9aa-06b6f598efd1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:01.375015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00469ba4-4e87-4565-b9aa-06b6f598efd1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:01.375459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00469ba4-4e87-4565-b9aa-06b6f598efd1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:01.569602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5141aa0b-ec9d-4969-880a-37d0992a56c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:01.572679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-00469ba4-4e87-4565-b9aa-06b6f598efd1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:01.578181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5141aa0b-ec9d-4969-880a-37d0992a56c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.219984 Jun 02 19:25:01.578757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1182/2376] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:01 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:01.582196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-00469ba4-4e87-4565-b9aa-06b6f598efd1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.220362 Jun 02 19:25:01.582794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1195/2377] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:02.596115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5942fb61-6c52-435c-a884-39da2fecc77b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:02.596748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5942fb61-6c52-435c-a884-39da2fecc77b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:02.600110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4f2e8428-f5f7-465d-ba21-ca04ca62f589 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:02.600735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4f2e8428-f5f7-465d-ba21-ca04ca62f589 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:02.603873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5942fb61-6c52-435c-a884-39da2fecc77b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:02.604326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5942fb61-6c52-435c-a884-39da2fecc77b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:02.605091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5942fb61-6c52-435c-a884-39da2fecc77b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:02.605527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5942fb61-6c52-435c-a884-39da2fecc77b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:02.607991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f2e8428-f5f7-465d-ba21-ca04ca62f589 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:02.608449 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f2e8428-f5f7-465d-ba21-ca04ca62f589 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:02.609232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f2e8428-f5f7-465d-ba21-ca04ca62f589 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:02.609678 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4f2e8428-f5f7-465d-ba21-ca04ca62f589 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:02.803185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5942fb61-6c52-435c-a884-39da2fecc77b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:02.806364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4f2e8428-f5f7-465d-ba21-ca04ca62f589 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:02.812217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5942fb61-6c52-435c-a884-39da2fecc77b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.220251 Jun 02 19:25:02.813240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1183/2378] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:02 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:02.814827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4f2e8428-f5f7-465d-ba21-ca04ca62f589 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.218591 Jun 02 19:25:02.815372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1196/2379] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:03.831759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a5833844-0257-475b-bd44-e0a58be09856 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:03.832352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a5833844-0257-475b-bd44-e0a58be09856 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:03.832472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ce7c7f0d-720c-4af0-a260-07cb66083c11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:03.832941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ce7c7f0d-720c-4af0-a260-07cb66083c11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:03.839475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5833844-0257-475b-bd44-e0a58be09856 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:03.839840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce7c7f0d-720c-4af0-a260-07cb66083c11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:03.840061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5833844-0257-475b-bd44-e0a58be09856 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:03.840337 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce7c7f0d-720c-4af0-a260-07cb66083c11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:03.840959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5833844-0257-475b-bd44-e0a58be09856 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:03.841115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce7c7f0d-720c-4af0-a260-07cb66083c11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:03.841555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5833844-0257-475b-bd44-e0a58be09856 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:03.841700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ce7c7f0d-720c-4af0-a260-07cb66083c11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:04.037398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ce7c7f0d-720c-4af0-a260-07cb66083c11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:04.040245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a5833844-0257-475b-bd44-e0a58be09856 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:04.046870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ce7c7f0d-720c-4af0-a260-07cb66083c11 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.218621 Jun 02 19:25:04.047514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1197/2380] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:25:04.049595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a5833844-0257-475b-bd44-e0a58be09856 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.222226 Jun 02 19:25:04.050238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1184/2381] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:03 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:05.065008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5285215b-24be-4c17-93a6-46101438c002 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:05.065614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5285215b-24be-4c17-93a6-46101438c002 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:05.066628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef8eb820-377e-46b5-8046-1a308162452b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:05.067247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef8eb820-377e-46b5-8046-1a308162452b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:05.072227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5285215b-24be-4c17-93a6-46101438c002 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:05.072683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5285215b-24be-4c17-93a6-46101438c002 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:05.073458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5285215b-24be-4c17-93a6-46101438c002 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:05.073935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5285215b-24be-4c17-93a6-46101438c002 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:05.074222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef8eb820-377e-46b5-8046-1a308162452b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:05.074866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef8eb820-377e-46b5-8046-1a308162452b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:05.075477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef8eb820-377e-46b5-8046-1a308162452b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:05.075915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef8eb820-377e-46b5-8046-1a308162452b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:05.276964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5285215b-24be-4c17-93a6-46101438c002 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:05.284655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef8eb820-377e-46b5-8046-1a308162452b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:05.285709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5285215b-24be-4c17-93a6-46101438c002 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.224946 Jun 02 19:25:05.286590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1198/2382] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:05.293541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef8eb820-377e-46b5-8046-1a308162452b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.231114 Jun 02 19:25:05.294176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1185/2383] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:05 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:06.303650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ef2c86eb-afe0-49d5-a3ea-db4021c26ff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:06.304307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ef2c86eb-afe0-49d5-a3ea-db4021c26ff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:06.311587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5eaf930e-49be-4f37-a1d6-7051bd9a2dea tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:06.312209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef2c86eb-afe0-49d5-a3ea-db4021c26ff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:06.312209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef2c86eb-afe0-49d5-a3ea-db4021c26ff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:06.312786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5eaf930e-49be-4f37-a1d6-7051bd9a2dea tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:06.313194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef2c86eb-afe0-49d5-a3ea-db4021c26ff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:06.313639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ef2c86eb-afe0-49d5-a3ea-db4021c26ff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:06.315026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:06.320933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5eaf930e-49be-4f37-a1d6-7051bd9a2dea tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:06.321404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5eaf930e-49be-4f37-a1d6-7051bd9a2dea tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:06.322215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5eaf930e-49be-4f37-a1d6-7051bd9a2dea tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:06.322649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5eaf930e-49be-4f37-a1d6-7051bd9a2dea tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:06.513414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ef2c86eb-afe0-49d5-a3ea-db4021c26ff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:06.516408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5eaf930e-49be-4f37-a1d6-7051bd9a2dea tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:06.523731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ef2c86eb-afe0-49d5-a3ea-db4021c26ff0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.224027 Jun 02 19:25:06.525708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5eaf930e-49be-4f37-a1d6-7051bd9a2dea tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.217866 Jun 02 19:25:06.526039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1199/2384] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:06.526280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1186/2385] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:06 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:07.541551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-337a1465-82f1-4d56-a525-7788f4c827a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:07.542205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-337a1465-82f1-4d56-a525-7788f4c827a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:07.543610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8eefc619-0370-45da-a273-f0a93d65cf0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:07.544233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8eefc619-0370-45da-a273-f0a93d65cf0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:07.549234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-337a1465-82f1-4d56-a525-7788f4c827a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:07.549674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-337a1465-82f1-4d56-a525-7788f4c827a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:07.550501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-337a1465-82f1-4d56-a525-7788f4c827a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:07.550941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-337a1465-82f1-4d56-a525-7788f4c827a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:07.551111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8eefc619-0370-45da-a273-f0a93d65cf0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:07.551527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8eefc619-0370-45da-a273-f0a93d65cf0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:07.552281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8eefc619-0370-45da-a273-f0a93d65cf0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:07.552706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8eefc619-0370-45da-a273-f0a93d65cf0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:07.752338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-337a1465-82f1-4d56-a525-7788f4c827a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:07.761591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-337a1465-82f1-4d56-a525-7788f4c827a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.223821 Jun 02 19:25:07.762797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1200/2386] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:07.763814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8eefc619-0370-45da-a273-f0a93d65cf0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:07.771990 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8eefc619-0370-45da-a273-f0a93d65cf0f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.232594 Jun 02 19:25:07.772543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1187/2387] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:07 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:08.786476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d5511988-0343-405f-a465-279946bc54aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:08.787120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d5511988-0343-405f-a465-279946bc54aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:08.794526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-06b9c49d-df37-4d18-b679-64b52a462ecd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:08.795393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d5511988-0343-405f-a465-279946bc54aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:08.795841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d5511988-0343-405f-a465-279946bc54aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:08.795993 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-06b9c49d-df37-4d18-b679-64b52a462ecd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:08.796624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d5511988-0343-405f-a465-279946bc54aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:08.797069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d5511988-0343-405f-a465-279946bc54aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:08.807165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06b9c49d-df37-4d18-b679-64b52a462ecd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:08.808110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06b9c49d-df37-4d18-b679-64b52a462ecd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:08.809130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06b9c49d-df37-4d18-b679-64b52a462ecd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:08.809631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06b9c49d-df37-4d18-b679-64b52a462ecd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:09.013349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d5511988-0343-405f-a465-279946bc54aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:09.017620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06b9c49d-df37-4d18-b679-64b52a462ecd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:09.024827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d5511988-0343-405f-a465-279946bc54aa tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.245063 Jun 02 19:25:09.026237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1201/2388] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:09.029103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-06b9c49d-df37-4d18-b679-64b52a462ecd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.241773 Jun 02 19:25:09.029694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1188/2389] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:08 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:10.044335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2851b85f-d1e5-47a6-98ad-41b543e47f79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:10.044972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2851b85f-d1e5-47a6-98ad-41b543e47f79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:10.047220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-44416f6e-2a23-40a3-9f7b-81e1d4bf85a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:10.047828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-44416f6e-2a23-40a3-9f7b-81e1d4bf85a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:10.052366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2851b85f-d1e5-47a6-98ad-41b543e47f79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:10.052826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2851b85f-d1e5-47a6-98ad-41b543e47f79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:10.053609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2851b85f-d1e5-47a6-98ad-41b543e47f79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:10.054082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2851b85f-d1e5-47a6-98ad-41b543e47f79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:10.055049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44416f6e-2a23-40a3-9f7b-81e1d4bf85a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:10.055500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44416f6e-2a23-40a3-9f7b-81e1d4bf85a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:10.056326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44416f6e-2a23-40a3-9f7b-81e1d4bf85a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:10.056759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44416f6e-2a23-40a3-9f7b-81e1d4bf85a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:10.256841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2851b85f-d1e5-47a6-98ad-41b543e47f79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:10.264202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-44416f6e-2a23-40a3-9f7b-81e1d4bf85a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:10.267286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2851b85f-d1e5-47a6-98ad-41b543e47f79 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.227886 Jun 02 19:25:10.267889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1202/2390] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:10.273014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-44416f6e-2a23-40a3-9f7b-81e1d4bf85a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.230349 Jun 02 19:25:10.273767 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1189/2391] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:10 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:11.285193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4c21107b-9a93-4340-ae28-5a982d1ec9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:11.285775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4c21107b-9a93-4340-ae28-5a982d1ec9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:11.291385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bab6dd46-f67e-4da7-9e4c-c3176ccf055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:11.292266 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bab6dd46-f67e-4da7-9e4c-c3176ccf055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:11.293034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4c21107b-9a93-4340-ae28-5a982d1ec9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:11.293696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4c21107b-9a93-4340-ae28-5a982d1ec9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:11.294710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4c21107b-9a93-4340-ae28-5a982d1ec9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:11.295154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4c21107b-9a93-4340-ae28-5a982d1ec9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:11.300509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bab6dd46-f67e-4da7-9e4c-c3176ccf055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:11.300956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bab6dd46-f67e-4da7-9e4c-c3176ccf055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:11.301735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bab6dd46-f67e-4da7-9e4c-c3176ccf055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:11.302205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bab6dd46-f67e-4da7-9e4c-c3176ccf055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:11.507002 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4c21107b-9a93-4340-ae28-5a982d1ec9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:11.515495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4c21107b-9a93-4340-ae28-5a982d1ec9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.234384 Jun 02 19:25:11.516302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1203/2392] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:11.520252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bab6dd46-f67e-4da7-9e4c-c3176ccf055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:11.535608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bab6dd46-f67e-4da7-9e4c-c3176ccf055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.247750 Jun 02 19:25:11.535979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1190/2393] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:11 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:12.532984 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5a4547c6-6e39-48f7-ba76-aca05e6d5d58 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:12.533586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5a4547c6-6e39-48f7-ba76-aca05e6d5d58 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:12.540949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a4547c6-6e39-48f7-ba76-aca05e6d5d58 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:12.541412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a4547c6-6e39-48f7-ba76-aca05e6d5d58 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:12.542235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a4547c6-6e39-48f7-ba76-aca05e6d5d58 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:12.542696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a4547c6-6e39-48f7-ba76-aca05e6d5d58 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:12.552696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea62afc7-5f1a-4fbd-8c9c-394ee6eb3912 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:12.553308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ea62afc7-5f1a-4fbd-8c9c-394ee6eb3912 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:12.561121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea62afc7-5f1a-4fbd-8c9c-394ee6eb3912 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:12.561550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea62afc7-5f1a-4fbd-8c9c-394ee6eb3912 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:12.562715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea62afc7-5f1a-4fbd-8c9c-394ee6eb3912 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:12.563180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea62afc7-5f1a-4fbd-8c9c-394ee6eb3912 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:12.752043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5a4547c6-6e39-48f7-ba76-aca05e6d5d58 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:12.761485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5a4547c6-6e39-48f7-ba76-aca05e6d5d58 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.232329 Jun 02 19:25:12.761702 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ea62afc7-5f1a-4fbd-8c9c-394ee6eb3912 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:12.762091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1204/2394] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:12.763892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:12.770862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ea62afc7-5f1a-4fbd-8c9c-394ee6eb3912 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.221969 Jun 02 19:25:12.771463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1191/2395] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:12 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:13.781917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c96b61a0-414c-470f-870d-2bdd8d98ebb2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:13.782551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c96b61a0-414c-470f-870d-2bdd8d98ebb2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:13.789523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-76dd25a7-efba-4a1d-a0e8-7800a3502757 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:13.790181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-76dd25a7-efba-4a1d-a0e8-7800a3502757 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:13.790663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c96b61a0-414c-470f-870d-2bdd8d98ebb2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:13.791116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c96b61a0-414c-470f-870d-2bdd8d98ebb2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:13.791885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c96b61a0-414c-470f-870d-2bdd8d98ebb2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:13.792319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c96b61a0-414c-470f-870d-2bdd8d98ebb2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:13.797265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76dd25a7-efba-4a1d-a0e8-7800a3502757 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:13.797711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76dd25a7-efba-4a1d-a0e8-7800a3502757 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:13.798513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76dd25a7-efba-4a1d-a0e8-7800a3502757 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:13.798943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76dd25a7-efba-4a1d-a0e8-7800a3502757 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:13.998552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c96b61a0-414c-470f-870d-2bdd8d98ebb2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:14.001918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-76dd25a7-efba-4a1d-a0e8-7800a3502757 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:14.008341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c96b61a0-414c-470f-870d-2bdd8d98ebb2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.232455 Jun 02 19:25:14.009050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1205/2396] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:14.011673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-76dd25a7-efba-4a1d-a0e8-7800a3502757 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.226071 Jun 02 19:25:14.012317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1192/2397] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:13 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:15.026803 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-be17c42f-d4da-416b-a4e2-765f52adcc9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:15.027497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-be17c42f-d4da-416b-a4e2-765f52adcc9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:15.029249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-34e3d6e2-9a7c-46fa-9d93-931737160949 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:15.029862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-34e3d6e2-9a7c-46fa-9d93-931737160949 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:15.034464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be17c42f-d4da-416b-a4e2-765f52adcc9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:15.034921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be17c42f-d4da-416b-a4e2-765f52adcc9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:15.035708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be17c42f-d4da-416b-a4e2-765f52adcc9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:15.036152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be17c42f-d4da-416b-a4e2-765f52adcc9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:15.036663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34e3d6e2-9a7c-46fa-9d93-931737160949 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:15.037113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34e3d6e2-9a7c-46fa-9d93-931737160949 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:15.037907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34e3d6e2-9a7c-46fa-9d93-931737160949 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:15.038337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34e3d6e2-9a7c-46fa-9d93-931737160949 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:15.056582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:15.242129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-be17c42f-d4da-416b-a4e2-765f52adcc9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:15.248920 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-34e3d6e2-9a7c-46fa-9d93-931737160949 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:15.252857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-be17c42f-d4da-416b-a4e2-765f52adcc9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.229783 Jun 02 19:25:15.253625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1206/2398] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:15.257446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-34e3d6e2-9a7c-46fa-9d93-931737160949 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.232071 Jun 02 19:25:15.258006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1193/2399] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:15 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:25:16.271946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-02bdf601-8ba4-49cb-a05b-776c26b95793 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:16.272653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-02bdf601-8ba4-49cb-a05b-776c26b95793 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:16.274744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-245fe741-493d-4e6b-99a2-6eef7826ccf7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:16.275358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-245fe741-493d-4e6b-99a2-6eef7826ccf7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:16.279657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02bdf601-8ba4-49cb-a05b-776c26b95793 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:16.280112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02bdf601-8ba4-49cb-a05b-776c26b95793 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:16.280878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02bdf601-8ba4-49cb-a05b-776c26b95793 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:16.281313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-02bdf601-8ba4-49cb-a05b-776c26b95793 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:16.282983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-245fe741-493d-4e6b-99a2-6eef7826ccf7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:16.283434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-245fe741-493d-4e6b-99a2-6eef7826ccf7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:16.284198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-245fe741-493d-4e6b-99a2-6eef7826ccf7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:16.284630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-245fe741-493d-4e6b-99a2-6eef7826ccf7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:16.491449 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-02bdf601-8ba4-49cb-a05b-776c26b95793 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:16.495464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-245fe741-493d-4e6b-99a2-6eef7826ccf7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:16.501176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-02bdf601-8ba4-49cb-a05b-776c26b95793 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.233568 Jun 02 19:25:16.506902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1207/2400] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:16.507120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-245fe741-493d-4e6b-99a2-6eef7826ccf7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.233791 Jun 02 19:25:16.507120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1194/2401] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:16 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:17.520713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-850366cd-cca3-4bd1-87bf-2bdf9cd5ea6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:17.521323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-850366cd-cca3-4bd1-87bf-2bdf9cd5ea6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:17.527989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-090906a7-80e4-463b-8570-830351f411a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:17.529005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-850366cd-cca3-4bd1-87bf-2bdf9cd5ea6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:17.529138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-090906a7-80e4-463b-8570-830351f411a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:17.529467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-850366cd-cca3-4bd1-87bf-2bdf9cd5ea6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:17.530278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-850366cd-cca3-4bd1-87bf-2bdf9cd5ea6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:17.530748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-850366cd-cca3-4bd1-87bf-2bdf9cd5ea6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:17.535978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-090906a7-80e4-463b-8570-830351f411a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:17.536433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-090906a7-80e4-463b-8570-830351f411a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:17.537207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-090906a7-80e4-463b-8570-830351f411a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:17.537640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-090906a7-80e4-463b-8570-830351f411a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:17.739697 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-850366cd-cca3-4bd1-87bf-2bdf9cd5ea6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:17.747429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-090906a7-80e4-463b-8570-830351f411a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:17.748264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-850366cd-cca3-4bd1-87bf-2bdf9cd5ea6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.231482 Jun 02 19:25:17.748921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1208/2402] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:17.756865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-090906a7-80e4-463b-8570-830351f411a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.238043 Jun 02 19:25:17.757448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1195/2403] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:17 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:18.770181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-acd57b1e-a8f6-4528-9033-20e1202a8c70 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:18.771120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-acd57b1e-a8f6-4528-9033-20e1202a8c70 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:18.779025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8b45096d-46e7-45cc-8df1-669ac3dc013c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:18.780145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8b45096d-46e7-45cc-8df1-669ac3dc013c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:18.781283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acd57b1e-a8f6-4528-9033-20e1202a8c70 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:18.781283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acd57b1e-a8f6-4528-9033-20e1202a8c70 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:18.781879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acd57b1e-a8f6-4528-9033-20e1202a8c70 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:18.782421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acd57b1e-a8f6-4528-9033-20e1202a8c70 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:18.788512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b45096d-46e7-45cc-8df1-669ac3dc013c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:18.788895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b45096d-46e7-45cc-8df1-669ac3dc013c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:18.789665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b45096d-46e7-45cc-8df1-669ac3dc013c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:18.790134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b45096d-46e7-45cc-8df1-669ac3dc013c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:18.993133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-acd57b1e-a8f6-4528-9033-20e1202a8c70 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:18.997765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8b45096d-46e7-45cc-8df1-669ac3dc013c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:19.002492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-acd57b1e-a8f6-4528-9033-20e1202a8c70 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.238721 Jun 02 19:25:19.002965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1209/2404] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:19.009610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8b45096d-46e7-45cc-8df1-669ac3dc013c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.237720 Jun 02 19:25:19.010271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1196/2405] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:18 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:20.023783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cf1598e0-83e7-4142-8914-ff0beffa7822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:20.024670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cf1598e0-83e7-4142-8914-ff0beffa7822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:20.027472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-981a297b-869a-4ea4-b3a2-a4bf0b8982d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:20.028129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-981a297b-869a-4ea4-b3a2-a4bf0b8982d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:20.032695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf1598e0-83e7-4142-8914-ff0beffa7822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:20.033158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf1598e0-83e7-4142-8914-ff0beffa7822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:20.034100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf1598e0-83e7-4142-8914-ff0beffa7822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:20.034574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf1598e0-83e7-4142-8914-ff0beffa7822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:20.035462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-981a297b-869a-4ea4-b3a2-a4bf0b8982d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:20.035891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-981a297b-869a-4ea4-b3a2-a4bf0b8982d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:20.036657 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-981a297b-869a-4ea4-b3a2-a4bf0b8982d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:20.037073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-981a297b-869a-4ea4-b3a2-a4bf0b8982d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:20.244237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cf1598e0-83e7-4142-8914-ff0beffa7822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:20.248978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-981a297b-869a-4ea4-b3a2-a4bf0b8982d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:20.254661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cf1598e0-83e7-4142-8914-ff0beffa7822 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.234697 Jun 02 19:25:20.255583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1210/2406] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:20.258560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-981a297b-869a-4ea4-b3a2-a4bf0b8982d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.234782 Jun 02 19:25:20.259339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1197/2407] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:20 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:21.274884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b50980d1-d058-444f-9c47-1d35ef9a401e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:21.275727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b50980d1-d058-444f-9c47-1d35ef9a401e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:21.279139 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2aafc442-9113-45a7-a53a-971c466ec335 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:21.279703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2aafc442-9113-45a7-a53a-971c466ec335 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:21.284088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b50980d1-d058-444f-9c47-1d35ef9a401e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:21.284552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b50980d1-d058-444f-9c47-1d35ef9a401e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:21.285330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b50980d1-d058-444f-9c47-1d35ef9a401e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:21.285775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b50980d1-d058-444f-9c47-1d35ef9a401e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:21.287822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2aafc442-9113-45a7-a53a-971c466ec335 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:21.288273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2aafc442-9113-45a7-a53a-971c466ec335 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:21.289070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2aafc442-9113-45a7-a53a-971c466ec335 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:21.289505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2aafc442-9113-45a7-a53a-971c466ec335 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:21.490638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2aafc442-9113-45a7-a53a-971c466ec335 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:21.493327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b50980d1-d058-444f-9c47-1d35ef9a401e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:21.503016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2aafc442-9113-45a7-a53a-971c466ec335 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.228965 Jun 02 19:25:21.503740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1198/2408] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:21 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:21.504609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b50980d1-d058-444f-9c47-1d35ef9a401e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.235979 Jun 02 19:25:21.505186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1211/2409] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:22.525408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4946e9b7-7c24-41d7-aaaf-a919b494124b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:22.526807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e2a3ca5-13f4-4123-9e26-173c18e17245 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:22.527264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4946e9b7-7c24-41d7-aaaf-a919b494124b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:22.527433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e2a3ca5-13f4-4123-9e26-173c18e17245 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:22.535636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e2a3ca5-13f4-4123-9e26-173c18e17245 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:22.535755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4946e9b7-7c24-41d7-aaaf-a919b494124b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:22.535912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e2a3ca5-13f4-4123-9e26-173c18e17245 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:22.536179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4946e9b7-7c24-41d7-aaaf-a919b494124b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:22.536833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e2a3ca5-13f4-4123-9e26-173c18e17245 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:22.536969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4946e9b7-7c24-41d7-aaaf-a919b494124b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:22.537354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e2a3ca5-13f4-4123-9e26-173c18e17245 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:22.537502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4946e9b7-7c24-41d7-aaaf-a919b494124b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:22.745986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5e2a3ca5-13f4-4123-9e26-173c18e17245 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:22.749145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4946e9b7-7c24-41d7-aaaf-a919b494124b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:22.754953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e2a3ca5-13f4-4123-9e26-173c18e17245 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.235595 Jun 02 19:25:22.755535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1212/2410] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:22.757812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4946e9b7-7c24-41d7-aaaf-a919b494124b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.240529 Jun 02 19:25:22.758394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1199/2411] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:22 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:23.773029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-458a955f-4cac-457e-94d2-c0ff2f09a33b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:23.773670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-458a955f-4cac-457e-94d2-c0ff2f09a33b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:23.776207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0b407a2f-1f97-460a-9915-a775b147c013 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:23.776822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0b407a2f-1f97-460a-9915-a775b147c013 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:23.780998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-458a955f-4cac-457e-94d2-c0ff2f09a33b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:23.781555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-458a955f-4cac-457e-94d2-c0ff2f09a33b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:23.782446 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-458a955f-4cac-457e-94d2-c0ff2f09a33b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:23.782910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-458a955f-4cac-457e-94d2-c0ff2f09a33b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:23.784353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b407a2f-1f97-460a-9915-a775b147c013 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:23.784809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b407a2f-1f97-460a-9915-a775b147c013 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:23.785548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b407a2f-1f97-460a-9915-a775b147c013 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:23.786128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b407a2f-1f97-460a-9915-a775b147c013 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:23.990138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-458a955f-4cac-457e-94d2-c0ff2f09a33b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:23.993350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0b407a2f-1f97-460a-9915-a775b147c013 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:24.000105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-458a955f-4cac-457e-94d2-c0ff2f09a33b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.230996 Jun 02 19:25:24.000764 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1213/2412] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:24.002584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0b407a2f-1f97-460a-9915-a775b147c013 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.230119 Jun 02 19:25:24.003325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1200/2413] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:23 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:25.018966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-58394056-4738-4c51-a046-6367212c76c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:25.019617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-58394056-4738-4c51-a046-6367212c76c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:25.019957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-758f3ff3-a1ad-46ce-854f-0c51fc6f4baf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:25.020573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-758f3ff3-a1ad-46ce-854f-0c51fc6f4baf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:25.027190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-758f3ff3-a1ad-46ce-854f-0c51fc6f4baf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:25.027642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-758f3ff3-a1ad-46ce-854f-0c51fc6f4baf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:25.027830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58394056-4738-4c51-a046-6367212c76c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:25.028302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58394056-4738-4c51-a046-6367212c76c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:25.028429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-758f3ff3-a1ad-46ce-854f-0c51fc6f4baf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:25.028814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-758f3ff3-a1ad-46ce-854f-0c51fc6f4baf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:25.029205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58394056-4738-4c51-a046-6367212c76c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:25.029707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-58394056-4738-4c51-a046-6367212c76c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:25.230821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-58394056-4738-4c51-a046-6367212c76c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:25.235192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-758f3ff3-a1ad-46ce-854f-0c51fc6f4baf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:25.240057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-58394056-4738-4c51-a046-6367212c76c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.225085 Jun 02 19:25:25.240620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1214/2414] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:25.243590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-758f3ff3-a1ad-46ce-854f-0c51fc6f4baf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.227719 Jun 02 19:25:25.244159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1201/2415] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:25 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:26.258262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ddb8f23d-cfc1-43e1-bae2-918fce35fe97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:26.258898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ddb8f23d-cfc1-43e1-bae2-918fce35fe97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:26.261138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4dc21af7-c1f0-4cb5-9eaf-4ade723f822e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:26.261746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4dc21af7-c1f0-4cb5-9eaf-4ade723f822e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:26.266027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ddb8f23d-cfc1-43e1-bae2-918fce35fe97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:26.266493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ddb8f23d-cfc1-43e1-bae2-918fce35fe97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:26.267253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ddb8f23d-cfc1-43e1-bae2-918fce35fe97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:26.267687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ddb8f23d-cfc1-43e1-bae2-918fce35fe97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:26.269234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dc21af7-c1f0-4cb5-9eaf-4ade723f822e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:26.269686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dc21af7-c1f0-4cb5-9eaf-4ade723f822e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:26.270479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dc21af7-c1f0-4cb5-9eaf-4ade723f822e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:26.270904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dc21af7-c1f0-4cb5-9eaf-4ade723f822e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:26.470624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4dc21af7-c1f0-4cb5-9eaf-4ade723f822e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:26.472776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ddb8f23d-cfc1-43e1-bae2-918fce35fe97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:26.479019 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4dc21af7-c1f0-4cb5-9eaf-4ade723f822e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.221836 Jun 02 19:25:26.479635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1202/2416] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:26 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:26.481275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ddb8f23d-cfc1-43e1-bae2-918fce35fe97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.227101 Jun 02 19:25:26.481848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1215/2417] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:27.497779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2d9f7ca8-6c76-4fd2-bcbf-bce82778142e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:27.498447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2d9f7ca8-6c76-4fd2-bcbf-bce82778142e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:27.499855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a37cdf76-0acf-434d-a192-cf983707c721 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:27.500521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a37cdf76-0acf-434d-a192-cf983707c721 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:27.507322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d9f7ca8-6c76-4fd2-bcbf-bce82778142e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:27.507792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d9f7ca8-6c76-4fd2-bcbf-bce82778142e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:27.508562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d9f7ca8-6c76-4fd2-bcbf-bce82778142e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:27.508723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a37cdf76-0acf-434d-a192-cf983707c721 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:27.508983 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d9f7ca8-6c76-4fd2-bcbf-bce82778142e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:27.509140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a37cdf76-0acf-434d-a192-cf983707c721 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:27.509891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a37cdf76-0acf-434d-a192-cf983707c721 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:27.510334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a37cdf76-0acf-434d-a192-cf983707c721 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:27.714745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2d9f7ca8-6c76-4fd2-bcbf-bce82778142e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:27.722469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a37cdf76-0acf-434d-a192-cf983707c721 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:27.724109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2d9f7ca8-6c76-4fd2-bcbf-bce82778142e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.230076 Jun 02 19:25:27.725909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1203/2418] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:27 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:27.731800 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a37cdf76-0acf-434d-a192-cf983707c721 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.235762 Jun 02 19:25:27.732862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1216/2419] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:28.743583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-288a9bbf-6144-4497-8429-81f2f54cc3c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:28.744209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-288a9bbf-6144-4497-8429-81f2f54cc3c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:28.750369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f5e767e4-80c0-4a4f-b17e-f8feae144481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:28.751118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f5e767e4-80c0-4a4f-b17e-f8feae144481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:28.751338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-288a9bbf-6144-4497-8429-81f2f54cc3c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:28.751791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-288a9bbf-6144-4497-8429-81f2f54cc3c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:28.752588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-288a9bbf-6144-4497-8429-81f2f54cc3c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:28.753021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-288a9bbf-6144-4497-8429-81f2f54cc3c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:28.757811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5e767e4-80c0-4a4f-b17e-f8feae144481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:28.758286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5e767e4-80c0-4a4f-b17e-f8feae144481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:28.759084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5e767e4-80c0-4a4f-b17e-f8feae144481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:28.759524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f5e767e4-80c0-4a4f-b17e-f8feae144481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:28.954549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-288a9bbf-6144-4497-8429-81f2f54cc3c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:28.958669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f5e767e4-80c0-4a4f-b17e-f8feae144481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:28.965657 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-288a9bbf-6144-4497-8429-81f2f54cc3c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.225954 Jun 02 19:25:28.966277 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1204/2420] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:28 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:28.968292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f5e767e4-80c0-4a4f-b17e-f8feae144481 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.221898 Jun 02 19:25:28.969276 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1217/2421] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:29.984620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e500cbf0-cd27-47aa-a6da-7eadb1ac3cdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:29.985252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e500cbf0-cd27-47aa-a6da-7eadb1ac3cdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:29.986669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-45c608fd-c52c-4599-a1eb-5551fed2a077 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:29.987285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-45c608fd-c52c-4599-a1eb-5551fed2a077 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:29.992037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e500cbf0-cd27-47aa-a6da-7eadb1ac3cdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:29.992496 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e500cbf0-cd27-47aa-a6da-7eadb1ac3cdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:29.993258 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e500cbf0-cd27-47aa-a6da-7eadb1ac3cdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:29.993691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e500cbf0-cd27-47aa-a6da-7eadb1ac3cdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:29.994299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45c608fd-c52c-4599-a1eb-5551fed2a077 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:29.994735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45c608fd-c52c-4599-a1eb-5551fed2a077 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:29.995580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45c608fd-c52c-4599-a1eb-5551fed2a077 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:29.996066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45c608fd-c52c-4599-a1eb-5551fed2a077 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:30.422894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e500cbf0-cd27-47aa-a6da-7eadb1ac3cdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:30.426394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-45c608fd-c52c-4599-a1eb-5551fed2a077 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:30.431572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e500cbf0-cd27-47aa-a6da-7eadb1ac3cdc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.451461 Jun 02 19:25:30.432136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1205/2422] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:29 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:30.435244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-45c608fd-c52c-4599-a1eb-5551fed2a077 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.452423 Jun 02 19:25:30.436121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1218/2423] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:31.450101 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-12de2201-13ae-486c-8dae-c6bcfe2b4d52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:31.450758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-12de2201-13ae-486c-8dae-c6bcfe2b4d52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:31.454027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-213dc517-ab04-4f07-85bf-f7f9be120b03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:31.454653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-213dc517-ab04-4f07-85bf-f7f9be120b03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:31.457270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=48 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:31.458146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12de2201-13ae-486c-8dae-c6bcfe2b4d52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:31.458628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12de2201-13ae-486c-8dae-c6bcfe2b4d52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:31.459590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12de2201-13ae-486c-8dae-c6bcfe2b4d52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:31.460108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12de2201-13ae-486c-8dae-c6bcfe2b4d52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:31.463234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-213dc517-ab04-4f07-85bf-f7f9be120b03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:31.463700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-213dc517-ab04-4f07-85bf-f7f9be120b03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:31.464457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-213dc517-ab04-4f07-85bf-f7f9be120b03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:31.464890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-213dc517-ab04-4f07-85bf-f7f9be120b03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:31.669509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-12de2201-13ae-486c-8dae-c6bcfe2b4d52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:31.672765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-213dc517-ab04-4f07-85bf-f7f9be120b03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:31.678966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-12de2201-13ae-486c-8dae-c6bcfe2b4d52 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.232738 Jun 02 19:25:31.679522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1206/2424] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:31 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:31.681744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-213dc517-ab04-4f07-85bf-f7f9be120b03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.231831 Jun 02 19:25:31.682331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1219/2425] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:32.697335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59c8ec9a-be58-4c48-87b3-3a023d4e8f35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:32.698032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-59c8ec9a-be58-4c48-87b3-3a023d4e8f35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:32.700266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d453714f-9b09-4d77-817c-4f5644002c26 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:32.700903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d453714f-9b09-4d77-817c-4f5644002c26 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:32.705274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59c8ec9a-be58-4c48-87b3-3a023d4e8f35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:32.705717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59c8ec9a-be58-4c48-87b3-3a023d4e8f35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:32.707137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59c8ec9a-be58-4c48-87b3-3a023d4e8f35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:32.707569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59c8ec9a-be58-4c48-87b3-3a023d4e8f35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:32.707867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d453714f-9b09-4d77-817c-4f5644002c26 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:32.708330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d453714f-9b09-4d77-817c-4f5644002c26 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:32.709097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d453714f-9b09-4d77-817c-4f5644002c26 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:32.709545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d453714f-9b09-4d77-817c-4f5644002c26 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:32.933013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-59c8ec9a-be58-4c48-87b3-3a023d4e8f35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:32.939977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-59c8ec9a-be58-4c48-87b3-3a023d4e8f35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.246327 Jun 02 19:25:32.940421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1207/2426] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:32 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:32.942983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d453714f-9b09-4d77-817c-4f5644002c26 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:32.951544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d453714f-9b09-4d77-817c-4f5644002c26 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.255428 Jun 02 19:25:32.952228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1220/2427] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:33.957678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8f4fff9c-c2bc-46fc-b573-545375440f66 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:33.958314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8f4fff9c-c2bc-46fc-b573-545375440f66 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:33.965636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f4fff9c-c2bc-46fc-b573-545375440f66 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:33.966094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f4fff9c-c2bc-46fc-b573-545375440f66 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:33.966829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f4fff9c-c2bc-46fc-b573-545375440f66 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:33.967314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f4fff9c-c2bc-46fc-b573-545375440f66 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:33.968791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2613bc8f-322a-4759-b190-32dc37b0f2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:33.969444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2613bc8f-322a-4759-b190-32dc37b0f2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:33.976492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2613bc8f-322a-4759-b190-32dc37b0f2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:33.976953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2613bc8f-322a-4759-b190-32dc37b0f2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:33.977739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2613bc8f-322a-4759-b190-32dc37b0f2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:33.978209 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2613bc8f-322a-4759-b190-32dc37b0f2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:33.984117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:34.178049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8f4fff9c-c2bc-46fc-b573-545375440f66 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:34.181725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2613bc8f-322a-4759-b190-32dc37b0f2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:34.186619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8f4fff9c-c2bc-46fc-b573-545375440f66 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.233312 Jun 02 19:25:34.188603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1208/2428] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:33 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:34.190788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2613bc8f-322a-4759-b190-32dc37b0f2df tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.225912 Jun 02 19:25:34.191374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1221/2429] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:35.208675 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ce48e63-5ea5-4c0c-b447-cc07264af5d7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:35.209274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5ce48e63-5ea5-4c0c-b447-cc07264af5d7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:35.212826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dbe54126-4ab5-4a3f-9271-9c0b40ec6629 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:35.212826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dbe54126-4ab5-4a3f-9271-9c0b40ec6629 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:35.218913 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ce48e63-5ea5-4c0c-b447-cc07264af5d7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:35.219524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbe54126-4ab5-4a3f-9271-9c0b40ec6629 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:35.219713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ce48e63-5ea5-4c0c-b447-cc07264af5d7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:35.219980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbe54126-4ab5-4a3f-9271-9c0b40ec6629 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:35.220288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ce48e63-5ea5-4c0c-b447-cc07264af5d7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:35.220717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ce48e63-5ea5-4c0c-b447-cc07264af5d7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:35.220871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbe54126-4ab5-4a3f-9271-9c0b40ec6629 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:35.221183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbe54126-4ab5-4a3f-9271-9c0b40ec6629 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:35.458541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dbe54126-4ab5-4a3f-9271-9c0b40ec6629 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:35.467419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dbe54126-4ab5-4a3f-9271-9c0b40ec6629 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.259294 Jun 02 19:25:35.468225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1222/2430] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:25:35.473343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ce48e63-5ea5-4c0c-b447-cc07264af5d7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:35.488387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ce48e63-5ea5-4c0c-b447-cc07264af5d7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.283373 Jun 02 19:25:35.489417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1209/2431] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:35 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:36.487212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1e0f5b73-5331-4e24-be3e-99eb91a9b1a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:36.487808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1e0f5b73-5331-4e24-be3e-99eb91a9b1a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:36.495811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e0f5b73-5331-4e24-be3e-99eb91a9b1a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:36.496343 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e0f5b73-5331-4e24-be3e-99eb91a9b1a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:36.496709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f48b676d-e108-4ede-ad44-ef72018813d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:36.497205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f48b676d-e108-4ede-ad44-ef72018813d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:36.497375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e0f5b73-5331-4e24-be3e-99eb91a9b1a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:36.498005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e0f5b73-5331-4e24-be3e-99eb91a9b1a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:36.499831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=48 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:36.504988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:36.505628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f48b676d-e108-4ede-ad44-ef72018813d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:36.506134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f48b676d-e108-4ede-ad44-ef72018813d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:36.506956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f48b676d-e108-4ede-ad44-ef72018813d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:36.507466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f48b676d-e108-4ede-ad44-ef72018813d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:36.539628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f48b676d-e108-4ede-ad44-ef72018813d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:25:36.633754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f48b676d-e108-4ede-ad44-ef72018813d6 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "DELETE /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 204 len: 0 microversion: 2.20 time: 0.141675 Jun 02 19:25:36.634333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1210/2432] 10.222.0.15 () {60 vars in 1279 bytes} [Thu Jun 2 19:25:36 2022] DELETE /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 19:25:36.643103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-61888c8d-16e6-4418-97eb-8c0dcd81f9ab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:36.643802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-61888c8d-16e6-4418-97eb-8c0dcd81f9ab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:36.649830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61888c8d-16e6-4418-97eb-8c0dcd81f9ab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:36.650278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61888c8d-16e6-4418-97eb-8c0dcd81f9ab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:36.651018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61888c8d-16e6-4418-97eb-8c0dcd81f9ab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:36.651459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61888c8d-16e6-4418-97eb-8c0dcd81f9ab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:36.661541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1e0f5b73-5331-4e24-be3e-99eb91a9b1a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:36.673144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1e0f5b73-5331-4e24-be3e-99eb91a9b1a4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.191556 Jun 02 19:25:36.673978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1223/2433] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:36.678315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:36.678933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:36.688505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:36.688969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:36.689768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:36.690253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:36.853054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-61888c8d-16e6-4418-97eb-8c0dcd81f9ab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:36.862209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-61888c8d-16e6-4418-97eb-8c0dcd81f9ab tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.226563 Jun 02 19:25:36.862765 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1211/2434] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:36 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:36.878634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:36.886968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:36.888463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:36.889653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-28a5e63d-da49-44bc-b589-b05390f83c73 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1723 microversion: 2.20 time: 0.214979 Jun 02 19:25:36.890285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1224/2435] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:25:36 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:25:37.691518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-317feb05-4e65-4a9f-94e1-5bc6de868611 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:37.692203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-317feb05-4e65-4a9f-94e1-5bc6de868611 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:37.699757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-317feb05-4e65-4a9f-94e1-5bc6de868611 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:37.700319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-317feb05-4e65-4a9f-94e1-5bc6de868611 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:37.701426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-317feb05-4e65-4a9f-94e1-5bc6de868611 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:37.702099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-317feb05-4e65-4a9f-94e1-5bc6de868611 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:37.846918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-317feb05-4e65-4a9f-94e1-5bc6de868611 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:37.855856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-317feb05-4e65-4a9f-94e1-5bc6de868611 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.168668 Jun 02 19:25:37.856418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1212/2436] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:37.880182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f6bf0fdc-0665-4661-bab8-0ff6bd296ab2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:37.880782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f6bf0fdc-0665-4661-bab8-0ff6bd296ab2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:37.887900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6bf0fdc-0665-4661-bab8-0ff6bd296ab2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:37.888351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6bf0fdc-0665-4661-bab8-0ff6bd296ab2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:37.889110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6bf0fdc-0665-4661-bab8-0ff6bd296ab2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:37.889549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f6bf0fdc-0665-4661-bab8-0ff6bd296ab2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:37.910828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:37.911435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:37.917724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:37.918211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:37.918975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:37.919408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:38.098882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f6bf0fdc-0665-4661-bab8-0ff6bd296ab2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:38.108368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f6bf0fdc-0665-4661-bab8-0ff6bd296ab2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.231986 Jun 02 19:25:38.109204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1225/2437] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:37 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:38.111810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:38.121037 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:38.122667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:38.123850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8627b4d4-4bdf-439d-8934-8c9962586d91 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1723 microversion: 2.20 time: 0.217230 Jun 02 19:25:38.124515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1213/2438] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:25:37 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 19:25:38.872956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-903d2a27-573c-410a-a660-dc0744945d94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:38.873600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-903d2a27-573c-410a-a660-dc0744945d94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:38.880340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-903d2a27-573c-410a-a660-dc0744945d94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:38.881057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-903d2a27-573c-410a-a660-dc0744945d94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:38.881581 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-903d2a27-573c-410a-a660-dc0744945d94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:38.882058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-903d2a27-573c-410a-a660-dc0744945d94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:38.951478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-b9cb9ef2-7610-41fa-85ee-fe311cdf1770 req-d7180ae9-39ec-4dfe-adac-73e5936f0f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968d6e4a-b6f7-4e04-a771-afcd71d03539", "name": "network-vif-deleted", "tag": "82177338-a233-4fe5-804d-6002dfc43f81"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:25:38.966491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-b9cb9ef2-7610-41fa-85ee-fe311cdf1770 req-d7180ae9-39ec-4dfe-adac-73e5936f0f48 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:38.967291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-b9cb9ef2-7610-41fa-85ee-fe311cdf1770 req-d7180ae9-39ec-4dfe-adac-73e5936f0f48 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:38.992563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-b9cb9ef2-7610-41fa-85ee-fe311cdf1770 req-d7180ae9-39ec-4dfe-adac-73e5936f0f48 service nova] Creating event network-vif-deleted:82177338-a233-4fe5-804d-6002dfc43f81 for instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 on hv-cinder-79760 Jun 02 19:25:39.014401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-b9cb9ef2-7610-41fa-85ee-fe311cdf1770 req-d7180ae9-39ec-4dfe-adac-73e5936f0f48 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066153 Jun 02 19:25:39.016992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1214/2439] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:25:39.084638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-903d2a27-573c-410a-a660-dc0744945d94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:39.107250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-903d2a27-573c-410a-a660-dc0744945d94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.238222 Jun 02 19:25:39.107855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1226/2440] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:39.127257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ba2eb9b-e80a-4e37-96ae-1a0d250572c1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:39.128010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ba2eb9b-e80a-4e37-96ae-1a0d250572c1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:39.138252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ba2eb9b-e80a-4e37-96ae-1a0d250572c1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:39.138991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ba2eb9b-e80a-4e37-96ae-1a0d250572c1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:39.140233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ba2eb9b-e80a-4e37-96ae-1a0d250572c1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:39.141203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ba2eb9b-e80a-4e37-96ae-1a0d250572c1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:39.145688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:39.146712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:39.161026 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:39.161484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:39.162317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:39.162759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:39.208881 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:39.209350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:39.209874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lazy-loading 'fault' on Instance uuid 968d6e4a-b6f7-4e04-a771-afcd71d03539 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:25:39.275458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:39.284393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:39.286172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef7ac127d2f4284a1808c580148c9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23ef70d937643f8a1c8597a8cfac596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:39.287391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9112d2e4-8496-4d54-a3a2-831ae591c504 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 200 len: 1371 microversion: 2.20 time: 0.147571 Jun 02 19:25:39.287934 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1227/2441] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:25:39 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 19:25:39.346069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0ba2eb9b-e80a-4e37-96ae-1a0d250572c1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:39.354885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ba2eb9b-e80a-4e37-96ae-1a0d250572c1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.232143 Jun 02 19:25:39.355397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1215/2442] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:39 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:40.127761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a0606c8f-7d32-42cd-bfe1-4c4ac0de023c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:40.128399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a0606c8f-7d32-42cd-bfe1-4c4ac0de023c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:40.136371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0606c8f-7d32-42cd-bfe1-4c4ac0de023c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:40.136823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0606c8f-7d32-42cd-bfe1-4c4ac0de023c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:40.137595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0606c8f-7d32-42cd-bfe1-4c4ac0de023c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:40.138086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0606c8f-7d32-42cd-bfe1-4c4ac0de023c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:40.280395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a0606c8f-7d32-42cd-bfe1-4c4ac0de023c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:40.292550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a0606c8f-7d32-42cd-bfe1-4c4ac0de023c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.168912 Jun 02 19:25:40.293476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1228/2443] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:40.312862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:40.313443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:40.321082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:40.321528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:40.322335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:40.322948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:40.338905 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] HTTP exception thrown: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Request method failure captured: Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 HTTP/1.1 Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkIsLrDQ-Sep8fVWW8sMgeg65pJE5fqKzPb74Xea6N68lP22aiLkZPvpplpXL05mdDhRtAgaeMJyKt9HFgRG9phpHZ_ttbkyNakNeLY6lOaTTfy9BXKpoqFbN_NnmuZb9sekJblGCGCWrzfs9hwzmKRtysKDNTERTV-Liljdga5KME Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:25:40.340628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: cef7ac127d2f4284a1808c580148c9e0 Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:40.342286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '968d6e4a-b6f7-4e04-a771-afcd71d03539'} Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:25:40.343424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:40.344824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:40.346203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Returning 404 to user: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:25:40.346203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-964be6fe-cb39-4e0a-8e05-026bc34299df tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 404 len: 111 microversion: 2.20 time: 0.035522 Jun 02 19:25:40.346203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1216/2444] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:25:40 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:25:40.352825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1dd9af3-8f50-4d8e-a5c8-35b6040629f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '.version_select at 0x7f5b7e04a310>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:40.371706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2f8cfa34-783e-45ce-a007-286fa27bb4c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:40.372321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2f8cfa34-783e-45ce-a007-286fa27bb4c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:40.376107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d1dd9af3-8f50-4d8e-a5c8-35b6040629f2 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-480491547" status: 204 len: 0 microversion: 2.20 time: 0.028100 Jun 02 19:25:40.376682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1229/2445] 10.222.0.15 () {60 vars in 1258 bytes} [Thu Jun 2 19:25:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-480491547 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 19:25:40.379783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f8cfa34-783e-45ce-a007-286fa27bb4c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:40.380268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f8cfa34-783e-45ce-a007-286fa27bb4c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:40.381047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f8cfa34-783e-45ce-a007-286fa27bb4c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:40.381481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f8cfa34-783e-45ce-a007-286fa27bb4c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:40.592969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2f8cfa34-783e-45ce-a007-286fa27bb4c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:40.601816 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2f8cfa34-783e-45ce-a007-286fa27bb4c6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.233917 Jun 02 19:25:40.602399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1217/2446] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:40 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:41.132350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:41.132917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:41.139839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:41.140281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:41.141157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:41.141830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:41.156185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] HTTP exception thrown: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Request method failure captured: Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 HTTP/1.1 Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkIsLrDQ-Sep8fVWW8sMgeg65pJE5fqKzPb74Xea6N68lP22aiLkZPvpplpXL05mdDhRtAgaeMJyKt9HFgRG9phpHZ_ttbkyNakNeLY6lOaTTfy9BXKpoqFbN_NnmuZb9sekJblGCGCWrzfs9hwzmKRtysKDNTERTV-Liljdga5KME Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:25:41.158009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: cef7ac127d2f4284a1808c580148c9e0 Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.159622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '968d6e4a-b6f7-4e04-a771-afcd71d03539'} Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:25:41.160496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.161996 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.163822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Returning 404 to user: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:25:41.163822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0380560c-18bc-4df9-8eae-a1c1faff64b3 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "DELETE /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 404 len: 111 microversion: 2.20 time: 0.031243 Jun 02 19:25:41.163822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1230/2447] 10.222.0.15 () {60 vars in 1279 bytes} [Thu Jun 2 19:25:41 2022] DELETE /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:25:41.169879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:41.170509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 968d6e4a-b6f7-4e04-a771-afcd71d03539] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:41.177393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:41.177832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:41.178626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:41.179050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:41.194168 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] HTTP exception thrown: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Request method failure captured: Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 HTTP/1.1 Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkIsLrDQ-Sep8fVWW8sMgeg65pJE5fqKzPb74Xea6N68lP22aiLkZPvpplpXL05mdDhRtAgaeMJyKt9HFgRG9phpHZ_ttbkyNakNeLY6lOaTTfy9BXKpoqFbN_NnmuZb9sekJblGCGCWrzfs9hwzmKRtysKDNTERTV-Liljdga5KME Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:25:41.195718 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: cef7ac127d2f4284a1808c580148c9e0 Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.198272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '968d6e4a-b6f7-4e04-a771-afcd71d03539'} Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:25:41.199686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. Jun 02 19:25:41.201732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:41.204244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Returning 404 to user: Instance 968d6e4a-b6f7-4e04-a771-afcd71d03539 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:25:41.204244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-daeee80c-3123-428f-9781-f058ea783e70 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539" status: 404 len: 111 microversion: 2.20 time: 0.031377 Jun 02 19:25:41.204244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1218/2448] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:25:41 2022] GET /compute/v2.1/servers/968d6e4a-b6f7-4e04-a771-afcd71d03539 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:25:41.314691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-af5ac630-3022-43ef-9423-d9ce23cab062 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:41.315333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-af5ac630-3022-43ef-9423-d9ce23cab062 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:41.322142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af5ac630-3022-43ef-9423-d9ce23cab062 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:41.322596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af5ac630-3022-43ef-9423-d9ce23cab062 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:41.323370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af5ac630-3022-43ef-9423-d9ce23cab062 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:41.323808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af5ac630-3022-43ef-9423-d9ce23cab062 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:41.459893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-af5ac630-3022-43ef-9423-d9ce23cab062 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:41.469912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-af5ac630-3022-43ef-9423-d9ce23cab062 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.161443 Jun 02 19:25:41.471566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1231/2449] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:41.622036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1b255934-ea1e-4640-ae0d-36019807cb1a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:41.622687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1b255934-ea1e-4640-ae0d-36019807cb1a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:41.630895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b255934-ea1e-4640-ae0d-36019807cb1a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:41.631340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b255934-ea1e-4640-ae0d-36019807cb1a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:41.632104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b255934-ea1e-4640-ae0d-36019807cb1a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:41.632530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b255934-ea1e-4640-ae0d-36019807cb1a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:41.773711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1b255934-ea1e-4640-ae0d-36019807cb1a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:41.783209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1b255934-ea1e-4640-ae0d-36019807cb1a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165768 Jun 02 19:25:41.783773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1219/2450] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:41 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:42.487586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2581ad6c-32f7-4620-b3fd-5729fd790a67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:42.488238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2581ad6c-32f7-4620-b3fd-5729fd790a67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:42.495283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2581ad6c-32f7-4620-b3fd-5729fd790a67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:42.495732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2581ad6c-32f7-4620-b3fd-5729fd790a67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:42.496501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2581ad6c-32f7-4620-b3fd-5729fd790a67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:42.496935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2581ad6c-32f7-4620-b3fd-5729fd790a67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:42.655849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2581ad6c-32f7-4620-b3fd-5729fd790a67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:42.665275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2581ad6c-32f7-4620-b3fd-5729fd790a67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.182011 Jun 02 19:25:42.665877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1232/2451] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:42.802808 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6397f16a-f7d0-4ee1-9937-c0e12cc949f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:42.803456 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6397f16a-f7d0-4ee1-9937-c0e12cc949f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:42.816760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6397f16a-f7d0-4ee1-9937-c0e12cc949f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:42.817231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6397f16a-f7d0-4ee1-9937-c0e12cc949f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:42.818044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6397f16a-f7d0-4ee1-9937-c0e12cc949f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:42.818472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6397f16a-f7d0-4ee1-9937-c0e12cc949f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:42.964163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6397f16a-f7d0-4ee1-9937-c0e12cc949f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:42.973096 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6397f16a-f7d0-4ee1-9937-c0e12cc949f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174240 Jun 02 19:25:42.973711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1220/2452] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:42 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:43.683859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-99e8e66b-6856-47e4-9010-38b198bf6262 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:43.684510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-99e8e66b-6856-47e4-9010-38b198bf6262 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:43.692261 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99e8e66b-6856-47e4-9010-38b198bf6262 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:43.692715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99e8e66b-6856-47e4-9010-38b198bf6262 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:43.693487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99e8e66b-6856-47e4-9010-38b198bf6262 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:43.693953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99e8e66b-6856-47e4-9010-38b198bf6262 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:43.848420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99e8e66b-6856-47e4-9010-38b198bf6262 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:43.858857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-99e8e66b-6856-47e4-9010-38b198bf6262 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.178820 Jun 02 19:25:43.859703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1233/2453] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:43.992379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-08529b05-0505-491d-9d20-42739c969660 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:43.993321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-08529b05-0505-491d-9d20-42739c969660 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:44.001877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08529b05-0505-491d-9d20-42739c969660 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:44.002664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08529b05-0505-491d-9d20-42739c969660 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:44.003827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08529b05-0505-491d-9d20-42739c969660 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:44.004297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08529b05-0505-491d-9d20-42739c969660 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:44.145521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-08529b05-0505-491d-9d20-42739c969660 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:44.154493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-08529b05-0505-491d-9d20-42739c969660 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166704 Jun 02 19:25:44.155100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1221/2454] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:43 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:44.876175 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-91123188-9e1a-49ce-9a4c-717de2614488 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:44.876974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-91123188-9e1a-49ce-9a4c-717de2614488 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:44.884495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91123188-9e1a-49ce-9a4c-717de2614488 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:44.884953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91123188-9e1a-49ce-9a4c-717de2614488 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:44.885688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91123188-9e1a-49ce-9a4c-717de2614488 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:44.886147 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91123188-9e1a-49ce-9a4c-717de2614488 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:45.025756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-91123188-9e1a-49ce-9a4c-717de2614488 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:45.035113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-91123188-9e1a-49ce-9a4c-717de2614488 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.163095 Jun 02 19:25:45.035698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1234/2455] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:45.171831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7a253ad1-b293-46dc-9afd-d1b56f3320c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:45.172603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7a253ad1-b293-46dc-9afd-d1b56f3320c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:45.179650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a253ad1-b293-46dc-9afd-d1b56f3320c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:45.180095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a253ad1-b293-46dc-9afd-d1b56f3320c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:45.180843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a253ad1-b293-46dc-9afd-d1b56f3320c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:45.181268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a253ad1-b293-46dc-9afd-d1b56f3320c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:45.326784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7a253ad1-b293-46dc-9afd-d1b56f3320c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:45.336077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7a253ad1-b293-46dc-9afd-d1b56f3320c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168205 Jun 02 19:25:45.336661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1222/2456] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:45 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:46.052735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1210137c-8317-4afb-9f22-01710d8d20a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:46.054083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1210137c-8317-4afb-9f22-01710d8d20a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:46.061267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1210137c-8317-4afb-9f22-01710d8d20a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:46.062154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1210137c-8317-4afb-9f22-01710d8d20a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:46.063253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1210137c-8317-4afb-9f22-01710d8d20a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:46.063774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1210137c-8317-4afb-9f22-01710d8d20a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:46.208185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1210137c-8317-4afb-9f22-01710d8d20a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:46.217541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1210137c-8317-4afb-9f22-01710d8d20a0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.168625 Jun 02 19:25:46.218250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1235/2457] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:46.354794 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a4b0397a-3fcd-41c6-98af-00203aeb7780 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:46.355376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a4b0397a-3fcd-41c6-98af-00203aeb7780 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:46.362682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b0397a-3fcd-41c6-98af-00203aeb7780 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:46.363135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b0397a-3fcd-41c6-98af-00203aeb7780 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:46.363897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b0397a-3fcd-41c6-98af-00203aeb7780 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:46.364329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b0397a-3fcd-41c6-98af-00203aeb7780 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:46.507432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a4b0397a-3fcd-41c6-98af-00203aeb7780 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:46.519029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a4b0397a-3fcd-41c6-98af-00203aeb7780 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168113 Jun 02 19:25:46.519644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1223/2458] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:46 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:47.235835 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3d5fc737-f366-4aa6-ab82-b83488b96153 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:47.236544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3d5fc737-f366-4aa6-ab82-b83488b96153 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:47.243656 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d5fc737-f366-4aa6-ab82-b83488b96153 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:47.244038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d5fc737-f366-4aa6-ab82-b83488b96153 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:47.245008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d5fc737-f366-4aa6-ab82-b83488b96153 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:47.245454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d5fc737-f366-4aa6-ab82-b83488b96153 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:47.388151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d5fc737-f366-4aa6-ab82-b83488b96153 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:47.397853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3d5fc737-f366-4aa6-ab82-b83488b96153 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.165631 Jun 02 19:25:47.398763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1236/2459] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:47.538418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d9b52dc-4b79-48cf-a4b1-8ea23537a4d1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:47.539447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9d9b52dc-4b79-48cf-a4b1-8ea23537a4d1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:47.546480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d9b52dc-4b79-48cf-a4b1-8ea23537a4d1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:47.546921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d9b52dc-4b79-48cf-a4b1-8ea23537a4d1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:47.547753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d9b52dc-4b79-48cf-a4b1-8ea23537a4d1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:47.548218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d9b52dc-4b79-48cf-a4b1-8ea23537a4d1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:47.691995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9d9b52dc-4b79-48cf-a4b1-8ea23537a4d1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:47.701150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9d9b52dc-4b79-48cf-a4b1-8ea23537a4d1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167123 Jun 02 19:25:47.702040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1224/2460] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:47 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:48.131865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:48.132440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:48.140190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.140652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.141452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.142143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.156958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 HTTP/1.1 Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:25:48.158888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.160390 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd285abbb-bcf6-43c7-be53-6b909c9bcce1'} Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:25:48.161277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.162752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.164072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:25:48.164072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6aaa9c55-158b-4200-9486-218bb903fdbf tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 404 len: 111 microversion: 2.1 time: 0.032855 Jun 02 19:25:48.164072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1237/2461] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:25:48 2022] DELETE /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:25:48.169493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:48.170434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: d285abbb-bcf6-43c7-be53-6b909c9bcce1] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:48.176864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.177314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.178282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.178874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.200005 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 HTTP/1.1 Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:25:48.202008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.205142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': 'd285abbb-bcf6-43c7-be53-6b909c9bcce1'} Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:25:48.206474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. Jun 02 19:25:48.207857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.209185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance d285abbb-bcf6-43c7-be53-6b909c9bcce1 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:25:48.209185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c533f1a0-b3c9-4372-b55a-30cebb05bc4e tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1" status: 404 len: 111 microversion: 2.1 time: 0.038424 Jun 02 19:25:48.209185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1225/2462] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:48 2022] GET /compute/v2.1/servers/d285abbb-bcf6-43c7-be53-6b909c9bcce1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:25:48.213015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:48.213525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:48.220622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.221115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.221807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.222284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.238901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 HTTP/1.1 Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:25:48.240519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.242056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '1ac72221-56c7-4928-a41f-7bf89b4cab20'} Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:25:48.242862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.244252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.245635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:25:48.245635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cea5a899-033c-4c56-a354-7778fffca436 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 404 len: 111 microversion: 2.1 time: 0.033058 Jun 02 19:25:48.245635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1238/2463] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:25:48 2022] DELETE /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:25:48.250616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:48.251390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 1ac72221-56c7-4928-a41f-7bf89b4cab20] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:48.258248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.258704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.259486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.259924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.265091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:48.277836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 HTTP/1.1 Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:25:48.279858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.281495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '1ac72221-56c7-4928-a41f-7bf89b4cab20'} Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:25:48.282686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. Jun 02 19:25:48.283908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:25:48.285002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 1ac72221-56c7-4928-a41f-7bf89b4cab20 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:25:48.285002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f46ee09f-dbb4-4b8c-9083-bc5ffc0ef210 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20" status: 404 len: 111 microversion: 2.1 time: 0.034635 Jun 02 19:25:48.285002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1226/2464] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:48 2022] GET /compute/v2.1/servers/1ac72221-56c7-4928-a41f-7bf89b4cab20 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:25:48.416544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7fbf7d9c-7d9a-420a-b53c-fc73e769b743 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:48.417148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7fbf7d9c-7d9a-420a-b53c-fc73e769b743 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:48.424347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fbf7d9c-7d9a-420a-b53c-fc73e769b743 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.424733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fbf7d9c-7d9a-420a-b53c-fc73e769b743 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.425501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fbf7d9c-7d9a-420a-b53c-fc73e769b743 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.425978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fbf7d9c-7d9a-420a-b53c-fc73e769b743 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.567189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7fbf7d9c-7d9a-420a-b53c-fc73e769b743 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:48.575553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7fbf7d9c-7d9a-420a-b53c-fc73e769b743 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1597 microversion: 2.1 time: 0.162835 Jun 02 19:25:48.576142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1239/2465] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1597 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:48.720755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2c7e5335-776e-4fc8-ae86-fe5ce1ab2767 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:48.721393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2c7e5335-776e-4fc8-ae86-fe5ce1ab2767 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:48.729100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c7e5335-776e-4fc8-ae86-fe5ce1ab2767 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.729559 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c7e5335-776e-4fc8-ae86-fe5ce1ab2767 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.730368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c7e5335-776e-4fc8-ae86-fe5ce1ab2767 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:48.730806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c7e5335-776e-4fc8-ae86-fe5ce1ab2767 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:48.868212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2c7e5335-776e-4fc8-ae86-fe5ce1ab2767 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:48.876682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2c7e5335-776e-4fc8-ae86-fe5ce1ab2767 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159889 Jun 02 19:25:48.877153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1227/2466] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:48 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:49.096443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-e8a6cd8b-a36e-436a-8c9a-417afe5d4817 req-d306aecc-4695-48fc-ad40-95ae180e1747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721b511d-9547-41f5-a72c-47179f69b6af", "name": "network-vif-deleted", "tag": "dcfd3ee8-9442-4031-bf79-1d94f38ef91a"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:25:49.105739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-e8a6cd8b-a36e-436a-8c9a-417afe5d4817 req-d306aecc-4695-48fc-ad40-95ae180e1747 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:49.106272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-e8a6cd8b-a36e-436a-8c9a-417afe5d4817 req-d306aecc-4695-48fc-ad40-95ae180e1747 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:49.119113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-e8a6cd8b-a36e-436a-8c9a-417afe5d4817 req-d306aecc-4695-48fc-ad40-95ae180e1747 service nova] Creating event network-vif-deleted:dcfd3ee8-9442-4031-bf79-1d94f38ef91a for instance 721b511d-9547-41f5-a72c-47179f69b6af on hv-cinder-79760 Jun 02 19:25:49.125664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-e8a6cd8b-a36e-436a-8c9a-417afe5d4817 req-d306aecc-4695-48fc-ad40-95ae180e1747 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Jun 02 19:25:49.126299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1240/2467] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:25:49.595588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6151c98b-2e93-4214-b86f-f91152e29006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:49.596205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6151c98b-2e93-4214-b86f-f91152e29006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:49.602995 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6151c98b-2e93-4214-b86f-f91152e29006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:49.603448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6151c98b-2e93-4214-b86f-f91152e29006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:49.604218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6151c98b-2e93-4214-b86f-f91152e29006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:49.604651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6151c98b-2e93-4214-b86f-f91152e29006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:49.679384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6151c98b-2e93-4214-b86f-f91152e29006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:49.688454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6151c98b-2e93-4214-b86f-f91152e29006 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097432 Jun 02 19:25:49.689036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1228/2468] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:49.896478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ebd3f447-de52-457b-b3ad-ba213681fd63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:49.897164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ebd3f447-de52-457b-b3ad-ba213681fd63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:49.904051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebd3f447-de52-457b-b3ad-ba213681fd63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:49.904523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebd3f447-de52-457b-b3ad-ba213681fd63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:49.905510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebd3f447-de52-457b-b3ad-ba213681fd63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:49.906122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebd3f447-de52-457b-b3ad-ba213681fd63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:50.057723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ebd3f447-de52-457b-b3ad-ba213681fd63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:50.066791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ebd3f447-de52-457b-b3ad-ba213681fd63 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.175047 Jun 02 19:25:50.067529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1241/2469] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:49 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:50.706753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-26f4832f-655c-4a72-9c21-bd9bbd297bde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:50.707468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-26f4832f-655c-4a72-9c21-bd9bbd297bde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:50.714565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26f4832f-655c-4a72-9c21-bd9bbd297bde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:50.715013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26f4832f-655c-4a72-9c21-bd9bbd297bde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:50.715784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26f4832f-655c-4a72-9c21-bd9bbd297bde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:50.716316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26f4832f-655c-4a72-9c21-bd9bbd297bde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:50.787812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-26f4832f-655c-4a72-9c21-bd9bbd297bde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:50.796476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-26f4832f-655c-4a72-9c21-bd9bbd297bde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094501 Jun 02 19:25:50.797046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1229/2470] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:51.084647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cafa6b8e-bbe1-4d47-a3cf-83c9fc104559 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:51.085264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cafa6b8e-bbe1-4d47-a3cf-83c9fc104559 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:51.093583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cafa6b8e-bbe1-4d47-a3cf-83c9fc104559 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:51.094092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cafa6b8e-bbe1-4d47-a3cf-83c9fc104559 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:51.095132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cafa6b8e-bbe1-4d47-a3cf-83c9fc104559 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:51.095578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cafa6b8e-bbe1-4d47-a3cf-83c9fc104559 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:51.252823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cafa6b8e-bbe1-4d47-a3cf-83c9fc104559 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:51.262167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cafa6b8e-bbe1-4d47-a3cf-83c9fc104559 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.181574 Jun 02 19:25:51.262778 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1242/2471] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:51 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:51.815805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-70dc2de3-c9ed-4b21-a084-f0f530a01965 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:51.816393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-70dc2de3-c9ed-4b21-a084-f0f530a01965 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:51.823463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70dc2de3-c9ed-4b21-a084-f0f530a01965 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:51.823907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70dc2de3-c9ed-4b21-a084-f0f530a01965 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:51.824664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70dc2de3-c9ed-4b21-a084-f0f530a01965 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:51.825091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70dc2de3-c9ed-4b21-a084-f0f530a01965 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:51.892847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-70dc2de3-c9ed-4b21-a084-f0f530a01965 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:51.901386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-70dc2de3-c9ed-4b21-a084-f0f530a01965 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090442 Jun 02 19:25:51.902002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1230/2472] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:52.280738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cc5c2798-6ee4-48a4-9452-12a54a49e9ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:52.281378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cc5c2798-6ee4-48a4-9452-12a54a49e9ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:52.288650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc5c2798-6ee4-48a4-9452-12a54a49e9ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:52.289100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc5c2798-6ee4-48a4-9452-12a54a49e9ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:52.289897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc5c2798-6ee4-48a4-9452-12a54a49e9ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:52.290321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc5c2798-6ee4-48a4-9452-12a54a49e9ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:52.294767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:52.430037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cc5c2798-6ee4-48a4-9452-12a54a49e9ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:52.439538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cc5c2798-6ee4-48a4-9452-12a54a49e9ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162607 Jun 02 19:25:52.440120 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1243/2473] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:52 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:52.920535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-742d14a3-c3b6-420f-93f6-3bd0a0b5f9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:52.921182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-742d14a3-c3b6-420f-93f6-3bd0a0b5f9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:52.929285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-742d14a3-c3b6-420f-93f6-3bd0a0b5f9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:52.929736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-742d14a3-c3b6-420f-93f6-3bd0a0b5f9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:52.930534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-742d14a3-c3b6-420f-93f6-3bd0a0b5f9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:52.930966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-742d14a3-c3b6-420f-93f6-3bd0a0b5f9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:53.001144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-742d14a3-c3b6-420f-93f6-3bd0a0b5f9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:53.009851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-742d14a3-c3b6-420f-93f6-3bd0a0b5f9ea tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094371 Jun 02 19:25:53.010452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1231/2474] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:53.460929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-25502a53-c526-4cc0-a80b-e5fb558269fc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:53.462035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-25502a53-c526-4cc0-a80b-e5fb558269fc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:53.471655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25502a53-c526-4cc0-a80b-e5fb558269fc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:53.472153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25502a53-c526-4cc0-a80b-e5fb558269fc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:53.473195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25502a53-c526-4cc0-a80b-e5fb558269fc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:53.473757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25502a53-c526-4cc0-a80b-e5fb558269fc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:53.621458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-25502a53-c526-4cc0-a80b-e5fb558269fc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:53.630292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-25502a53-c526-4cc0-a80b-e5fb558269fc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.176019 Jun 02 19:25:53.630867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1244/2475] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:53 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:54.029283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c293f1ba-7a02-466b-a127-484de3c26cce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:54.030050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c293f1ba-7a02-466b-a127-484de3c26cce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:54.039278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c293f1ba-7a02-466b-a127-484de3c26cce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:54.039734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c293f1ba-7a02-466b-a127-484de3c26cce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:54.040499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c293f1ba-7a02-466b-a127-484de3c26cce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:54.040932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c293f1ba-7a02-466b-a127-484de3c26cce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:54.106987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c293f1ba-7a02-466b-a127-484de3c26cce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:54.115981 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c293f1ba-7a02-466b-a127-484de3c26cce tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091208 Jun 02 19:25:54.116552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1232/2476] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:54.648019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dc1f1387-c57d-4166-b192-a006e4c9a592 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:54.648853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dc1f1387-c57d-4166-b192-a006e4c9a592 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:54.658909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc1f1387-c57d-4166-b192-a006e4c9a592 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:54.659366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc1f1387-c57d-4166-b192-a006e4c9a592 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:54.660146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc1f1387-c57d-4166-b192-a006e4c9a592 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:54.660589 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc1f1387-c57d-4166-b192-a006e4c9a592 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:54.807747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dc1f1387-c57d-4166-b192-a006e4c9a592 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:54.818084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dc1f1387-c57d-4166-b192-a006e4c9a592 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.173730 Jun 02 19:25:54.819095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1245/2477] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:54 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:55.134208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-33f240d5-c6fc-487d-88a8-e4428fe620fb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:55.134807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-33f240d5-c6fc-487d-88a8-e4428fe620fb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:55.142752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-33f240d5-c6fc-487d-88a8-e4428fe620fb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:55.143207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-33f240d5-c6fc-487d-88a8-e4428fe620fb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:55.143979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-33f240d5-c6fc-487d-88a8-e4428fe620fb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:55.144413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-33f240d5-c6fc-487d-88a8-e4428fe620fb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:55.215257 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-33f240d5-c6fc-487d-88a8-e4428fe620fb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:55.224777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-33f240d5-c6fc-487d-88a8-e4428fe620fb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094602 Jun 02 19:25:55.225400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1233/2478] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:55.839634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e2af98dc-1c77-4d8d-a840-22712267b7f9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:55.840233 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e2af98dc-1c77-4d8d-a840-22712267b7f9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:55.847780 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2af98dc-1c77-4d8d-a840-22712267b7f9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:55.848237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2af98dc-1c77-4d8d-a840-22712267b7f9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:55.849022 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2af98dc-1c77-4d8d-a840-22712267b7f9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:55.849463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2af98dc-1c77-4d8d-a840-22712267b7f9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:55.987330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e2af98dc-1c77-4d8d-a840-22712267b7f9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:55.997216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e2af98dc-1c77-4d8d-a840-22712267b7f9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161489 Jun 02 19:25:55.997813 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1246/2479] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:55 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:56.244324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2b38eda9-68fc-459e-aad2-f5c861936d76 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:56.244957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2b38eda9-68fc-459e-aad2-f5c861936d76 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:56.251954 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b38eda9-68fc-459e-aad2-f5c861936d76 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:56.252402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b38eda9-68fc-459e-aad2-f5c861936d76 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:56.253160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b38eda9-68fc-459e-aad2-f5c861936d76 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:56.253584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b38eda9-68fc-459e-aad2-f5c861936d76 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:56.322073 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2b38eda9-68fc-459e-aad2-f5c861936d76 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:56.330889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2b38eda9-68fc-459e-aad2-f5c861936d76 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090517 Jun 02 19:25:56.331475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1234/2480] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:57.014805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c8f4a587-ed06-4628-9c59-a48375af513e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:57.015420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c8f4a587-ed06-4628-9c59-a48375af513e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:57.022650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8f4a587-ed06-4628-9c59-a48375af513e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:57.023134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8f4a587-ed06-4628-9c59-a48375af513e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:57.023949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8f4a587-ed06-4628-9c59-a48375af513e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:57.024382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c8f4a587-ed06-4628-9c59-a48375af513e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:57.161102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c8f4a587-ed06-4628-9c59-a48375af513e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:57.169949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c8f4a587-ed06-4628-9c59-a48375af513e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159055 Jun 02 19:25:57.170505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1247/2481] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:57 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:57.351991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4db2c7cd-9e10-4fed-a2a7-cbf2a5dfd873 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:57.352893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4db2c7cd-9e10-4fed-a2a7-cbf2a5dfd873 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:57.363136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4db2c7cd-9e10-4fed-a2a7-cbf2a5dfd873 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:57.363596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4db2c7cd-9e10-4fed-a2a7-cbf2a5dfd873 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:57.364374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4db2c7cd-9e10-4fed-a2a7-cbf2a5dfd873 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:57.364807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4db2c7cd-9e10-4fed-a2a7-cbf2a5dfd873 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:57.443806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4db2c7cd-9e10-4fed-a2a7-cbf2a5dfd873 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:57.456293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4db2c7cd-9e10-4fed-a2a7-cbf2a5dfd873 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.110151 Jun 02 19:25:57.456864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1235/2482] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:58.191229 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a74faa25-c94b-4cbe-a48e-444a403726a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:58.191956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a74faa25-c94b-4cbe-a48e-444a403726a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:58.198774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a74faa25-c94b-4cbe-a48e-444a403726a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:58.199224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a74faa25-c94b-4cbe-a48e-444a403726a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:58.199998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a74faa25-c94b-4cbe-a48e-444a403726a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:58.200432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a74faa25-c94b-4cbe-a48e-444a403726a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:58.350013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a74faa25-c94b-4cbe-a48e-444a403726a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:58.358846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a74faa25-c94b-4cbe-a48e-444a403726a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.172442 Jun 02 19:25:58.359559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1248/2483] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:58 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:58.475222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-91b100d4-ab75-4eb4-a572-7937c5d16b93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:58.475800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-91b100d4-ab75-4eb4-a572-7937c5d16b93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:58.482655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91b100d4-ab75-4eb4-a572-7937c5d16b93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:58.483100 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91b100d4-ab75-4eb4-a572-7937c5d16b93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:58.483859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91b100d4-ab75-4eb4-a572-7937c5d16b93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:58.484284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91b100d4-ab75-4eb4-a572-7937c5d16b93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:58.550450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-91b100d4-ab75-4eb4-a572-7937c5d16b93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:58.561930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-91b100d4-ab75-4eb4-a572-7937c5d16b93 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090394 Jun 02 19:25:58.562709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1236/2484] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:59.376961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cadba306-c598-424a-8038-85290f73425a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:59.377550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cadba306-c598-424a-8038-85290f73425a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:59.384846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cadba306-c598-424a-8038-85290f73425a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:59.385294 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cadba306-c598-424a-8038-85290f73425a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:59.386097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cadba306-c598-424a-8038-85290f73425a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:59.386529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cadba306-c598-424a-8038-85290f73425a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:59.531473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cadba306-c598-424a-8038-85290f73425a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:59.540349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cadba306-c598-424a-8038-85290f73425a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167327 Jun 02 19:25:59.540988 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1249/2485] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:59 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:25:59.584928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3baaa4e0-f132-48db-9adf-7aee07532d52 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:25:59.586513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3baaa4e0-f132-48db-9adf-7aee07532d52 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:25:59.592110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3baaa4e0-f132-48db-9adf-7aee07532d52 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:59.592570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3baaa4e0-f132-48db-9adf-7aee07532d52 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:59.593370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3baaa4e0-f132-48db-9adf-7aee07532d52 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:25:59.593830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3baaa4e0-f132-48db-9adf-7aee07532d52 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:25:59.663061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3baaa4e0-f132-48db-9adf-7aee07532d52 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:25:59.671584 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3baaa4e0-f132-48db-9adf-7aee07532d52 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092108 Jun 02 19:25:59.672199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1237/2486] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:25:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:00.561981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4877982-4665-4001-8b96-6d278e3eff6f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:00.562596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c4877982-4665-4001-8b96-6d278e3eff6f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:00.570560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4877982-4665-4001-8b96-6d278e3eff6f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:00.571140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4877982-4665-4001-8b96-6d278e3eff6f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:00.572263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4877982-4665-4001-8b96-6d278e3eff6f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:00.572757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4877982-4665-4001-8b96-6d278e3eff6f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:00.690193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ae2ea13-c77f-45a0-9497-99f945815851 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:00.690810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5ae2ea13-c77f-45a0-9497-99f945815851 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:00.698573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ae2ea13-c77f-45a0-9497-99f945815851 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:00.698937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ae2ea13-c77f-45a0-9497-99f945815851 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:00.699709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ae2ea13-c77f-45a0-9497-99f945815851 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:00.700138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ae2ea13-c77f-45a0-9497-99f945815851 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:00.709424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c4877982-4665-4001-8b96-6d278e3eff6f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:00.717870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c4877982-4665-4001-8b96-6d278e3eff6f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160878 Jun 02 19:26:00.718555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1250/2487] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:00 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:00.764785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ae2ea13-c77f-45a0-9497-99f945815851 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:00.774357 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ae2ea13-c77f-45a0-9497-99f945815851 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088293 Jun 02 19:26:00.775191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1238/2488] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:01.736083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cdab5af9-45a2-4216-a767-d5f086cf8513 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:01.736739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cdab5af9-45a2-4216-a767-d5f086cf8513 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:01.739100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:01.745484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cdab5af9-45a2-4216-a767-d5f086cf8513 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:01.746100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cdab5af9-45a2-4216-a767-d5f086cf8513 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:01.746798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cdab5af9-45a2-4216-a767-d5f086cf8513 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:01.747241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cdab5af9-45a2-4216-a767-d5f086cf8513 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:01.793024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-871e1265-64e6-4240-a930-158118a0193d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:01.793598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-871e1265-64e6-4240-a930-158118a0193d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:01.801828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-871e1265-64e6-4240-a930-158118a0193d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:01.802390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-871e1265-64e6-4240-a930-158118a0193d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:01.803174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-871e1265-64e6-4240-a930-158118a0193d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:01.803614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-871e1265-64e6-4240-a930-158118a0193d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:01.881613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-871e1265-64e6-4240-a930-158118a0193d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:01.889907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-871e1265-64e6-4240-a930-158118a0193d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.100907 Jun 02 19:26:01.890703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1239/2489] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:01.910084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cdab5af9-45a2-4216-a767-d5f086cf8513 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:01.920971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cdab5af9-45a2-4216-a767-d5f086cf8513 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.188819 Jun 02 19:26:01.921568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1251/2490] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:01 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:02.912414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8ae40d34-015a-41d9-aff2-d9eb63c4c93c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:02.913373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8ae40d34-015a-41d9-aff2-d9eb63c4c93c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:02.920732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ae40d34-015a-41d9-aff2-d9eb63c4c93c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:02.921179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ae40d34-015a-41d9-aff2-d9eb63c4c93c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:02.921974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ae40d34-015a-41d9-aff2-d9eb63c4c93c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:02.922403 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ae40d34-015a-41d9-aff2-d9eb63c4c93c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:02.939084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e1415329-9c18-475c-b7d3-e9990ecd2db2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:02.939712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e1415329-9c18-475c-b7d3-e9990ecd2db2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:02.946882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e1415329-9c18-475c-b7d3-e9990ecd2db2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:02.947338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e1415329-9c18-475c-b7d3-e9990ecd2db2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:02.948111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e1415329-9c18-475c-b7d3-e9990ecd2db2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:02.948558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e1415329-9c18-475c-b7d3-e9990ecd2db2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:02.987938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8ae40d34-015a-41d9-aff2-d9eb63c4c93c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:02.997131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8ae40d34-015a-41d9-aff2-d9eb63c4c93c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091733 Jun 02 19:26:02.997950 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1240/2491] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:03.092655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e1415329-9c18-475c-b7d3-e9990ecd2db2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:03.101489 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e1415329-9c18-475c-b7d3-e9990ecd2db2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166645 Jun 02 19:26:03.102116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1252/2492] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:02 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:04.015148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cfaa7560-4396-47e3-b2e5-6ddd876953d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:04.015784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cfaa7560-4396-47e3-b2e5-6ddd876953d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:04.023364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfaa7560-4396-47e3-b2e5-6ddd876953d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:04.023861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfaa7560-4396-47e3-b2e5-6ddd876953d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:04.024700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfaa7560-4396-47e3-b2e5-6ddd876953d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:04.025198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfaa7560-4396-47e3-b2e5-6ddd876953d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:04.093968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cfaa7560-4396-47e3-b2e5-6ddd876953d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:04.102629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cfaa7560-4396-47e3-b2e5-6ddd876953d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091586 Jun 02 19:26:04.103216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1241/2493] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:04.119445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9add0939-2c1e-44cf-8b70-7836e6ea4b95 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:04.120165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9add0939-2c1e-44cf-8b70-7836e6ea4b95 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:04.127107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9add0939-2c1e-44cf-8b70-7836e6ea4b95 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:04.127566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9add0939-2c1e-44cf-8b70-7836e6ea4b95 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:04.128346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9add0939-2c1e-44cf-8b70-7836e6ea4b95 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:04.128833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9add0939-2c1e-44cf-8b70-7836e6ea4b95 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:04.266631 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9add0939-2c1e-44cf-8b70-7836e6ea4b95 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:04.277427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9add0939-2c1e-44cf-8b70-7836e6ea4b95 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161850 Jun 02 19:26:04.278036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1253/2494] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:04 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:05.120333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-07d204cf-2e2d-40cf-8aa9-0c4fbda0d7f6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:05.121007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-07d204cf-2e2d-40cf-8aa9-0c4fbda0d7f6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:05.130873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07d204cf-2e2d-40cf-8aa9-0c4fbda0d7f6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:05.131535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07d204cf-2e2d-40cf-8aa9-0c4fbda0d7f6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:05.132757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07d204cf-2e2d-40cf-8aa9-0c4fbda0d7f6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:05.133334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07d204cf-2e2d-40cf-8aa9-0c4fbda0d7f6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:05.204489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-07d204cf-2e2d-40cf-8aa9-0c4fbda0d7f6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:05.213764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-07d204cf-2e2d-40cf-8aa9-0c4fbda0d7f6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097543 Jun 02 19:26:05.214367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1242/2495] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:05.294700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3995ea5-7ef8-4ad0-aa04-eb20e8cd3057 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:05.295288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f3995ea5-7ef8-4ad0-aa04-eb20e8cd3057 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:05.304922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3995ea5-7ef8-4ad0-aa04-eb20e8cd3057 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:05.305379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3995ea5-7ef8-4ad0-aa04-eb20e8cd3057 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:05.306221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3995ea5-7ef8-4ad0-aa04-eb20e8cd3057 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:05.306730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3995ea5-7ef8-4ad0-aa04-eb20e8cd3057 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:05.449935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f3995ea5-7ef8-4ad0-aa04-eb20e8cd3057 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:05.459272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f3995ea5-7ef8-4ad0-aa04-eb20e8cd3057 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168552 Jun 02 19:26:05.459857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1254/2496] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:05 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:06.231430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-331d4903-7136-4061-a9c8-82c6dc231ed2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:06.232075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-331d4903-7136-4061-a9c8-82c6dc231ed2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:06.242065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-331d4903-7136-4061-a9c8-82c6dc231ed2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:06.242795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-331d4903-7136-4061-a9c8-82c6dc231ed2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:06.244059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-331d4903-7136-4061-a9c8-82c6dc231ed2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:06.244760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-331d4903-7136-4061-a9c8-82c6dc231ed2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:06.263402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:06.312986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-331d4903-7136-4061-a9c8-82c6dc231ed2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:06.324290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-331d4903-7136-4061-a9c8-82c6dc231ed2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097420 Jun 02 19:26:06.324904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1243/2497] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:06.477288 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f648b4ca-c5de-4109-8614-70b652051cfb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:06.477944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f648b4ca-c5de-4109-8614-70b652051cfb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:06.486107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f648b4ca-c5de-4109-8614-70b652051cfb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:06.486484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f648b4ca-c5de-4109-8614-70b652051cfb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:06.487271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f648b4ca-c5de-4109-8614-70b652051cfb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:06.487711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f648b4ca-c5de-4109-8614-70b652051cfb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:06.633189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f648b4ca-c5de-4109-8614-70b652051cfb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:06.642246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f648b4ca-c5de-4109-8614-70b652051cfb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168718 Jun 02 19:26:06.643074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1255/2498] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:06 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:07.341908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-552cb5a5-afc7-4a14-9869-969874e3ea27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:07.342492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-552cb5a5-afc7-4a14-9869-969874e3ea27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:07.344788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:07.350503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-552cb5a5-afc7-4a14-9869-969874e3ea27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:07.351039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-552cb5a5-afc7-4a14-9869-969874e3ea27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:07.351820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-552cb5a5-afc7-4a14-9869-969874e3ea27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:07.352253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-552cb5a5-afc7-4a14-9869-969874e3ea27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:07.419889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-552cb5a5-afc7-4a14-9869-969874e3ea27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:07.428842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-552cb5a5-afc7-4a14-9869-969874e3ea27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090946 Jun 02 19:26:07.429428 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1244/2499] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:07.660954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-de8b2ebc-6ebc-4dbf-afc4-e6b2959222b7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:07.661683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-de8b2ebc-6ebc-4dbf-afc4-e6b2959222b7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:07.668588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de8b2ebc-6ebc-4dbf-afc4-e6b2959222b7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:07.669037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de8b2ebc-6ebc-4dbf-afc4-e6b2959222b7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:07.669825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de8b2ebc-6ebc-4dbf-afc4-e6b2959222b7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:07.670259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de8b2ebc-6ebc-4dbf-afc4-e6b2959222b7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:07.813207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-de8b2ebc-6ebc-4dbf-afc4-e6b2959222b7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:07.822254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-de8b2ebc-6ebc-4dbf-afc4-e6b2959222b7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165180 Jun 02 19:26:07.822807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1256/2500] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:07 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:08.447996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6f7f0641-fca5-47fa-a1f7-3758c5a4a705 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:08.448663 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6f7f0641-fca5-47fa-a1f7-3758c5a4a705 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:08.455618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f7f0641-fca5-47fa-a1f7-3758c5a4a705 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:08.456068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f7f0641-fca5-47fa-a1f7-3758c5a4a705 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:08.457727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f7f0641-fca5-47fa-a1f7-3758c5a4a705 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:08.458103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f7f0641-fca5-47fa-a1f7-3758c5a4a705 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:08.526607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6f7f0641-fca5-47fa-a1f7-3758c5a4a705 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:08.541275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6f7f0641-fca5-47fa-a1f7-3758c5a4a705 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097716 Jun 02 19:26:08.541889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1245/2501] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:08.841728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c2acd6d0-2fa0-4b21-a5f6-6ae372846f54 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:08.842351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c2acd6d0-2fa0-4b21-a5f6-6ae372846f54 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:08.850051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2acd6d0-2fa0-4b21-a5f6-6ae372846f54 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:08.850507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2acd6d0-2fa0-4b21-a5f6-6ae372846f54 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:08.851284 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2acd6d0-2fa0-4b21-a5f6-6ae372846f54 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:08.851714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2acd6d0-2fa0-4b21-a5f6-6ae372846f54 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:08.999217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c2acd6d0-2fa0-4b21-a5f6-6ae372846f54 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:09.008586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c2acd6d0-2fa0-4b21-a5f6-6ae372846f54 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.170393 Jun 02 19:26:09.009347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1257/2502] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:08 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:09.561214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-85ea292a-c6e5-420d-a47c-97675dbe8fb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:09.562468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-85ea292a-c6e5-420d-a47c-97675dbe8fb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:09.570588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85ea292a-c6e5-420d-a47c-97675dbe8fb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:09.571033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85ea292a-c6e5-420d-a47c-97675dbe8fb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:09.571790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85ea292a-c6e5-420d-a47c-97675dbe8fb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:09.572216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85ea292a-c6e5-420d-a47c-97675dbe8fb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:09.641398 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85ea292a-c6e5-420d-a47c-97675dbe8fb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:09.650169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-85ea292a-c6e5-420d-a47c-97675dbe8fb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095005 Jun 02 19:26:09.650717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1246/2503] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:10.028541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8fe75ec8-639b-47b4-b49a-63e79e02b004 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:10.029167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8fe75ec8-639b-47b4-b49a-63e79e02b004 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:10.036635 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fe75ec8-639b-47b4-b49a-63e79e02b004 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:10.037094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fe75ec8-639b-47b4-b49a-63e79e02b004 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:10.037920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fe75ec8-639b-47b4-b49a-63e79e02b004 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:10.038330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fe75ec8-639b-47b4-b49a-63e79e02b004 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:10.185777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8fe75ec8-639b-47b4-b49a-63e79e02b004 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:10.196554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8fe75ec8-639b-47b4-b49a-63e79e02b004 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.171747 Jun 02 19:26:10.197400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1258/2504] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:10 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:10.670948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d49e4f70-11b2-418a-9f4d-a9739f347292 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:10.671656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d49e4f70-11b2-418a-9f4d-a9739f347292 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:10.680155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d49e4f70-11b2-418a-9f4d-a9739f347292 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:10.680607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d49e4f70-11b2-418a-9f4d-a9739f347292 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:10.681378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d49e4f70-11b2-418a-9f4d-a9739f347292 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:10.681832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d49e4f70-11b2-418a-9f4d-a9739f347292 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:10.747466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d49e4f70-11b2-418a-9f4d-a9739f347292 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:10.756418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d49e4f70-11b2-418a-9f4d-a9739f347292 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092019 Jun 02 19:26:10.757344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1247/2505] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:11.216693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6dbfc415-2564-49bd-988d-62c069942258 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:11.217563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6dbfc415-2564-49bd-988d-62c069942258 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:11.224641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dbfc415-2564-49bd-988d-62c069942258 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:11.225116 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dbfc415-2564-49bd-988d-62c069942258 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:11.225914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dbfc415-2564-49bd-988d-62c069942258 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:11.226391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6dbfc415-2564-49bd-988d-62c069942258 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:11.365833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6dbfc415-2564-49bd-988d-62c069942258 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:11.369403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:11.374946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6dbfc415-2564-49bd-988d-62c069942258 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162270 Jun 02 19:26:11.375535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1259/2506] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:11 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:11.775354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6a0239b7-8d66-4b25-baaf-559e6f2b3f9c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:11.776023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6a0239b7-8d66-4b25-baaf-559e6f2b3f9c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:11.785952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a0239b7-8d66-4b25-baaf-559e6f2b3f9c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:11.786408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a0239b7-8d66-4b25-baaf-559e6f2b3f9c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:11.787481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a0239b7-8d66-4b25-baaf-559e6f2b3f9c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:11.787914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a0239b7-8d66-4b25-baaf-559e6f2b3f9c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:11.857709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6a0239b7-8d66-4b25-baaf-559e6f2b3f9c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:11.866509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6a0239b7-8d66-4b25-baaf-559e6f2b3f9c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095084 Jun 02 19:26:11.867159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1248/2507] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:12.396729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ebf61d8a-bee1-4c0d-9492-afca6ab1024a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:12.397409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ebf61d8a-bee1-4c0d-9492-afca6ab1024a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:12.405836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebf61d8a-bee1-4c0d-9492-afca6ab1024a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:12.406310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebf61d8a-bee1-4c0d-9492-afca6ab1024a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:12.407093 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebf61d8a-bee1-4c0d-9492-afca6ab1024a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:12.407532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebf61d8a-bee1-4c0d-9492-afca6ab1024a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:12.559592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ebf61d8a-bee1-4c0d-9492-afca6ab1024a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:12.568925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ebf61d8a-bee1-4c0d-9492-afca6ab1024a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.176879 Jun 02 19:26:12.569539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1260/2508] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:12 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:12.884523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1cb98d85-0dc8-46f5-a5c4-fc01275ee22e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:12.885154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1cb98d85-0dc8-46f5-a5c4-fc01275ee22e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:12.891938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cb98d85-0dc8-46f5-a5c4-fc01275ee22e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:12.892384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cb98d85-0dc8-46f5-a5c4-fc01275ee22e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:12.893222 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cb98d85-0dc8-46f5-a5c4-fc01275ee22e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:12.893649 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cb98d85-0dc8-46f5-a5c4-fc01275ee22e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:12.962698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1cb98d85-0dc8-46f5-a5c4-fc01275ee22e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:12.972982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1cb98d85-0dc8-46f5-a5c4-fc01275ee22e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092255 Jun 02 19:26:12.973682 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1249/2509] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:13.587115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3e391fca-598c-4aee-a244-c44cab6d6ec6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:13.587858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3e391fca-598c-4aee-a244-c44cab6d6ec6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:13.595493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e391fca-598c-4aee-a244-c44cab6d6ec6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:13.595956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e391fca-598c-4aee-a244-c44cab6d6ec6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:13.596902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e391fca-598c-4aee-a244-c44cab6d6ec6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:13.597415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e391fca-598c-4aee-a244-c44cab6d6ec6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:13.745326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3e391fca-598c-4aee-a244-c44cab6d6ec6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:13.759160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3e391fca-598c-4aee-a244-c44cab6d6ec6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.175693 Jun 02 19:26:13.760155 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1261/2510] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:13 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:13.995555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5834750f-2cc6-49a8-85a8-1ccc3a585c0d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:13.996197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5834750f-2cc6-49a8-85a8-1ccc3a585c0d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:14.003225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5834750f-2cc6-49a8-85a8-1ccc3a585c0d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:14.004412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5834750f-2cc6-49a8-85a8-1ccc3a585c0d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:14.004781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5834750f-2cc6-49a8-85a8-1ccc3a585c0d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:14.005200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5834750f-2cc6-49a8-85a8-1ccc3a585c0d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:14.078573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5834750f-2cc6-49a8-85a8-1ccc3a585c0d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:14.087430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5834750f-2cc6-49a8-85a8-1ccc3a585c0d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095771 Jun 02 19:26:14.088044 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1250/2511] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:14.782605 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-833c9510-44ab-4b6f-80f9-528af202c04b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:14.783572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-833c9510-44ab-4b6f-80f9-528af202c04b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:14.791091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-833c9510-44ab-4b6f-80f9-528af202c04b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:14.791462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-833c9510-44ab-4b6f-80f9-528af202c04b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:14.792242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-833c9510-44ab-4b6f-80f9-528af202c04b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:14.792682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-833c9510-44ab-4b6f-80f9-528af202c04b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:14.932228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-833c9510-44ab-4b6f-80f9-528af202c04b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:14.941096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-833c9510-44ab-4b6f-80f9-528af202c04b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164089 Jun 02 19:26:14.941908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1262/2512] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:14 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:15.104240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d4bdc4dd-bc89-4b12-a946-bac4500fdeff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:15.104811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d4bdc4dd-bc89-4b12-a946-bac4500fdeff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:15.111864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4bdc4dd-bc89-4b12-a946-bac4500fdeff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:15.112309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4bdc4dd-bc89-4b12-a946-bac4500fdeff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:15.113224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4bdc4dd-bc89-4b12-a946-bac4500fdeff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:15.113658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d4bdc4dd-bc89-4b12-a946-bac4500fdeff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:15.177926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d4bdc4dd-bc89-4b12-a946-bac4500fdeff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:15.186888 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d4bdc4dd-bc89-4b12-a946-bac4500fdeff tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086287 Jun 02 19:26:15.187475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1251/2513] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:15.959473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-775f9f6c-f511-4ad0-af95-0813f4141d59 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:15.960066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-775f9f6c-f511-4ad0-af95-0813f4141d59 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:15.969427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-775f9f6c-f511-4ad0-af95-0813f4141d59 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:15.969903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-775f9f6c-f511-4ad0-af95-0813f4141d59 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:15.970676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-775f9f6c-f511-4ad0-af95-0813f4141d59 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:15.971108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-775f9f6c-f511-4ad0-af95-0813f4141d59 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:16.111568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-775f9f6c-f511-4ad0-af95-0813f4141d59 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:16.120643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-775f9f6c-f511-4ad0-af95-0813f4141d59 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165271 Jun 02 19:26:16.121216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1263/2514] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:15 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:16.210470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-13fafa7a-4ca2-4274-a736-3f7ae10184a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:16.211077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-13fafa7a-4ca2-4274-a736-3f7ae10184a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:16.218080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-13fafa7a-4ca2-4274-a736-3f7ae10184a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:16.218524 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-13fafa7a-4ca2-4274-a736-3f7ae10184a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:16.219285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-13fafa7a-4ca2-4274-a736-3f7ae10184a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:16.219711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-13fafa7a-4ca2-4274-a736-3f7ae10184a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:16.290432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-13fafa7a-4ca2-4274-a736-3f7ae10184a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:16.299397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-13fafa7a-4ca2-4274-a736-3f7ae10184a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.093317 Jun 02 19:26:16.299976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1252/2515] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:17.139928 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92413f6b-4810-44f9-b04c-580d46672476 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:17.140590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92413f6b-4810-44f9-b04c-580d46672476 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:17.149370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92413f6b-4810-44f9-b04c-580d46672476 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:17.149824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92413f6b-4810-44f9-b04c-580d46672476 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:17.150669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92413f6b-4810-44f9-b04c-580d46672476 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:17.151111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92413f6b-4810-44f9-b04c-580d46672476 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:17.289608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92413f6b-4810-44f9-b04c-580d46672476 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:17.298076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92413f6b-4810-44f9-b04c-580d46672476 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162191 Jun 02 19:26:17.298655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1264/2516] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:17 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:17.317274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-10f86abd-1fa5-44c5-95df-fccdcae77a90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:17.318072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-10f86abd-1fa5-44c5-95df-fccdcae77a90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:17.325248 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10f86abd-1fa5-44c5-95df-fccdcae77a90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:17.325679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10f86abd-1fa5-44c5-95df-fccdcae77a90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:17.326507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10f86abd-1fa5-44c5-95df-fccdcae77a90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:17.326937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-10f86abd-1fa5-44c5-95df-fccdcae77a90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:17.403659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-10f86abd-1fa5-44c5-95df-fccdcae77a90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:17.412801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-10f86abd-1fa5-44c5-95df-fccdcae77a90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.099655 Jun 02 19:26:17.413383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1253/2517] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:18.317677 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90abe0de-b38f-47fd-99a0-f48bb503b4d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:18.318353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-90abe0de-b38f-47fd-99a0-f48bb503b4d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:18.325762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90abe0de-b38f-47fd-99a0-f48bb503b4d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:18.326253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90abe0de-b38f-47fd-99a0-f48bb503b4d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:18.327035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90abe0de-b38f-47fd-99a0-f48bb503b4d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:18.327464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90abe0de-b38f-47fd-99a0-f48bb503b4d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:18.432737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dac9f353-c7d4-4b32-907f-f4fa155e729c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:18.433345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dac9f353-c7d4-4b32-907f-f4fa155e729c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:18.440250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dac9f353-c7d4-4b32-907f-f4fa155e729c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:18.440695 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dac9f353-c7d4-4b32-907f-f4fa155e729c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:18.442190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dac9f353-c7d4-4b32-907f-f4fa155e729c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:18.442626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dac9f353-c7d4-4b32-907f-f4fa155e729c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:18.469633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-90abe0de-b38f-47fd-99a0-f48bb503b4d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:18.479410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-90abe0de-b38f-47fd-99a0-f48bb503b4d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166884 Jun 02 19:26:18.487636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1265/2518] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:18 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:18.510205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dac9f353-c7d4-4b32-907f-f4fa155e729c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:18.520467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dac9f353-c7d4-4b32-907f-f4fa155e729c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092242 Jun 02 19:26:18.521624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1254/2519] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:19.497503 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78059025-dbe6-42af-bb69-83e552d64d35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:19.498249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78059025-dbe6-42af-bb69-83e552d64d35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:19.505472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78059025-dbe6-42af-bb69-83e552d64d35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:19.505963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78059025-dbe6-42af-bb69-83e552d64d35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:19.506749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78059025-dbe6-42af-bb69-83e552d64d35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:19.507189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78059025-dbe6-42af-bb69-83e552d64d35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:19.539125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cdc2623d-cd45-4844-8e7e-66d837b9a937 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:19.539904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cdc2623d-cd45-4844-8e7e-66d837b9a937 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:19.547173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdc2623d-cd45-4844-8e7e-66d837b9a937 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:19.547620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdc2623d-cd45-4844-8e7e-66d837b9a937 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:19.548392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdc2623d-cd45-4844-8e7e-66d837b9a937 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:19.548806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdc2623d-cd45-4844-8e7e-66d837b9a937 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:19.629358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cdc2623d-cd45-4844-8e7e-66d837b9a937 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:19.638590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cdc2623d-cd45-4844-8e7e-66d837b9a937 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.103985 Jun 02 19:26:19.639226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1255/2520] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:19.668747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-78059025-dbe6-42af-bb69-83e552d64d35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:19.678154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78059025-dbe6-42af-bb69-83e552d64d35 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.184457 Jun 02 19:26:19.678717 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1266/2521] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:19 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:20.656652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d3b4813a-1246-4058-9ba8-3e4c60e5ddd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:20.657273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d3b4813a-1246-4058-9ba8-3e4c60e5ddd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:20.664435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3b4813a-1246-4058-9ba8-3e4c60e5ddd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:20.664887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3b4813a-1246-4058-9ba8-3e4c60e5ddd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:20.665658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3b4813a-1246-4058-9ba8-3e4c60e5ddd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:20.666125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3b4813a-1246-4058-9ba8-3e4c60e5ddd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:20.696524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-71120c21-f4d7-4bf3-b012-77391856e373 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:20.697164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-71120c21-f4d7-4bf3-b012-77391856e373 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:20.705139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71120c21-f4d7-4bf3-b012-77391856e373 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:20.705609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71120c21-f4d7-4bf3-b012-77391856e373 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:20.706529 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71120c21-f4d7-4bf3-b012-77391856e373 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:20.707210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71120c21-f4d7-4bf3-b012-77391856e373 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:20.731962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d3b4813a-1246-4058-9ba8-3e4c60e5ddd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:20.740834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d3b4813a-1246-4058-9ba8-3e4c60e5ddd9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088071 Jun 02 19:26:20.741445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1256/2522] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:20.848047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-71120c21-f4d7-4bf3-b012-77391856e373 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:20.857004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-71120c21-f4d7-4bf3-b012-77391856e373 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164202 Jun 02 19:26:20.857607 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1267/2523] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:20 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:21.758908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c32fd068-a5c4-47e3-b8aa-bb8e87f5a72e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:21.759553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c32fd068-a5c4-47e3-b8aa-bb8e87f5a72e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:21.766656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c32fd068-a5c4-47e3-b8aa-bb8e87f5a72e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:21.767099 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c32fd068-a5c4-47e3-b8aa-bb8e87f5a72e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:21.767902 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c32fd068-a5c4-47e3-b8aa-bb8e87f5a72e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:21.768322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c32fd068-a5c4-47e3-b8aa-bb8e87f5a72e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:21.843520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c32fd068-a5c4-47e3-b8aa-bb8e87f5a72e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:21.852984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c32fd068-a5c4-47e3-b8aa-bb8e87f5a72e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098156 Jun 02 19:26:21.853926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1257/2524] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:21.875403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d6c5fb27-8230-466f-92ce-78ddcb6d5462 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:21.876045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d6c5fb27-8230-466f-92ce-78ddcb6d5462 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:21.887368 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6c5fb27-8230-466f-92ce-78ddcb6d5462 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:21.887827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6c5fb27-8230-466f-92ce-78ddcb6d5462 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:21.888587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6c5fb27-8230-466f-92ce-78ddcb6d5462 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:21.889043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6c5fb27-8230-466f-92ce-78ddcb6d5462 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:22.036566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d6c5fb27-8230-466f-92ce-78ddcb6d5462 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:22.045963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d6c5fb27-8230-466f-92ce-78ddcb6d5462 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174562 Jun 02 19:26:22.046861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1268/2525] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:21 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:22.871887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7938bec8-c7a6-4008-b32d-4c9ec7e1a362 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:22.872569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7938bec8-c7a6-4008-b32d-4c9ec7e1a362 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:22.880640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7938bec8-c7a6-4008-b32d-4c9ec7e1a362 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:22.881082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7938bec8-c7a6-4008-b32d-4c9ec7e1a362 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:22.881871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7938bec8-c7a6-4008-b32d-4c9ec7e1a362 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:22.882299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7938bec8-c7a6-4008-b32d-4c9ec7e1a362 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:22.951167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7938bec8-c7a6-4008-b32d-4c9ec7e1a362 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:22.961664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7938bec8-c7a6-4008-b32d-4c9ec7e1a362 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.093807 Jun 02 19:26:22.962295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1258/2526] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:23.073523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7c10a605-157c-4397-b513-b203cbad38ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:23.074208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7c10a605-157c-4397-b513-b203cbad38ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:23.081451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c10a605-157c-4397-b513-b203cbad38ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:23.082004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c10a605-157c-4397-b513-b203cbad38ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:23.083089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c10a605-157c-4397-b513-b203cbad38ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:23.083711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c10a605-157c-4397-b513-b203cbad38ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:23.234596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7c10a605-157c-4397-b513-b203cbad38ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:23.242888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7c10a605-157c-4397-b513-b203cbad38ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.175519 Jun 02 19:26:23.243437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1269/2527] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:23 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:23.980586 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-33ce0a56-44b9-4335-b038-a7c1f6ec161c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:23.981217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-33ce0a56-44b9-4335-b038-a7c1f6ec161c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:23.988335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-33ce0a56-44b9-4335-b038-a7c1f6ec161c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:23.988854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-33ce0a56-44b9-4335-b038-a7c1f6ec161c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:23.989628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-33ce0a56-44b9-4335-b038-a7c1f6ec161c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:23.990093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-33ce0a56-44b9-4335-b038-a7c1f6ec161c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:24.059126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-33ce0a56-44b9-4335-b038-a7c1f6ec161c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:24.068311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-33ce0a56-44b9-4335-b038-a7c1f6ec161c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091561 Jun 02 19:26:24.068853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1259/2528] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:24.261487 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-35a5945b-051e-43a5-890f-66074bb373ec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:24.262112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-35a5945b-051e-43a5-890f-66074bb373ec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:24.269754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35a5945b-051e-43a5-890f-66074bb373ec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:24.270257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35a5945b-051e-43a5-890f-66074bb373ec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:24.271037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35a5945b-051e-43a5-890f-66074bb373ec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:24.271475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35a5945b-051e-43a5-890f-66074bb373ec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:24.409299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-35a5945b-051e-43a5-890f-66074bb373ec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:24.418268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-35a5945b-051e-43a5-890f-66074bb373ec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160741 Jun 02 19:26:24.418854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1270/2529] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:24 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:25.085314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fcd4e44b-af07-44fc-85ce-18a656ebbf03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:25.085970 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fcd4e44b-af07-44fc-85ce-18a656ebbf03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:25.093491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fcd4e44b-af07-44fc-85ce-18a656ebbf03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:25.093972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fcd4e44b-af07-44fc-85ce-18a656ebbf03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:25.094733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fcd4e44b-af07-44fc-85ce-18a656ebbf03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:25.095163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fcd4e44b-af07-44fc-85ce-18a656ebbf03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:25.098697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:25.164304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fcd4e44b-af07-44fc-85ce-18a656ebbf03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:25.173623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fcd4e44b-af07-44fc-85ce-18a656ebbf03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092328 Jun 02 19:26:25.174212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1260/2530] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:25.436563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-17d24862-f2ed-414e-96bb-3dc5d2c41ba8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:25.437242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-17d24862-f2ed-414e-96bb-3dc5d2c41ba8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:25.444855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17d24862-f2ed-414e-96bb-3dc5d2c41ba8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:25.445316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17d24862-f2ed-414e-96bb-3dc5d2c41ba8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:25.446132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17d24862-f2ed-414e-96bb-3dc5d2c41ba8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:25.446579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17d24862-f2ed-414e-96bb-3dc5d2c41ba8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:25.476857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:26:25.477134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a (ip 10.222.0.15) !!! Jun 02 19:26:25.587970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-17d24862-f2ed-414e-96bb-3dc5d2c41ba8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:25.599078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-17d24862-f2ed-414e-96bb-3dc5d2c41ba8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166669 Jun 02 19:26:25.599968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1271/2531] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:25 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:26.191819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b9f2329-2acd-4fa6-a588-8ef6f7f5bcb6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:26.192462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b9f2329-2acd-4fa6-a588-8ef6f7f5bcb6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:26.199846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b9f2329-2acd-4fa6-a588-8ef6f7f5bcb6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:26.200341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b9f2329-2acd-4fa6-a588-8ef6f7f5bcb6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:26.201056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b9f2329-2acd-4fa6-a588-8ef6f7f5bcb6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:26.201481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b9f2329-2acd-4fa6-a588-8ef6f7f5bcb6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:26.269282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3b9f2329-2acd-4fa6-a588-8ef6f7f5bcb6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:26.278161 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b9f2329-2acd-4fa6-a588-8ef6f7f5bcb6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090234 Jun 02 19:26:26.278745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1261/2532] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:26.618818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f55b4fb1-2301-470e-b91c-250fceb93775 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:26.619530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f55b4fb1-2301-470e-b91c-250fceb93775 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:26.629707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f55b4fb1-2301-470e-b91c-250fceb93775 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:26.630243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f55b4fb1-2301-470e-b91c-250fceb93775 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:26.631063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f55b4fb1-2301-470e-b91c-250fceb93775 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:26.631497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f55b4fb1-2301-470e-b91c-250fceb93775 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:26.772253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f55b4fb1-2301-470e-b91c-250fceb93775 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:26.780901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f55b4fb1-2301-470e-b91c-250fceb93775 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166204 Jun 02 19:26:26.781757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1272/2533] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:26 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:27.296624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3ef83ad2-adc5-4e65-bdaa-ed375ee301c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:27.297205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ef83ad2-adc5-4e65-bdaa-ed375ee301c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:27.304337 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ef83ad2-adc5-4e65-bdaa-ed375ee301c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:27.304781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ef83ad2-adc5-4e65-bdaa-ed375ee301c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:27.305601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ef83ad2-adc5-4e65-bdaa-ed375ee301c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:27.306064 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ef83ad2-adc5-4e65-bdaa-ed375ee301c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:27.374521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3ef83ad2-adc5-4e65-bdaa-ed375ee301c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:27.383842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3ef83ad2-adc5-4e65-bdaa-ed375ee301c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091134 Jun 02 19:26:27.384429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1262/2534] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:27.798887 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fed5517d-ff0f-49e1-9a9b-51c00cebef94 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:27.799531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fed5517d-ff0f-49e1-9a9b-51c00cebef94 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:27.806920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fed5517d-ff0f-49e1-9a9b-51c00cebef94 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:27.807378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fed5517d-ff0f-49e1-9a9b-51c00cebef94 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:27.808158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fed5517d-ff0f-49e1-9a9b-51c00cebef94 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:27.808597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fed5517d-ff0f-49e1-9a9b-51c00cebef94 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:27.956087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fed5517d-ff0f-49e1-9a9b-51c00cebef94 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:27.965630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fed5517d-ff0f-49e1-9a9b-51c00cebef94 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.170561 Jun 02 19:26:27.966254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1273/2535] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:27 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:28.402190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4962f7bc-b540-4066-ad0c-0a3b8f589764 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:28.402831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4962f7bc-b540-4066-ad0c-0a3b8f589764 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:28.410459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4962f7bc-b540-4066-ad0c-0a3b8f589764 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:28.410878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4962f7bc-b540-4066-ad0c-0a3b8f589764 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:28.411668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4962f7bc-b540-4066-ad0c-0a3b8f589764 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:28.412090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4962f7bc-b540-4066-ad0c-0a3b8f589764 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:28.486389 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4962f7bc-b540-4066-ad0c-0a3b8f589764 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:28.495845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4962f7bc-b540-4066-ad0c-0a3b8f589764 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097744 Jun 02 19:26:28.496443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1263/2536] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:28.984540 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8ed342bb-4f77-4731-872e-d382c02b7ddf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:28.985184 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8ed342bb-4f77-4731-872e-d382c02b7ddf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:28.993491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ed342bb-4f77-4731-872e-d382c02b7ddf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:28.993971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ed342bb-4f77-4731-872e-d382c02b7ddf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:28.994751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ed342bb-4f77-4731-872e-d382c02b7ddf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:28.995195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ed342bb-4f77-4731-872e-d382c02b7ddf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:29.143535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ed342bb-4f77-4731-872e-d382c02b7ddf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:29.156163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8ed342bb-4f77-4731-872e-d382c02b7ddf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.176158 Jun 02 19:26:29.157050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1274/2537] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:28 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:29.513921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ac4ae2a-bd32-4040-8ce9-8c5914f7fbde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:29.514548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5ac4ae2a-bd32-4040-8ce9-8c5914f7fbde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:29.522159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ac4ae2a-bd32-4040-8ce9-8c5914f7fbde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:29.522603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ac4ae2a-bd32-4040-8ce9-8c5914f7fbde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:29.523392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ac4ae2a-bd32-4040-8ce9-8c5914f7fbde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:29.523817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ac4ae2a-bd32-4040-8ce9-8c5914f7fbde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:29.591837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ac4ae2a-bd32-4040-8ce9-8c5914f7fbde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:29.600492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ac4ae2a-bd32-4040-8ce9-8c5914f7fbde tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090556 Jun 02 19:26:29.601483 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1264/2538] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:29.959755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:26:29.959755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:26:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:26:30.174632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-51a49d45-b0b2-43db-8644-e0a1621c5cfe tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:30.175292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-51a49d45-b0b2-43db-8644-e0a1621c5cfe tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:30.182479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-51a49d45-b0b2-43db-8644-e0a1621c5cfe tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:30.182925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-51a49d45-b0b2-43db-8644-e0a1621c5cfe tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:30.183696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-51a49d45-b0b2-43db-8644-e0a1621c5cfe tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:30.184106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-51a49d45-b0b2-43db-8644-e0a1621c5cfe tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:30.559434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-51a49d45-b0b2-43db-8644-e0a1621c5cfe tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:30.568255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-51a49d45-b0b2-43db-8644-e0a1621c5cfe tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.397524 Jun 02 19:26:30.569007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1275/2539] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:30 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:30.618469 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-12e8e97e-1110-44b5-85fb-b267fd802322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:30.619083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-12e8e97e-1110-44b5-85fb-b267fd802322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:30.625909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12e8e97e-1110-44b5-85fb-b267fd802322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:30.626375 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12e8e97e-1110-44b5-85fb-b267fd802322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:30.627129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12e8e97e-1110-44b5-85fb-b267fd802322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:30.627571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12e8e97e-1110-44b5-85fb-b267fd802322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:30.695003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-12e8e97e-1110-44b5-85fb-b267fd802322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:30.707276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-12e8e97e-1110-44b5-85fb-b267fd802322 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092638 Jun 02 19:26:30.708145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1265/2540] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:26:31.585580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aa42bae2-738d-49af-9a68-0f2ff53f080b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:31.586244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-aa42bae2-738d-49af-9a68-0f2ff53f080b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:31.593414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa42bae2-738d-49af-9a68-0f2ff53f080b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:31.593898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa42bae2-738d-49af-9a68-0f2ff53f080b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:31.594680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa42bae2-738d-49af-9a68-0f2ff53f080b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:31.595118 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa42bae2-738d-49af-9a68-0f2ff53f080b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:31.614831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:31.731015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-96d6cd4b-a310-44f6-9e8e-1e5a2e4b8cee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:31.731630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-96d6cd4b-a310-44f6-9e8e-1e5a2e4b8cee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:31.738089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-aa42bae2-738d-49af-9a68-0f2ff53f080b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:31.738751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96d6cd4b-a310-44f6-9e8e-1e5a2e4b8cee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:31.739276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96d6cd4b-a310-44f6-9e8e-1e5a2e4b8cee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:31.740125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96d6cd4b-a310-44f6-9e8e-1e5a2e4b8cee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:31.740839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-96d6cd4b-a310-44f6-9e8e-1e5a2e4b8cee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:31.748752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-aa42bae2-738d-49af-9a68-0f2ff53f080b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167091 Jun 02 19:26:31.749311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1276/2541] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:31 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:31.807998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-96d6cd4b-a310-44f6-9e8e-1e5a2e4b8cee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:31.818236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-96d6cd4b-a310-44f6-9e8e-1e5a2e4b8cee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090844 Jun 02 19:26:31.819148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1266/2542] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:32.766810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-88d7afa6-db3f-400f-bc43-8dcace8fbf31 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:32.767433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-88d7afa6-db3f-400f-bc43-8dcace8fbf31 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:32.769888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=52 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:32.778137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88d7afa6-db3f-400f-bc43-8dcace8fbf31 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:32.778882 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88d7afa6-db3f-400f-bc43-8dcace8fbf31 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:32.779784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88d7afa6-db3f-400f-bc43-8dcace8fbf31 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:32.780221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-88d7afa6-db3f-400f-bc43-8dcace8fbf31 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:32.836233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1fdd7f6b-689c-407e-a46b-c1c70395887d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:32.836822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1fdd7f6b-689c-407e-a46b-c1c70395887d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:32.843395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fdd7f6b-689c-407e-a46b-c1c70395887d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:32.843836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fdd7f6b-689c-407e-a46b-c1c70395887d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:32.844610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fdd7f6b-689c-407e-a46b-c1c70395887d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:32.845032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1fdd7f6b-689c-407e-a46b-c1c70395887d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:32.918390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1fdd7f6b-689c-407e-a46b-c1c70395887d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:32.927279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1fdd7f6b-689c-407e-a46b-c1c70395887d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095001 Jun 02 19:26:32.927871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1267/2543] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:26:32.942531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-88d7afa6-db3f-400f-bc43-8dcace8fbf31 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:32.951168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-88d7afa6-db3f-400f-bc43-8dcace8fbf31 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.188355 Jun 02 19:26:32.951756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1277/2544] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:32 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:33.945509 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3476fa06-30da-45a7-832e-811a3f9dd1c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:33.946291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3476fa06-30da-45a7-832e-811a3f9dd1c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:33.953999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3476fa06-30da-45a7-832e-811a3f9dd1c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:33.954493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3476fa06-30da-45a7-832e-811a3f9dd1c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:33.955264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3476fa06-30da-45a7-832e-811a3f9dd1c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:33.955704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3476fa06-30da-45a7-832e-811a3f9dd1c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:33.970746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-889fa9e5-0b9d-49ec-822d-8ff8a28c2bf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:33.971599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-889fa9e5-0b9d-49ec-822d-8ff8a28c2bf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:33.978447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-889fa9e5-0b9d-49ec-822d-8ff8a28c2bf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:33.978909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-889fa9e5-0b9d-49ec-822d-8ff8a28c2bf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:33.979796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-889fa9e5-0b9d-49ec-822d-8ff8a28c2bf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:33.980244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-889fa9e5-0b9d-49ec-822d-8ff8a28c2bf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:34.039806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3476fa06-30da-45a7-832e-811a3f9dd1c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:34.050014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3476fa06-30da-45a7-832e-811a3f9dd1c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.108653 Jun 02 19:26:34.053846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1268/2545] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:34.142124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-889fa9e5-0b9d-49ec-822d-8ff8a28c2bf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:34.151336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-889fa9e5-0b9d-49ec-822d-8ff8a28c2bf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.185328 Jun 02 19:26:34.151954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1278/2546] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:33 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:35.068072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2c53e7c9-ce82-4e23-93c9-59eb6a675594 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:35.068803 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2c53e7c9-ce82-4e23-93c9-59eb6a675594 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:35.076135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c53e7c9-ce82-4e23-93c9-59eb6a675594 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:35.076587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c53e7c9-ce82-4e23-93c9-59eb6a675594 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:35.077351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c53e7c9-ce82-4e23-93c9-59eb6a675594 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:35.077779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c53e7c9-ce82-4e23-93c9-59eb6a675594 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:35.144408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2c53e7c9-ce82-4e23-93c9-59eb6a675594 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:35.153363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2c53e7c9-ce82-4e23-93c9-59eb6a675594 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089235 Jun 02 19:26:35.153976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1269/2547] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:35.169077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e239d568-90bc-430e-a940-540e6cf2fbc6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:35.169692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e239d568-90bc-430e-a940-540e6cf2fbc6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:35.176530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e239d568-90bc-430e-a940-540e6cf2fbc6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:35.177059 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e239d568-90bc-430e-a940-540e6cf2fbc6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:35.177739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e239d568-90bc-430e-a940-540e6cf2fbc6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:35.178259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e239d568-90bc-430e-a940-540e6cf2fbc6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:35.336339 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e239d568-90bc-430e-a940-540e6cf2fbc6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:35.344710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e239d568-90bc-430e-a940-540e6cf2fbc6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.179527 Jun 02 19:26:35.345488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1279/2548] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:35 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:36.170767 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cc7d27fc-b912-4086-b277-256796794536 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:36.171401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cc7d27fc-b912-4086-b277-256796794536 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:36.179534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc7d27fc-b912-4086-b277-256796794536 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:36.179989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc7d27fc-b912-4086-b277-256796794536 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:36.180753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc7d27fc-b912-4086-b277-256796794536 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:36.181170 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc7d27fc-b912-4086-b277-256796794536 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:36.247451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cc7d27fc-b912-4086-b277-256796794536 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:36.256344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cc7d27fc-b912-4086-b277-256796794536 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089354 Jun 02 19:26:36.256930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1270/2549] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:36.364231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b4b15a3b-53aa-4dd3-bc5d-d0234d48e225 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:36.364863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b4b15a3b-53aa-4dd3-bc5d-d0234d48e225 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:36.372431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4b15a3b-53aa-4dd3-bc5d-d0234d48e225 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:36.372874 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4b15a3b-53aa-4dd3-bc5d-d0234d48e225 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:36.373657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4b15a3b-53aa-4dd3-bc5d-d0234d48e225 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:36.374121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4b15a3b-53aa-4dd3-bc5d-d0234d48e225 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:36.525016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b4b15a3b-53aa-4dd3-bc5d-d0234d48e225 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:36.534969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b4b15a3b-53aa-4dd3-bc5d-d0234d48e225 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.176135 Jun 02 19:26:36.536140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1280/2550] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:36 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:37.274687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ff64ad4-461a-4e46-9686-2063afd8f997 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:37.275304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5ff64ad4-461a-4e46-9686-2063afd8f997 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:37.282881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ff64ad4-461a-4e46-9686-2063afd8f997 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:37.283336 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ff64ad4-461a-4e46-9686-2063afd8f997 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:37.284473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ff64ad4-461a-4e46-9686-2063afd8f997 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:37.285227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ff64ad4-461a-4e46-9686-2063afd8f997 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:37.359554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ff64ad4-461a-4e46-9686-2063afd8f997 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:37.374215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ff64ad4-461a-4e46-9686-2063afd8f997 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.103548 Jun 02 19:26:37.374802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1271/2551] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:37.553782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cc1af61e-50c3-4e4f-9102-604e1f806d40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:37.554501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cc1af61e-50c3-4e4f-9102-604e1f806d40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:37.562122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc1af61e-50c3-4e4f-9102-604e1f806d40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:37.562578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc1af61e-50c3-4e4f-9102-604e1f806d40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:37.563363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc1af61e-50c3-4e4f-9102-604e1f806d40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:37.563800 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc1af61e-50c3-4e4f-9102-604e1f806d40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:37.715859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cc1af61e-50c3-4e4f-9102-604e1f806d40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:37.724471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cc1af61e-50c3-4e4f-9102-604e1f806d40 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174550 Jun 02 19:26:37.725061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1281/2552] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:37 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:38.396877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6cf1f522-d1dd-44ac-aa47-13314c816d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:38.397512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6cf1f522-d1dd-44ac-aa47-13314c816d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:38.400000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=56 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:38.405835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cf1f522-d1dd-44ac-aa47-13314c816d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:38.406442 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cf1f522-d1dd-44ac-aa47-13314c816d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:38.407204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cf1f522-d1dd-44ac-aa47-13314c816d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:38.407631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6cf1f522-d1dd-44ac-aa47-13314c816d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:38.474295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6cf1f522-d1dd-44ac-aa47-13314c816d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:38.482638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6cf1f522-d1dd-44ac-aa47-13314c816d27 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089653 Jun 02 19:26:38.483205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1272/2553] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:38.743365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a0786c66-1825-4017-a676-67c20a660932 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:38.743941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a0786c66-1825-4017-a676-67c20a660932 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:38.751103 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0786c66-1825-4017-a676-67c20a660932 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:38.751768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0786c66-1825-4017-a676-67c20a660932 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:38.752560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0786c66-1825-4017-a676-67c20a660932 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:38.753006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0786c66-1825-4017-a676-67c20a660932 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:38.896591 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a0786c66-1825-4017-a676-67c20a660932 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:38.907745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a0786c66-1825-4017-a676-67c20a660932 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168632 Jun 02 19:26:38.908471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1282/2554] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:38 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:39.500312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c5db875f-1d12-4811-b4cc-79011e55cfc1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:39.501094 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c5db875f-1d12-4811-b4cc-79011e55cfc1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:39.510647 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5db875f-1d12-4811-b4cc-79011e55cfc1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:39.511091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5db875f-1d12-4811-b4cc-79011e55cfc1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:39.511845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5db875f-1d12-4811-b4cc-79011e55cfc1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:39.512273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5db875f-1d12-4811-b4cc-79011e55cfc1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:39.582813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c5db875f-1d12-4811-b4cc-79011e55cfc1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:39.591849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c5db875f-1d12-4811-b4cc-79011e55cfc1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095360 Jun 02 19:26:39.592459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1273/2555] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:39.926935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2e67f8e9-7029-4a6e-95cb-e5637d17fb68 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:39.927531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2e67f8e9-7029-4a6e-95cb-e5637d17fb68 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:39.934796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e67f8e9-7029-4a6e-95cb-e5637d17fb68 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:39.935251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e67f8e9-7029-4a6e-95cb-e5637d17fb68 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:39.936372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e67f8e9-7029-4a6e-95cb-e5637d17fb68 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:39.936805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2e67f8e9-7029-4a6e-95cb-e5637d17fb68 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:40.074762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2e67f8e9-7029-4a6e-95cb-e5637d17fb68 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:40.083958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2e67f8e9-7029-4a6e-95cb-e5637d17fb68 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161007 Jun 02 19:26:40.084560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1283/2556] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:39 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:40.611323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-359c24cd-8443-4563-8a69-fa5a2be7ebfc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:40.611965 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-359c24cd-8443-4563-8a69-fa5a2be7ebfc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:40.618857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-359c24cd-8443-4563-8a69-fa5a2be7ebfc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:40.619301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-359c24cd-8443-4563-8a69-fa5a2be7ebfc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:40.620246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-359c24cd-8443-4563-8a69-fa5a2be7ebfc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:40.620683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-359c24cd-8443-4563-8a69-fa5a2be7ebfc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:40.691125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-359c24cd-8443-4563-8a69-fa5a2be7ebfc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:40.702903 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-359c24cd-8443-4563-8a69-fa5a2be7ebfc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.096842 Jun 02 19:26:40.703485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1274/2557] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:41.105442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d4772217-12a0-4fce-a275-d3c0d05b15bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:41.106058 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d4772217-12a0-4fce-a275-d3c0d05b15bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:41.113202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4772217-12a0-4fce-a275-d3c0d05b15bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:41.113687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4772217-12a0-4fce-a275-d3c0d05b15bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:41.114499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4772217-12a0-4fce-a275-d3c0d05b15bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:41.114936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4772217-12a0-4fce-a275-d3c0d05b15bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:41.268810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d4772217-12a0-4fce-a275-d3c0d05b15bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:41.278181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d4772217-12a0-4fce-a275-d3c0d05b15bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.177227 Jun 02 19:26:41.278674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1284/2558] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:41 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:41.721742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-df2bd09b-46f7-4048-bb33-55511a116115 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:41.722420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-df2bd09b-46f7-4048-bb33-55511a116115 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:41.730136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df2bd09b-46f7-4048-bb33-55511a116115 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:41.730604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df2bd09b-46f7-4048-bb33-55511a116115 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:41.731356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df2bd09b-46f7-4048-bb33-55511a116115 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:41.731811 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df2bd09b-46f7-4048-bb33-55511a116115 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:41.799207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-df2bd09b-46f7-4048-bb33-55511a116115 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:41.808131 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-df2bd09b-46f7-4048-bb33-55511a116115 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090301 Jun 02 19:26:41.808702 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1275/2559] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:42.296228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ac3dc7c2-3bdb-4cce-9244-a9dac603fb22 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:42.296883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ac3dc7c2-3bdb-4cce-9244-a9dac603fb22 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:42.308298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac3dc7c2-3bdb-4cce-9244-a9dac603fb22 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:42.309067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac3dc7c2-3bdb-4cce-9244-a9dac603fb22 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:42.310397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac3dc7c2-3bdb-4cce-9244-a9dac603fb22 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:42.311452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac3dc7c2-3bdb-4cce-9244-a9dac603fb22 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:42.455447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ac3dc7c2-3bdb-4cce-9244-a9dac603fb22 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:42.466251 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ac3dc7c2-3bdb-4cce-9244-a9dac603fb22 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.173829 Jun 02 19:26:42.466939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1285/2560] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:42 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:42.825997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-93ea6fb0-c750-4260-8060-d9c0e1303b2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:42.826629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-93ea6fb0-c750-4260-8060-d9c0e1303b2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:42.834359 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93ea6fb0-c750-4260-8060-d9c0e1303b2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:42.834833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93ea6fb0-c750-4260-8060-d9c0e1303b2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:42.835592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93ea6fb0-c750-4260-8060-d9c0e1303b2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:42.836116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93ea6fb0-c750-4260-8060-d9c0e1303b2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:42.900042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-93ea6fb0-c750-4260-8060-d9c0e1303b2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:42.902317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:42.910192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-93ea6fb0-c750-4260-8060-d9c0e1303b2f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088239 Jun 02 19:26:42.910763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1276/2561] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:43.486757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9277c44f-4df5-4f9a-af1a-a1a0cd17fce5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:43.487710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9277c44f-4df5-4f9a-af1a-a1a0cd17fce5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:43.495237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9277c44f-4df5-4f9a-af1a-a1a0cd17fce5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:43.495695 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9277c44f-4df5-4f9a-af1a-a1a0cd17fce5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:43.496479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9277c44f-4df5-4f9a-af1a-a1a0cd17fce5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:43.496917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9277c44f-4df5-4f9a-af1a-a1a0cd17fce5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:43.639351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9277c44f-4df5-4f9a-af1a-a1a0cd17fce5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:43.647932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9277c44f-4df5-4f9a-af1a-a1a0cd17fce5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166042 Jun 02 19:26:43.648617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1286/2562] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:43 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:43.931366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b22a1f0f-47f0-40cd-8c89-0b5f10fecb9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:43.931987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b22a1f0f-47f0-40cd-8c89-0b5f10fecb9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:43.941143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b22a1f0f-47f0-40cd-8c89-0b5f10fecb9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:43.941588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b22a1f0f-47f0-40cd-8c89-0b5f10fecb9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:43.942387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b22a1f0f-47f0-40cd-8c89-0b5f10fecb9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:43.942810 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b22a1f0f-47f0-40cd-8c89-0b5f10fecb9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:44.016801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b22a1f0f-47f0-40cd-8c89-0b5f10fecb9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:44.027180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b22a1f0f-47f0-40cd-8c89-0b5f10fecb9b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.101258 Jun 02 19:26:44.027739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1277/2563] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:44.664949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-30ca4931-c773-41ab-90fb-66356737bc9b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:44.665585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-30ca4931-c773-41ab-90fb-66356737bc9b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:44.673110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-30ca4931-c773-41ab-90fb-66356737bc9b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:44.673595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-30ca4931-c773-41ab-90fb-66356737bc9b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:44.674400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-30ca4931-c773-41ab-90fb-66356737bc9b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:44.674838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-30ca4931-c773-41ab-90fb-66356737bc9b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:44.823936 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-30ca4931-c773-41ab-90fb-66356737bc9b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:44.835498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-30ca4931-c773-41ab-90fb-66356737bc9b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174231 Jun 02 19:26:44.836532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1287/2564] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:44 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:45.044992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-781386d5-ff09-462f-8729-712ac4343ae6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:45.045587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-781386d5-ff09-462f-8729-712ac4343ae6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:45.052734 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-781386d5-ff09-462f-8729-712ac4343ae6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:45.053183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-781386d5-ff09-462f-8729-712ac4343ae6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:45.054007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-781386d5-ff09-462f-8729-712ac4343ae6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:45.054438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-781386d5-ff09-462f-8729-712ac4343ae6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:45.123444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-781386d5-ff09-462f-8729-712ac4343ae6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:45.134733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-781386d5-ff09-462f-8729-712ac4343ae6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.093826 Jun 02 19:26:45.135576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1278/2565] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:45.855268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fde48c7e-9083-48e6-9205-197bfa4aaac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:45.856062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fde48c7e-9083-48e6-9205-197bfa4aaac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:45.862963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fde48c7e-9083-48e6-9205-197bfa4aaac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:45.863422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fde48c7e-9083-48e6-9205-197bfa4aaac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:45.864196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fde48c7e-9083-48e6-9205-197bfa4aaac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:45.864637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fde48c7e-9083-48e6-9205-197bfa4aaac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:46.004113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fde48c7e-9083-48e6-9205-197bfa4aaac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:46.012883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fde48c7e-9083-48e6-9205-197bfa4aaac5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161885 Jun 02 19:26:46.013452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1288/2566] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:45 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:46.153431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-07e620d8-63d2-4ed3-ae8f-e0d86b733df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:46.154079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-07e620d8-63d2-4ed3-ae8f-e0d86b733df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:46.161211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07e620d8-63d2-4ed3-ae8f-e0d86b733df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:46.161666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07e620d8-63d2-4ed3-ae8f-e0d86b733df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:46.162488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07e620d8-63d2-4ed3-ae8f-e0d86b733df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:46.162899 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07e620d8-63d2-4ed3-ae8f-e0d86b733df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:46.230661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-07e620d8-63d2-4ed3-ae8f-e0d86b733df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:46.239607 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-07e620d8-63d2-4ed3-ae8f-e0d86b733df5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090143 Jun 02 19:26:46.240183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1279/2567] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:47.166693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-62e35dbe-0613-40e7-b7a9-75e3057f6687 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:47.167320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-62e35dbe-0613-40e7-b7a9-75e3057f6687 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:47.173986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62e35dbe-0613-40e7-b7a9-75e3057f6687 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:47.174424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62e35dbe-0613-40e7-b7a9-75e3057f6687 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:47.175187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62e35dbe-0613-40e7-b7a9-75e3057f6687 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:47.175625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-62e35dbe-0613-40e7-b7a9-75e3057f6687 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:47.256623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9b79bd89-2e5b-446d-bf04-c1787cf06044 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:47.257211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9b79bd89-2e5b-446d-bf04-c1787cf06044 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:47.265464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b79bd89-2e5b-446d-bf04-c1787cf06044 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:47.266000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b79bd89-2e5b-446d-bf04-c1787cf06044 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:47.266813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b79bd89-2e5b-446d-bf04-c1787cf06044 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:47.267242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b79bd89-2e5b-446d-bf04-c1787cf06044 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:47.346354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9b79bd89-2e5b-446d-bf04-c1787cf06044 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:47.349821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-62e35dbe-0613-40e7-b7a9-75e3057f6687 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:47.357354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9b79bd89-2e5b-446d-bf04-c1787cf06044 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.102682 Jun 02 19:26:47.357354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1280/2568] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:26:47.358366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-62e35dbe-0613-40e7-b7a9-75e3057f6687 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.329325 Jun 02 19:26:47.359154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1289/2569] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:47 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:48.373457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1c5fd015-4082-481b-9288-d75da5ae2df3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:48.374267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1c5fd015-4082-481b-9288-d75da5ae2df3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:48.375900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3a858154-53ac-4fff-979c-c3e04477212a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:48.376582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a858154-53ac-4fff-979c-c3e04477212a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:48.381074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c5fd015-4082-481b-9288-d75da5ae2df3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:48.381521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c5fd015-4082-481b-9288-d75da5ae2df3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:48.382353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c5fd015-4082-481b-9288-d75da5ae2df3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:48.382781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c5fd015-4082-481b-9288-d75da5ae2df3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:48.383611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a858154-53ac-4fff-979c-c3e04477212a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:48.384358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a858154-53ac-4fff-979c-c3e04477212a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:48.385205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a858154-53ac-4fff-979c-c3e04477212a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:48.385642 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a858154-53ac-4fff-979c-c3e04477212a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:48.474165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1c5fd015-4082-481b-9288-d75da5ae2df3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:48.484722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1c5fd015-4082-481b-9288-d75da5ae2df3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.115081 Jun 02 19:26:48.485637 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1281/2570] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:48.550789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a858154-53ac-4fff-979c-c3e04477212a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:48.559804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3a858154-53ac-4fff-979c-c3e04477212a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.187773 Jun 02 19:26:48.560393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1290/2571] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:48 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:49.502977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-afb2a317-fe5c-43a5-9f3b-63cb1ef5cb78 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:49.503613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-afb2a317-fe5c-43a5-9f3b-63cb1ef5cb78 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:49.511331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afb2a317-fe5c-43a5-9f3b-63cb1ef5cb78 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:49.511781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afb2a317-fe5c-43a5-9f3b-63cb1ef5cb78 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:49.512539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afb2a317-fe5c-43a5-9f3b-63cb1ef5cb78 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:49.512999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afb2a317-fe5c-43a5-9f3b-63cb1ef5cb78 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:49.577218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ac6f384e-9c1b-4fdd-bf43-af262b20ab25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:49.577885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ac6f384e-9c1b-4fdd-bf43-af262b20ab25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:49.584615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-afb2a317-fe5c-43a5-9f3b-63cb1ef5cb78 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:49.584957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac6f384e-9c1b-4fdd-bf43-af262b20ab25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:49.585424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac6f384e-9c1b-4fdd-bf43-af262b20ab25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:49.586243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac6f384e-9c1b-4fdd-bf43-af262b20ab25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:49.586671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac6f384e-9c1b-4fdd-bf43-af262b20ab25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:49.593299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-afb2a317-fe5c-43a5-9f3b-63cb1ef5cb78 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094146 Jun 02 19:26:49.593916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1282/2572] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:49.727110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ac6f384e-9c1b-4fdd-bf43-af262b20ab25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:49.736151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ac6f384e-9c1b-4fdd-bf43-af262b20ab25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162961 Jun 02 19:26:49.736736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1291/2573] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:49 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:50.611461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14a900b1-41ca-414f-8ae9-64508ede4977 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:50.612047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14a900b1-41ca-414f-8ae9-64508ede4977 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:50.619315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14a900b1-41ca-414f-8ae9-64508ede4977 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:50.619927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14a900b1-41ca-414f-8ae9-64508ede4977 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:50.620994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14a900b1-41ca-414f-8ae9-64508ede4977 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:50.621470 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14a900b1-41ca-414f-8ae9-64508ede4977 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:50.685699 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-14a900b1-41ca-414f-8ae9-64508ede4977 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:50.695504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14a900b1-41ca-414f-8ae9-64508ede4977 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088740 Jun 02 19:26:50.696380 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1283/2574] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:50.755415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f2bafcf-9411-44a8-b642-67f3647d1d4f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:50.756395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5f2bafcf-9411-44a8-b642-67f3647d1d4f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:50.764609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f2bafcf-9411-44a8-b642-67f3647d1d4f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:50.765056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f2bafcf-9411-44a8-b642-67f3647d1d4f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:50.766303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f2bafcf-9411-44a8-b642-67f3647d1d4f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:50.767027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f2bafcf-9411-44a8-b642-67f3647d1d4f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:50.912359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f2bafcf-9411-44a8-b642-67f3647d1d4f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:50.922711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5f2bafcf-9411-44a8-b642-67f3647d1d4f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.172936 Jun 02 19:26:50.923300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1292/2575] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:50 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:50.990572 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:26:50.990963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:26:51.715634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1bb76297-d2e1-4ad0-8f8e-09f90df9f4f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:51.716362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1bb76297-d2e1-4ad0-8f8e-09f90df9f4f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:51.723205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bb76297-d2e1-4ad0-8f8e-09f90df9f4f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:51.723662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bb76297-d2e1-4ad0-8f8e-09f90df9f4f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:51.724424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bb76297-d2e1-4ad0-8f8e-09f90df9f4f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:51.724856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bb76297-d2e1-4ad0-8f8e-09f90df9f4f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:51.791199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1bb76297-d2e1-4ad0-8f8e-09f90df9f4f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:51.800794 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1bb76297-d2e1-4ad0-8f8e-09f90df9f4f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089593 Jun 02 19:26:51.801369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1284/2576] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:51.941171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9182b5a1-8c68-46ec-98f5-4b0b7cd69588 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:51.941788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9182b5a1-8c68-46ec-98f5-4b0b7cd69588 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:51.949134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9182b5a1-8c68-46ec-98f5-4b0b7cd69588 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:51.949825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9182b5a1-8c68-46ec-98f5-4b0b7cd69588 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:51.950855 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9182b5a1-8c68-46ec-98f5-4b0b7cd69588 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:51.951295 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9182b5a1-8c68-46ec-98f5-4b0b7cd69588 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:51.955572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:52.097513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9182b5a1-8c68-46ec-98f5-4b0b7cd69588 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:52.106858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9182b5a1-8c68-46ec-98f5-4b0b7cd69588 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.169561 Jun 02 19:26:52.107441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1293/2577] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:51 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:52.819622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-05c77eff-5be7-402c-921f-7139d71b6ce6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:52.820186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-05c77eff-5be7-402c-921f-7139d71b6ce6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:52.827673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-05c77eff-5be7-402c-921f-7139d71b6ce6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:52.828149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-05c77eff-5be7-402c-921f-7139d71b6ce6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:52.828921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-05c77eff-5be7-402c-921f-7139d71b6ce6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:52.829354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-05c77eff-5be7-402c-921f-7139d71b6ce6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:52.895190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-05c77eff-5be7-402c-921f-7139d71b6ce6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:52.904072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-05c77eff-5be7-402c-921f-7139d71b6ce6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089328 Jun 02 19:26:52.904638 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1285/2578] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:53.126264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-105afa57-a966-4f3c-aa43-4f5d4862cabf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:53.126940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-105afa57-a966-4f3c-aa43-4f5d4862cabf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:53.134987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-105afa57-a966-4f3c-aa43-4f5d4862cabf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:53.135725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-105afa57-a966-4f3c-aa43-4f5d4862cabf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:53.137084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-105afa57-a966-4f3c-aa43-4f5d4862cabf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:53.137738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-105afa57-a966-4f3c-aa43-4f5d4862cabf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:53.281772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-105afa57-a966-4f3c-aa43-4f5d4862cabf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:53.290428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-105afa57-a966-4f3c-aa43-4f5d4862cabf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.169411 Jun 02 19:26:53.291015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1294/2579] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:53 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:53.926346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14e6e554-2e36-4eb9-8177-6c6a4fae1ac9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:53.926981 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14e6e554-2e36-4eb9-8177-6c6a4fae1ac9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:53.934074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14e6e554-2e36-4eb9-8177-6c6a4fae1ac9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:53.934827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14e6e554-2e36-4eb9-8177-6c6a4fae1ac9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:53.935340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14e6e554-2e36-4eb9-8177-6c6a4fae1ac9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:53.936111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14e6e554-2e36-4eb9-8177-6c6a4fae1ac9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:54.004152 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-14e6e554-2e36-4eb9-8177-6c6a4fae1ac9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:54.012758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14e6e554-2e36-4eb9-8177-6c6a4fae1ac9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090914 Jun 02 19:26:54.013603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1286/2580] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:54.308198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d9852921-122e-499b-bc2e-e2979f68b7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:54.309178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d9852921-122e-499b-bc2e-e2979f68b7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:54.316424 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9852921-122e-499b-bc2e-e2979f68b7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:54.316878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9852921-122e-499b-bc2e-e2979f68b7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:54.317622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9852921-122e-499b-bc2e-e2979f68b7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:54.318167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9852921-122e-499b-bc2e-e2979f68b7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:54.463325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d9852921-122e-499b-bc2e-e2979f68b7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:54.472821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d9852921-122e-499b-bc2e-e2979f68b7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168624 Jun 02 19:26:54.473394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1295/2581] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:54 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:55.031113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d8cf5545-5afc-47e5-94fa-70fa17d31fe8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:55.031802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d8cf5545-5afc-47e5-94fa-70fa17d31fe8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:55.038835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8cf5545-5afc-47e5-94fa-70fa17d31fe8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:55.039294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8cf5545-5afc-47e5-94fa-70fa17d31fe8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:55.040067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8cf5545-5afc-47e5-94fa-70fa17d31fe8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:55.040500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8cf5545-5afc-47e5-94fa-70fa17d31fe8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:55.117837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d8cf5545-5afc-47e5-94fa-70fa17d31fe8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:55.127195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d8cf5545-5afc-47e5-94fa-70fa17d31fe8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.100096 Jun 02 19:26:55.127773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1287/2582] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:55.491283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-23b678f9-4c03-4675-8c94-e7f393568e83 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:55.491900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-23b678f9-4c03-4675-8c94-e7f393568e83 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:55.499206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-23b678f9-4c03-4675-8c94-e7f393568e83 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:55.499661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-23b678f9-4c03-4675-8c94-e7f393568e83 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:55.500437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-23b678f9-4c03-4675-8c94-e7f393568e83 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:55.500870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-23b678f9-4c03-4675-8c94-e7f393568e83 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:55.640144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-23b678f9-4c03-4675-8c94-e7f393568e83 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:55.648538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-23b678f9-4c03-4675-8c94-e7f393568e83 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161095 Jun 02 19:26:55.649091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1296/2583] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:55 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:56.144834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f5ed1257-3df6-407d-8451-69f3f4ffc557 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:56.145467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f5ed1257-3df6-407d-8451-69f3f4ffc557 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:56.152235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5ed1257-3df6-407d-8451-69f3f4ffc557 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:56.152659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5ed1257-3df6-407d-8451-69f3f4ffc557 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:56.153437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5ed1257-3df6-407d-8451-69f3f4ffc557 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:56.153865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5ed1257-3df6-407d-8451-69f3f4ffc557 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:56.221639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f5ed1257-3df6-407d-8451-69f3f4ffc557 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:56.231697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f5ed1257-3df6-407d-8451-69f3f4ffc557 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090015 Jun 02 19:26:56.231956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1288/2584] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:56.667051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c0518aa8-2ae2-4e29-98a8-ce5bdbe21edd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:56.667704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c0518aa8-2ae2-4e29-98a8-ce5bdbe21edd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:56.675433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0518aa8-2ae2-4e29-98a8-ce5bdbe21edd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:56.675889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0518aa8-2ae2-4e29-98a8-ce5bdbe21edd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:56.676696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0518aa8-2ae2-4e29-98a8-ce5bdbe21edd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:56.677133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c0518aa8-2ae2-4e29-98a8-ce5bdbe21edd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:56.823464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c0518aa8-2ae2-4e29-98a8-ce5bdbe21edd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:56.832419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c0518aa8-2ae2-4e29-98a8-ce5bdbe21edd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.169265 Jun 02 19:26:56.833012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1297/2585] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:56 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:57.250555 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-21045eda-b77f-48c5-8239-6b9f2af57ba9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:57.251181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-21045eda-b77f-48c5-8239-6b9f2af57ba9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:57.258263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21045eda-b77f-48c5-8239-6b9f2af57ba9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:57.258708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21045eda-b77f-48c5-8239-6b9f2af57ba9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:57.259538 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21045eda-b77f-48c5-8239-6b9f2af57ba9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:57.259964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21045eda-b77f-48c5-8239-6b9f2af57ba9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:57.329789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-21045eda-b77f-48c5-8239-6b9f2af57ba9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:57.340693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-21045eda-b77f-48c5-8239-6b9f2af57ba9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095069 Jun 02 19:26:57.341457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1289/2586] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:57.852074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-24b55db3-b5d7-4bf0-89f5-027ee72ba018 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:57.852671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-24b55db3-b5d7-4bf0-89f5-027ee72ba018 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:57.861394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24b55db3-b5d7-4bf0-89f5-027ee72ba018 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:57.861885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24b55db3-b5d7-4bf0-89f5-027ee72ba018 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:57.862672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24b55db3-b5d7-4bf0-89f5-027ee72ba018 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:57.863115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-24b55db3-b5d7-4bf0-89f5-027ee72ba018 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:58.000146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-24b55db3-b5d7-4bf0-89f5-027ee72ba018 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:58.008854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-24b55db3-b5d7-4bf0-89f5-027ee72ba018 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160768 Jun 02 19:26:58.009437 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1298/2587] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:57 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:58.363984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-058be6b3-0b6d-4e8a-a043-961c8b7283ac tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:58.364598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-058be6b3-0b6d-4e8a-a043-961c8b7283ac tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:58.371769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-058be6b3-0b6d-4e8a-a043-961c8b7283ac tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:58.372349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-058be6b3-0b6d-4e8a-a043-961c8b7283ac tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:58.374316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-058be6b3-0b6d-4e8a-a043-961c8b7283ac tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:58.374756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-058be6b3-0b6d-4e8a-a043-961c8b7283ac tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:58.447590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-058be6b3-0b6d-4e8a-a043-961c8b7283ac tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:58.458463 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-058be6b3-0b6d-4e8a-a043-961c8b7283ac tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.099147 Jun 02 19:26:58.459263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1290/2588] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:59.029035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6bf6efb9-cb7e-4000-8475-3f082c77941f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:59.030067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6bf6efb9-cb7e-4000-8475-3f082c77941f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:59.037069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bf6efb9-cb7e-4000-8475-3f082c77941f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:59.037524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bf6efb9-cb7e-4000-8475-3f082c77941f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:59.038340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bf6efb9-cb7e-4000-8475-3f082c77941f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:59.038854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bf6efb9-cb7e-4000-8475-3f082c77941f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:59.180438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6bf6efb9-cb7e-4000-8475-3f082c77941f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:59.190556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6bf6efb9-cb7e-4000-8475-3f082c77941f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165947 Jun 02 19:26:59.191133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1299/2589] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:59 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:26:59.480744 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d799f10a-b6b9-48b0-a4ae-4eb2dcebd098 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:26:59.481398 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d799f10a-b6b9-48b0-a4ae-4eb2dcebd098 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:26:59.490201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d799f10a-b6b9-48b0-a4ae-4eb2dcebd098 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:59.490942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d799f10a-b6b9-48b0-a4ae-4eb2dcebd098 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:59.492193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d799f10a-b6b9-48b0-a4ae-4eb2dcebd098 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:26:59.492901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d799f10a-b6b9-48b0-a4ae-4eb2dcebd098 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:26:59.558205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d799f10a-b6b9-48b0-a4ae-4eb2dcebd098 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:26:59.567832 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d799f10a-b6b9-48b0-a4ae-4eb2dcebd098 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092840 Jun 02 19:26:59.568409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1291/2590] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:26:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:00.208796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-370aadb8-4102-4dd0-b6c2-c382a941c948 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:00.209435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-370aadb8-4102-4dd0-b6c2-c382a941c948 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:00.218382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-370aadb8-4102-4dd0-b6c2-c382a941c948 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:00.218839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-370aadb8-4102-4dd0-b6c2-c382a941c948 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:00.219622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-370aadb8-4102-4dd0-b6c2-c382a941c948 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:00.220061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-370aadb8-4102-4dd0-b6c2-c382a941c948 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:00.366180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-370aadb8-4102-4dd0-b6c2-c382a941c948 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:00.376121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-370aadb8-4102-4dd0-b6c2-c382a941c948 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.171259 Jun 02 19:27:00.376745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1300/2591] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:00 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:00.585724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5f6f3ca5-8c8d-4e12-919a-2e34a00383f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:00.586432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5f6f3ca5-8c8d-4e12-919a-2e34a00383f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:00.593611 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f6f3ca5-8c8d-4e12-919a-2e34a00383f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:00.594083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f6f3ca5-8c8d-4e12-919a-2e34a00383f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:00.594931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f6f3ca5-8c8d-4e12-919a-2e34a00383f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:00.595454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f6f3ca5-8c8d-4e12-919a-2e34a00383f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:00.660167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5f6f3ca5-8c8d-4e12-919a-2e34a00383f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:00.670233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5f6f3ca5-8c8d-4e12-919a-2e34a00383f3 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088502 Jun 02 19:27:00.670847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1292/2592] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:01.396843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4e0b7e53-ce2c-45d5-8230-fc7859152025 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:01.397902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4e0b7e53-ce2c-45d5-8230-fc7859152025 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:01.405211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e0b7e53-ce2c-45d5-8230-fc7859152025 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:01.405663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e0b7e53-ce2c-45d5-8230-fc7859152025 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:01.406465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e0b7e53-ce2c-45d5-8230-fc7859152025 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:01.406905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e0b7e53-ce2c-45d5-8230-fc7859152025 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:01.541088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4e0b7e53-ce2c-45d5-8230-fc7859152025 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:01.550440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4e0b7e53-ce2c-45d5-8230-fc7859152025 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.157589 Jun 02 19:27:01.551062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1301/2593] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:01 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:01.688871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-642854ac-ce84-4363-93b4-00f17ccf8679 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:01.689452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-642854ac-ce84-4363-93b4-00f17ccf8679 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:01.698312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-642854ac-ce84-4363-93b4-00f17ccf8679 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:01.698763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-642854ac-ce84-4363-93b4-00f17ccf8679 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:01.699530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-642854ac-ce84-4363-93b4-00f17ccf8679 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:01.699943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-642854ac-ce84-4363-93b4-00f17ccf8679 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:01.718048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:01.770432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-642854ac-ce84-4363-93b4-00f17ccf8679 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:01.779407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-642854ac-ce84-4363-93b4-00f17ccf8679 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095431 Jun 02 19:27:01.779999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1293/2594] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:02.571243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fbcf9611-b30c-4039-9fdf-3623b9ed5e7f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:02.571865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fbcf9611-b30c-4039-9fdf-3623b9ed5e7f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:02.582484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbcf9611-b30c-4039-9fdf-3623b9ed5e7f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:02.583053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbcf9611-b30c-4039-9fdf-3623b9ed5e7f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:02.584248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbcf9611-b30c-4039-9fdf-3623b9ed5e7f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:02.584973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbcf9611-b30c-4039-9fdf-3623b9ed5e7f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:02.734745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fbcf9611-b30c-4039-9fdf-3623b9ed5e7f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:02.744698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fbcf9611-b30c-4039-9fdf-3623b9ed5e7f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.179853 Jun 02 19:27:02.745282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1302/2595] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:02 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:02.798332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d620c031-0591-4df6-adc4-601a1e77ca12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:02.798914 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d620c031-0591-4df6-adc4-601a1e77ca12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:02.806215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d620c031-0591-4df6-adc4-601a1e77ca12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:02.806680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d620c031-0591-4df6-adc4-601a1e77ca12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:02.807450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d620c031-0591-4df6-adc4-601a1e77ca12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:02.807887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d620c031-0591-4df6-adc4-601a1e77ca12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:02.871891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d620c031-0591-4df6-adc4-601a1e77ca12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:02.880307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d620c031-0591-4df6-adc4-601a1e77ca12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086114 Jun 02 19:27:02.880865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1294/2596] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:03.764491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5cab7cd6-9f26-4eb6-8951-e885fd4011a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:03.765122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5cab7cd6-9f26-4eb6-8951-e885fd4011a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:03.767556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=52 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:03.773459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5cab7cd6-9f26-4eb6-8951-e885fd4011a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:03.773961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5cab7cd6-9f26-4eb6-8951-e885fd4011a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:03.774730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5cab7cd6-9f26-4eb6-8951-e885fd4011a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:03.775187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5cab7cd6-9f26-4eb6-8951-e885fd4011a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:03.897770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8ab581e2-fe06-449e-b4a8-c5a745460a6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:03.898412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8ab581e2-fe06-449e-b4a8-c5a745460a6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:03.905590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ab581e2-fe06-449e-b4a8-c5a745460a6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:03.906068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ab581e2-fe06-449e-b4a8-c5a745460a6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:03.906869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ab581e2-fe06-449e-b4a8-c5a745460a6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:03.907236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8ab581e2-fe06-449e-b4a8-c5a745460a6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:03.926608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5cab7cd6-9f26-4eb6-8951-e885fd4011a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:03.935007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5cab7cd6-9f26-4eb6-8951-e885fd4011a3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174772 Jun 02 19:27:03.935927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1303/2597] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:03 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:03.975042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8ab581e2-fe06-449e-b4a8-c5a745460a6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:03.983893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8ab581e2-fe06-449e-b4a8-c5a745460a6b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089951 Jun 02 19:27:03.984736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1295/2598] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:04.953824 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-395e021d-bd0d-49e0-aca0-0a440535eece tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:04.954468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-395e021d-bd0d-49e0-aca0-0a440535eece tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:04.963308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-395e021d-bd0d-49e0-aca0-0a440535eece tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:04.963775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-395e021d-bd0d-49e0-aca0-0a440535eece tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:04.964553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-395e021d-bd0d-49e0-aca0-0a440535eece tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:04.964991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-395e021d-bd0d-49e0-aca0-0a440535eece tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:05.007581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9fa5ea3-aacd-4217-a774-ccbbf3ccd11e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:05.008271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9fa5ea3-aacd-4217-a774-ccbbf3ccd11e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:05.016066 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9fa5ea3-aacd-4217-a774-ccbbf3ccd11e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:05.016513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9fa5ea3-aacd-4217-a774-ccbbf3ccd11e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:05.017279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9fa5ea3-aacd-4217-a774-ccbbf3ccd11e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:05.017707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9fa5ea3-aacd-4217-a774-ccbbf3ccd11e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:05.098948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9fa5ea3-aacd-4217-a774-ccbbf3ccd11e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:05.109781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9fa5ea3-aacd-4217-a774-ccbbf3ccd11e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.105919 Jun 02 19:27:05.110407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1296/2599] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:05 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:05.127758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-395e021d-bd0d-49e0-aca0-0a440535eece tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:05.137564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-395e021d-bd0d-49e0-aca0-0a440535eece tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.187894 Jun 02 19:27:05.138345 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1304/2600] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:04 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:06.128160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6c13a68a-01d8-4ee3-a5d3-175158ed7bcd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:06.128797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6c13a68a-01d8-4ee3-a5d3-175158ed7bcd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:06.136185 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c13a68a-01d8-4ee3-a5d3-175158ed7bcd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:06.136634 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c13a68a-01d8-4ee3-a5d3-175158ed7bcd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:06.137399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c13a68a-01d8-4ee3-a5d3-175158ed7bcd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:06.138494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c13a68a-01d8-4ee3-a5d3-175158ed7bcd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:06.155937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e9f352af-2188-4174-818b-f890063c04b1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:06.156588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e9f352af-2188-4174-818b-f890063c04b1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:06.163655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e9f352af-2188-4174-818b-f890063c04b1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:06.164112 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e9f352af-2188-4174-818b-f890063c04b1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:06.165513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e9f352af-2188-4174-818b-f890063c04b1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:06.165513 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e9f352af-2188-4174-818b-f890063c04b1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:06.203423 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6c13a68a-01d8-4ee3-a5d3-175158ed7bcd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:06.212503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6c13a68a-01d8-4ee3-a5d3-175158ed7bcd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088510 Jun 02 19:27:06.213085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1297/2601] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:06.305403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e9f352af-2188-4174-818b-f890063c04b1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:06.315228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e9f352af-2188-4174-818b-f890063c04b1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.163457 Jun 02 19:27:06.315890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1305/2602] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:06 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:07.230662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-54d8d571-5346-4c83-9e99-72103061fa2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:07.231322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-54d8d571-5346-4c83-9e99-72103061fa2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:07.240546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54d8d571-5346-4c83-9e99-72103061fa2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:07.240991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54d8d571-5346-4c83-9e99-72103061fa2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:07.241758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54d8d571-5346-4c83-9e99-72103061fa2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:07.242219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-54d8d571-5346-4c83-9e99-72103061fa2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:07.313139 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-54d8d571-5346-4c83-9e99-72103061fa2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:07.324821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-54d8d571-5346-4c83-9e99-72103061fa2b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097953 Jun 02 19:27:07.325547 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1298/2603] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:07.332519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3ef652a9-7cfa-43ea-bbe2-1cce7ab01d8f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:07.333231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3ef652a9-7cfa-43ea-bbe2-1cce7ab01d8f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:07.340171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3ef652a9-7cfa-43ea-bbe2-1cce7ab01d8f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:07.340670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3ef652a9-7cfa-43ea-bbe2-1cce7ab01d8f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:07.341486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3ef652a9-7cfa-43ea-bbe2-1cce7ab01d8f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:07.342023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3ef652a9-7cfa-43ea-bbe2-1cce7ab01d8f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:07.481944 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3ef652a9-7cfa-43ea-bbe2-1cce7ab01d8f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:07.490402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3ef652a9-7cfa-43ea-bbe2-1cce7ab01d8f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161731 Jun 02 19:27:07.490965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1306/2604] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:07 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:08.342837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ade23d2f-75ab-488f-ade7-b309708b6a64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:08.343492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ade23d2f-75ab-488f-ade7-b309708b6a64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:08.351035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ade23d2f-75ab-488f-ade7-b309708b6a64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:08.351418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ade23d2f-75ab-488f-ade7-b309708b6a64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:08.352260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ade23d2f-75ab-488f-ade7-b309708b6a64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:08.352689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ade23d2f-75ab-488f-ade7-b309708b6a64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:08.423569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ade23d2f-75ab-488f-ade7-b309708b6a64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:08.436084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ade23d2f-75ab-488f-ade7-b309708b6a64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097374 Jun 02 19:27:08.436661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1299/2605] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:08.508152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-430dd905-3137-4905-944c-93d1a77e01d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:08.508925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-430dd905-3137-4905-944c-93d1a77e01d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:08.516729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-430dd905-3137-4905-944c-93d1a77e01d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:08.517190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-430dd905-3137-4905-944c-93d1a77e01d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:08.518012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-430dd905-3137-4905-944c-93d1a77e01d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:08.518463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-430dd905-3137-4905-944c-93d1a77e01d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:08.687679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-430dd905-3137-4905-944c-93d1a77e01d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:08.696127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-430dd905-3137-4905-944c-93d1a77e01d9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.191875 Jun 02 19:27:08.696699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1307/2606] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:08 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:09.453891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-49dac49d-840d-4a72-91c4-db0bd7ebb4da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:09.454547 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-49dac49d-840d-4a72-91c4-db0bd7ebb4da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:09.457664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=56 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:09.466061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49dac49d-840d-4a72-91c4-db0bd7ebb4da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:09.466570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49dac49d-840d-4a72-91c4-db0bd7ebb4da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:09.467382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49dac49d-840d-4a72-91c4-db0bd7ebb4da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:09.467809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-49dac49d-840d-4a72-91c4-db0bd7ebb4da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:09.536278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-49dac49d-840d-4a72-91c4-db0bd7ebb4da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:09.546934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-49dac49d-840d-4a72-91c4-db0bd7ebb4da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097162 Jun 02 19:27:09.547542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1300/2607] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:09.715621 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b9c87c0e-4d8d-4295-833f-cd52a8d86a25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:09.716366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b9c87c0e-4d8d-4295-833f-cd52a8d86a25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:09.724515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9c87c0e-4d8d-4295-833f-cd52a8d86a25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:09.725050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9c87c0e-4d8d-4295-833f-cd52a8d86a25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:09.725929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9c87c0e-4d8d-4295-833f-cd52a8d86a25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:09.726534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9c87c0e-4d8d-4295-833f-cd52a8d86a25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:09.868034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b9c87c0e-4d8d-4295-833f-cd52a8d86a25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:09.876481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b9c87c0e-4d8d-4295-833f-cd52a8d86a25 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165484 Jun 02 19:27:09.877064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1308/2608] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:09 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:10.565294 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-20124f65-1f49-4ef2-8612-0d5b5462ef37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:10.565931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-20124f65-1f49-4ef2-8612-0d5b5462ef37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:10.572916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20124f65-1f49-4ef2-8612-0d5b5462ef37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:10.573362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20124f65-1f49-4ef2-8612-0d5b5462ef37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:10.574155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20124f65-1f49-4ef2-8612-0d5b5462ef37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:10.574585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-20124f65-1f49-4ef2-8612-0d5b5462ef37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:10.641900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-20124f65-1f49-4ef2-8612-0d5b5462ef37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:10.652789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-20124f65-1f49-4ef2-8612-0d5b5462ef37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091396 Jun 02 19:27:10.653612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1301/2609] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:10.895254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-539b0b34-141d-4e8d-8785-a8fe74684436 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:10.895903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-539b0b34-141d-4e8d-8785-a8fe74684436 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:10.903176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-539b0b34-141d-4e8d-8785-a8fe74684436 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:10.903650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-539b0b34-141d-4e8d-8785-a8fe74684436 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:10.904429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-539b0b34-141d-4e8d-8785-a8fe74684436 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:10.904870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-539b0b34-141d-4e8d-8785-a8fe74684436 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:11.058471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-539b0b34-141d-4e8d-8785-a8fe74684436 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:11.062575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:11.068680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-539b0b34-141d-4e8d-8785-a8fe74684436 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.177530 Jun 02 19:27:11.069141 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1309/2610] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:10 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:11.673988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c8df9aea-2dbd-49fb-abe7-f0a2eee00f57 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:11.674606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c8df9aea-2dbd-49fb-abe7-f0a2eee00f57 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:11.683996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8df9aea-2dbd-49fb-abe7-f0a2eee00f57 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:11.684690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8df9aea-2dbd-49fb-abe7-f0a2eee00f57 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:11.685956 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8df9aea-2dbd-49fb-abe7-f0a2eee00f57 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:11.686395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8df9aea-2dbd-49fb-abe7-f0a2eee00f57 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:11.752021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c8df9aea-2dbd-49fb-abe7-f0a2eee00f57 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:11.760630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c8df9aea-2dbd-49fb-abe7-f0a2eee00f57 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091009 Jun 02 19:27:11.761205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1302/2611] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:12.090470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4e33c469-9bad-4dea-85e1-fd351195bd06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:12.091510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4e33c469-9bad-4dea-85e1-fd351195bd06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:12.103324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e33c469-9bad-4dea-85e1-fd351195bd06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:12.104060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e33c469-9bad-4dea-85e1-fd351195bd06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:12.105379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e33c469-9bad-4dea-85e1-fd351195bd06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:12.106280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e33c469-9bad-4dea-85e1-fd351195bd06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:12.253096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4e33c469-9bad-4dea-85e1-fd351195bd06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:12.261694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4e33c469-9bad-4dea-85e1-fd351195bd06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.177563 Jun 02 19:27:12.262324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1310/2612] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:12 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:12.780102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9b8ee4c9-c235-4acd-9d35-b8bd17175708 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:12.780735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9b8ee4c9-c235-4acd-9d35-b8bd17175708 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:12.788031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b8ee4c9-c235-4acd-9d35-b8bd17175708 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:12.788399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b8ee4c9-c235-4acd-9d35-b8bd17175708 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:12.789173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b8ee4c9-c235-4acd-9d35-b8bd17175708 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:12.789602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b8ee4c9-c235-4acd-9d35-b8bd17175708 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:12.857367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9b8ee4c9-c235-4acd-9d35-b8bd17175708 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:12.866392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9b8ee4c9-c235-4acd-9d35-b8bd17175708 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091984 Jun 02 19:27:12.866959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1303/2613] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:13.278979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1e1156f3-6ce6-47c6-b416-1b69fa5c2773 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:13.279636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1e1156f3-6ce6-47c6-b416-1b69fa5c2773 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:13.286906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e1156f3-6ce6-47c6-b416-1b69fa5c2773 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:13.287362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e1156f3-6ce6-47c6-b416-1b69fa5c2773 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:13.288365 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e1156f3-6ce6-47c6-b416-1b69fa5c2773 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:13.289298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1e1156f3-6ce6-47c6-b416-1b69fa5c2773 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:13.429204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1e1156f3-6ce6-47c6-b416-1b69fa5c2773 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:13.439336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1e1156f3-6ce6-47c6-b416-1b69fa5c2773 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164422 Jun 02 19:27:13.440108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1311/2614] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:13 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:13.885062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e0200575-8bbc-4bae-b0e6-6759305b7cd7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:13.885686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e0200575-8bbc-4bae-b0e6-6759305b7cd7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:13.893105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0200575-8bbc-4bae-b0e6-6759305b7cd7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:13.893559 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0200575-8bbc-4bae-b0e6-6759305b7cd7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:13.894362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0200575-8bbc-4bae-b0e6-6759305b7cd7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:13.894792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0200575-8bbc-4bae-b0e6-6759305b7cd7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:13.962664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e0200575-8bbc-4bae-b0e6-6759305b7cd7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:13.971494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e0200575-8bbc-4bae-b0e6-6759305b7cd7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090980 Jun 02 19:27:13.972078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1304/2615] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:14.461636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bfa1339f-d2bb-42b3-b9fa-47b0fa6887f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:14.462325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bfa1339f-d2bb-42b3-b9fa-47b0fa6887f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:14.469237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfa1339f-d2bb-42b3-b9fa-47b0fa6887f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:14.469694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfa1339f-d2bb-42b3-b9fa-47b0fa6887f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:14.470477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfa1339f-d2bb-42b3-b9fa-47b0fa6887f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:14.470916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bfa1339f-d2bb-42b3-b9fa-47b0fa6887f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:14.626366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bfa1339f-d2bb-42b3-b9fa-47b0fa6887f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:14.634994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bfa1339f-d2bb-42b3-b9fa-47b0fa6887f6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.177320 Jun 02 19:27:14.635551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1312/2616] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:14 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:14.991256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-35b46a61-4f76-4a64-92f3-5f3477139a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:14.991882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-35b46a61-4f76-4a64-92f3-5f3477139a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:15.000165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35b46a61-4f76-4a64-92f3-5f3477139a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:15.000746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35b46a61-4f76-4a64-92f3-5f3477139a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:15.001583 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35b46a61-4f76-4a64-92f3-5f3477139a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:15.002060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35b46a61-4f76-4a64-92f3-5f3477139a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:15.066844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-35b46a61-4f76-4a64-92f3-5f3477139a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:15.075361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-35b46a61-4f76-4a64-92f3-5f3477139a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089913 Jun 02 19:27:15.075937 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1305/2617] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:15.654061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-114bdc0b-c1a6-490a-9289-e81abada8747 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:15.654691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-114bdc0b-c1a6-490a-9289-e81abada8747 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:15.661468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-114bdc0b-c1a6-490a-9289-e81abada8747 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:15.661955 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-114bdc0b-c1a6-490a-9289-e81abada8747 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:15.662739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-114bdc0b-c1a6-490a-9289-e81abada8747 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:15.663181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-114bdc0b-c1a6-490a-9289-e81abada8747 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:15.828095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-114bdc0b-c1a6-490a-9289-e81abada8747 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:15.840726 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-114bdc0b-c1a6-490a-9289-e81abada8747 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.191000 Jun 02 19:27:15.841488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1313/2618] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:15 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:16.093186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92a594b0-9161-459d-8e47-a3bf48587f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:16.093789 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92a594b0-9161-459d-8e47-a3bf48587f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:16.100906 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92a594b0-9161-459d-8e47-a3bf48587f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:16.101355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92a594b0-9161-459d-8e47-a3bf48587f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:16.102154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92a594b0-9161-459d-8e47-a3bf48587f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:16.102585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92a594b0-9161-459d-8e47-a3bf48587f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:16.169400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-92a594b0-9161-459d-8e47-a3bf48587f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:16.183153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92a594b0-9161-459d-8e47-a3bf48587f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.093330 Jun 02 19:27:16.184055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1306/2619] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:16.860412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-69adde6d-7b0b-4038-b558-69c37d237a34 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:16.860985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-69adde6d-7b0b-4038-b558-69c37d237a34 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:16.867891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69adde6d-7b0b-4038-b558-69c37d237a34 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:16.868496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69adde6d-7b0b-4038-b558-69c37d237a34 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:16.869300 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69adde6d-7b0b-4038-b558-69c37d237a34 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:16.869751 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69adde6d-7b0b-4038-b558-69c37d237a34 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:17.011841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-69adde6d-7b0b-4038-b558-69c37d237a34 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:17.022431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-69adde6d-7b0b-4038-b558-69c37d237a34 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166037 Jun 02 19:27:17.023019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1314/2620] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:16 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:17.201481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c172c7ba-ae6b-43da-a775-25fe21fc8f73 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:17.202107 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c172c7ba-ae6b-43da-a775-25fe21fc8f73 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:17.209306 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c172c7ba-ae6b-43da-a775-25fe21fc8f73 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:17.209732 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c172c7ba-ae6b-43da-a775-25fe21fc8f73 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:17.210548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c172c7ba-ae6b-43da-a775-25fe21fc8f73 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:17.211013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c172c7ba-ae6b-43da-a775-25fe21fc8f73 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:17.278150 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c172c7ba-ae6b-43da-a775-25fe21fc8f73 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:17.286551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c172c7ba-ae6b-43da-a775-25fe21fc8f73 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089147 Jun 02 19:27:17.287122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1307/2621] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:18.042786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ccb7a3ab-159a-4ebf-bbd4-b9690eb20761 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:18.044158 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ccb7a3ab-159a-4ebf-bbd4-b9690eb20761 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:18.051306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccb7a3ab-159a-4ebf-bbd4-b9690eb20761 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:18.051758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccb7a3ab-159a-4ebf-bbd4-b9690eb20761 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:18.052537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccb7a3ab-159a-4ebf-bbd4-b9690eb20761 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:18.053004 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ccb7a3ab-159a-4ebf-bbd4-b9690eb20761 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:18.209306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ccb7a3ab-159a-4ebf-bbd4-b9690eb20761 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:18.219673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ccb7a3ab-159a-4ebf-bbd4-b9690eb20761 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.180733 Jun 02 19:27:18.220293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1315/2622] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:18 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:18.307822 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-446512d6-7c77-4293-9194-a7747a254048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:18.308677 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-446512d6-7c77-4293-9194-a7747a254048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:18.316360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-446512d6-7c77-4293-9194-a7747a254048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:18.316823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-446512d6-7c77-4293-9194-a7747a254048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:18.317591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-446512d6-7c77-4293-9194-a7747a254048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:18.318060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-446512d6-7c77-4293-9194-a7747a254048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:18.383250 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-446512d6-7c77-4293-9194-a7747a254048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:18.392997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-446512d6-7c77-4293-9194-a7747a254048 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091561 Jun 02 19:27:18.393549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1308/2623] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:19.236938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bf1f2958-e2ac-4510-ace3-78454f111199 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:19.237687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bf1f2958-e2ac-4510-ace3-78454f111199 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:19.244669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf1f2958-e2ac-4510-ace3-78454f111199 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:19.245128 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf1f2958-e2ac-4510-ace3-78454f111199 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:19.245941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf1f2958-e2ac-4510-ace3-78454f111199 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:19.246382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf1f2958-e2ac-4510-ace3-78454f111199 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:19.387812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bf1f2958-e2ac-4510-ace3-78454f111199 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:19.396761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bf1f2958-e2ac-4510-ace3-78454f111199 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.163765 Jun 02 19:27:19.397349 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1316/2624] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:19 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:19.411523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-62887857-0e12-4a62-9f57-202ddac83eb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:19.412126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-62887857-0e12-4a62-9f57-202ddac83eb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:19.419977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62887857-0e12-4a62-9f57-202ddac83eb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:19.420419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62887857-0e12-4a62-9f57-202ddac83eb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:19.421171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62887857-0e12-4a62-9f57-202ddac83eb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:19.421598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62887857-0e12-4a62-9f57-202ddac83eb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:19.486698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-62887857-0e12-4a62-9f57-202ddac83eb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:19.495826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-62887857-0e12-4a62-9f57-202ddac83eb9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088339 Jun 02 19:27:19.496457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1309/2625] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:20.414817 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-16ee4dd2-9557-4c25-bdf3-e6e8674e2408 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:20.415478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-16ee4dd2-9557-4c25-bdf3-e6e8674e2408 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:20.423474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16ee4dd2-9557-4c25-bdf3-e6e8674e2408 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:20.423961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16ee4dd2-9557-4c25-bdf3-e6e8674e2408 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:20.424736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16ee4dd2-9557-4c25-bdf3-e6e8674e2408 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:20.425173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16ee4dd2-9557-4c25-bdf3-e6e8674e2408 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:20.515897 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e67e7614-9670-47c0-8cd7-234aecb47498 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:20.516593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e67e7614-9670-47c0-8cd7-234aecb47498 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:20.528541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e67e7614-9670-47c0-8cd7-234aecb47498 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:20.529027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e67e7614-9670-47c0-8cd7-234aecb47498 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:20.530084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e67e7614-9670-47c0-8cd7-234aecb47498 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:20.530712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e67e7614-9670-47c0-8cd7-234aecb47498 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:20.533850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:20.566129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-16ee4dd2-9557-4c25-bdf3-e6e8674e2408 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:20.575117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-16ee4dd2-9557-4c25-bdf3-e6e8674e2408 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.163956 Jun 02 19:27:20.575921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1317/2626] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:20 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:20.599551 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e67e7614-9670-47c0-8cd7-234aecb47498 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:20.609393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e67e7614-9670-47c0-8cd7-234aecb47498 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097224 Jun 02 19:27:20.610194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1310/2627] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:27:21.593096 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7ce1272e-a48c-463d-a913-e695e6e12e03 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:21.593732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7ce1272e-a48c-463d-a913-e695e6e12e03 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:21.601105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ce1272e-a48c-463d-a913-e695e6e12e03 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:21.601561 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ce1272e-a48c-463d-a913-e695e6e12e03 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:21.602398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ce1272e-a48c-463d-a913-e695e6e12e03 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:21.602812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ce1272e-a48c-463d-a913-e695e6e12e03 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:21.628144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-48d5ea9c-d24b-4ada-bcd5-34e9ce2fb28b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:21.628768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-48d5ea9c-d24b-4ada-bcd5-34e9ce2fb28b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:21.635821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48d5ea9c-d24b-4ada-bcd5-34e9ce2fb28b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:21.636265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48d5ea9c-d24b-4ada-bcd5-34e9ce2fb28b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:21.637059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48d5ea9c-d24b-4ada-bcd5-34e9ce2fb28b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:21.637667 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48d5ea9c-d24b-4ada-bcd5-34e9ce2fb28b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:21.733830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-48d5ea9c-d24b-4ada-bcd5-34e9ce2fb28b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:21.743171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-48d5ea9c-d24b-4ada-bcd5-34e9ce2fb28b tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.118853 Jun 02 19:27:21.744132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1311/2628] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:21.779863 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7ce1272e-a48c-463d-a913-e695e6e12e03 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:21.792062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7ce1272e-a48c-463d-a913-e695e6e12e03 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.202903 Jun 02 19:27:21.792559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1318/2629] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:21 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:22.765684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-567d28b1-0661-4786-9530-d91d7ca194dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:22.766697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-567d28b1-0661-4786-9530-d91d7ca194dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:22.776830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-567d28b1-0661-4786-9530-d91d7ca194dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:22.777389 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-567d28b1-0661-4786-9530-d91d7ca194dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:22.778602 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-567d28b1-0661-4786-9530-d91d7ca194dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:22.779033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-567d28b1-0661-4786-9530-d91d7ca194dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:22.815279 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-13824729-c113-4e98-a18d-b0e21c615e08 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:22.815918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-13824729-c113-4e98-a18d-b0e21c615e08 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:22.825179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13824729-c113-4e98-a18d-b0e21c615e08 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:22.825680 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13824729-c113-4e98-a18d-b0e21c615e08 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:22.826468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13824729-c113-4e98-a18d-b0e21c615e08 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:22.826888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13824729-c113-4e98-a18d-b0e21c615e08 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:22.848367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-567d28b1-0661-4786-9530-d91d7ca194dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:22.857082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-567d28b1-0661-4786-9530-d91d7ca194dd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097239 Jun 02 19:27:22.857922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1312/2630] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:22.984444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-13824729-c113-4e98-a18d-b0e21c615e08 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:22.995715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-13824729-c113-4e98-a18d-b0e21c615e08 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.189162 Jun 02 19:27:22.996347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1319/2631] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:22 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:23.876299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f51dfedf-c85c-4e6c-b5ab-413410382e90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:23.877283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f51dfedf-c85c-4e6c-b5ab-413410382e90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:23.884827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f51dfedf-c85c-4e6c-b5ab-413410382e90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:23.885557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f51dfedf-c85c-4e6c-b5ab-413410382e90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:23.886862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f51dfedf-c85c-4e6c-b5ab-413410382e90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:23.887558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f51dfedf-c85c-4e6c-b5ab-413410382e90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:23.963371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f51dfedf-c85c-4e6c-b5ab-413410382e90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:23.972124 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f51dfedf-c85c-4e6c-b5ab-413410382e90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.101121 Jun 02 19:27:23.972705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1313/2632] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:24.014668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-911f5a1f-b762-42e1-9815-168e804d5f46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:24.015477 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-911f5a1f-b762-42e1-9815-168e804d5f46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:24.022145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-911f5a1f-b762-42e1-9815-168e804d5f46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:24.022721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-911f5a1f-b762-42e1-9815-168e804d5f46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:24.023648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-911f5a1f-b762-42e1-9815-168e804d5f46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:24.024197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-911f5a1f-b762-42e1-9815-168e804d5f46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:24.168144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-911f5a1f-b762-42e1-9815-168e804d5f46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:24.176833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-911f5a1f-b762-42e1-9815-168e804d5f46 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166105 Jun 02 19:27:24.177415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1320/2633] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:24 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:24.990071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-99cdb83c-d24c-4cd5-92bd-200dffdf8231 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:24.990829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-99cdb83c-d24c-4cd5-92bd-200dffdf8231 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:24.998155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99cdb83c-d24c-4cd5-92bd-200dffdf8231 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:24.998615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99cdb83c-d24c-4cd5-92bd-200dffdf8231 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:24.999373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99cdb83c-d24c-4cd5-92bd-200dffdf8231 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:24.999797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-99cdb83c-d24c-4cd5-92bd-200dffdf8231 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:25.068666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-99cdb83c-d24c-4cd5-92bd-200dffdf8231 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:25.077458 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-99cdb83c-d24c-4cd5-92bd-200dffdf8231 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091265 Jun 02 19:27:25.078067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1314/2634] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:25.199050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7f1d59f9-9e89-4405-b533-7b260407ec0c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:25.200172 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7f1d59f9-9e89-4405-b533-7b260407ec0c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:25.211685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f1d59f9-9e89-4405-b533-7b260407ec0c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:25.212502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f1d59f9-9e89-4405-b533-7b260407ec0c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:25.213826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f1d59f9-9e89-4405-b533-7b260407ec0c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:25.214667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f1d59f9-9e89-4405-b533-7b260407ec0c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:25.350707 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f1d59f9-9e89-4405-b533-7b260407ec0c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:25.359287 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7f1d59f9-9e89-4405-b533-7b260407ec0c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166765 Jun 02 19:27:25.359864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1321/2635] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:25 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:26.095309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-68e49d03-a2f3-47b2-a077-5baec34961c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:26.095961 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-68e49d03-a2f3-47b2-a077-5baec34961c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:26.103745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68e49d03-a2f3-47b2-a077-5baec34961c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:26.104191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68e49d03-a2f3-47b2-a077-5baec34961c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:26.104936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68e49d03-a2f3-47b2-a077-5baec34961c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:26.105368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68e49d03-a2f3-47b2-a077-5baec34961c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:26.170406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-68e49d03-a2f3-47b2-a077-5baec34961c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:26.179034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-68e49d03-a2f3-47b2-a077-5baec34961c4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.087643 Jun 02 19:27:26.179642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1315/2636] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:26 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:26.377232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3f023bda-e187-47a4-bbb4-74a5eb8a4d06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:26.378144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3f023bda-e187-47a4-bbb4-74a5eb8a4d06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:26.387502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f023bda-e187-47a4-bbb4-74a5eb8a4d06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:26.388136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f023bda-e187-47a4-bbb4-74a5eb8a4d06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:26.388749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f023bda-e187-47a4-bbb4-74a5eb8a4d06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:26.389182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3f023bda-e187-47a4-bbb4-74a5eb8a4d06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:26.544854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3f023bda-e187-47a4-bbb4-74a5eb8a4d06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:26.557911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3f023bda-e187-47a4-bbb4-74a5eb8a4d06 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.185122 Jun 02 19:27:26.558999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1322/2637] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:26 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:27.197841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6a378607-b6cd-4b19-9e59-995e62a6c5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:27.198459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6a378607-b6cd-4b19-9e59-995e62a6c5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:27.206435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a378607-b6cd-4b19-9e59-995e62a6c5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:27.206884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a378607-b6cd-4b19-9e59-995e62a6c5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:27.207658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a378607-b6cd-4b19-9e59-995e62a6c5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:27.208086 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a378607-b6cd-4b19-9e59-995e62a6c5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:27.450226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6a378607-b6cd-4b19-9e59-995e62a6c5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:27.462088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6a378607-b6cd-4b19-9e59-995e62a6c5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.268807 Jun 02 19:27:27.463084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1316/2638] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:27.576601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6e04a745-c925-4a60-9af3-6b6b4cf0d3cb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:27.577509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6e04a745-c925-4a60-9af3-6b6b4cf0d3cb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:27.585212 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6e04a745-c925-4a60-9af3-6b6b4cf0d3cb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:27.585666 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6e04a745-c925-4a60-9af3-6b6b4cf0d3cb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:27.586551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6e04a745-c925-4a60-9af3-6b6b4cf0d3cb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:27.587197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6e04a745-c925-4a60-9af3-6b6b4cf0d3cb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:27.731545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6e04a745-c925-4a60-9af3-6b6b4cf0d3cb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:27.740202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6e04a745-c925-4a60-9af3-6b6b4cf0d3cb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167724 Jun 02 19:27:27.740797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1323/2639] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:27 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:28.482243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0f4a8b4c-95c6-4211-9fc0-9e40485b8150 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:28.482829 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0f4a8b4c-95c6-4211-9fc0-9e40485b8150 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:28.489883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f4a8b4c-95c6-4211-9fc0-9e40485b8150 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:28.490325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f4a8b4c-95c6-4211-9fc0-9e40485b8150 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:28.491092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f4a8b4c-95c6-4211-9fc0-9e40485b8150 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:28.491534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f4a8b4c-95c6-4211-9fc0-9e40485b8150 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:28.563229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0f4a8b4c-95c6-4211-9fc0-9e40485b8150 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:28.571809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0f4a8b4c-95c6-4211-9fc0-9e40485b8150 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.093884 Jun 02 19:27:28.572347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1317/2640] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:28.759125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1336908c-706c-4dc9-aa08-0b6b992ceef5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:28.759719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1336908c-706c-4dc9-aa08-0b6b992ceef5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:28.769592 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1336908c-706c-4dc9-aa08-0b6b992ceef5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:28.770227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1336908c-706c-4dc9-aa08-0b6b992ceef5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:28.771417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1336908c-706c-4dc9-aa08-0b6b992ceef5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:28.772075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1336908c-706c-4dc9-aa08-0b6b992ceef5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:28.928484 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1336908c-706c-4dc9-aa08-0b6b992ceef5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:28.937545 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1336908c-706c-4dc9-aa08-0b6b992ceef5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.183111 Jun 02 19:27:28.938177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1324/2641] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:28 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:29.589843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f47c3243-6177-40a5-a753-968cf240de48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:29.590528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f47c3243-6177-40a5-a753-968cf240de48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:29.596917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f47c3243-6177-40a5-a753-968cf240de48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:29.597365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f47c3243-6177-40a5-a753-968cf240de48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:29.598164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f47c3243-6177-40a5-a753-968cf240de48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:29.598598 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f47c3243-6177-40a5-a753-968cf240de48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:29.663927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f47c3243-6177-40a5-a753-968cf240de48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:29.673029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f47c3243-6177-40a5-a753-968cf240de48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.087262 Jun 02 19:27:29.673575 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1318/2642] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:29.957293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-166da526-731f-4b52-adc8-38c1c6b6c206 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:29.958316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-166da526-731f-4b52-adc8-38c1c6b6c206 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:29.966410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-166da526-731f-4b52-adc8-38c1c6b6c206 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:29.966963 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-166da526-731f-4b52-adc8-38c1c6b6c206 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:29.967741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-166da526-731f-4b52-adc8-38c1c6b6c206 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:29.968182 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-166da526-731f-4b52-adc8-38c1c6b6c206 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:30.110194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-166da526-731f-4b52-adc8-38c1c6b6c206 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:30.118914 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-166da526-731f-4b52-adc8-38c1c6b6c206 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167465 Jun 02 19:27:30.119696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1325/2643] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:29 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:30.691860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8fa5ca09-1cfb-4770-bdf9-f49f2187b031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:30.692503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8fa5ca09-1cfb-4770-bdf9-f49f2187b031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:30.699619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca09-1cfb-4770-bdf9-f49f2187b031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:30.700154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca09-1cfb-4770-bdf9-f49f2187b031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:30.700921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca09-1cfb-4770-bdf9-f49f2187b031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:30.701351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca09-1cfb-4770-bdf9-f49f2187b031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:30.762644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8fa5ca09-1cfb-4770-bdf9-f49f2187b031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:30.770736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8fa5ca09-1cfb-4770-bdf9-f49f2187b031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.082838 Jun 02 19:27:30.771297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1319/2644] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:31.140899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-de99c4e1-ba04-401a-a53b-c5bc5c80e59e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:31.141541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-de99c4e1-ba04-401a-a53b-c5bc5c80e59e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:31.148889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de99c4e1-ba04-401a-a53b-c5bc5c80e59e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:31.149352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de99c4e1-ba04-401a-a53b-c5bc5c80e59e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:31.150167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de99c4e1-ba04-401a-a53b-c5bc5c80e59e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:31.150612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de99c4e1-ba04-401a-a53b-c5bc5c80e59e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:31.170624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:31.291676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-de99c4e1-ba04-401a-a53b-c5bc5c80e59e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:31.300870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-de99c4e1-ba04-401a-a53b-c5bc5c80e59e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.163946 Jun 02 19:27:31.301455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1326/2645] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:31 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:31.792327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6d80ad44-b4e3-4943-980e-14fb994077d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:31.793581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6d80ad44-b4e3-4943-980e-14fb994077d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:31.803859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d80ad44-b4e3-4943-980e-14fb994077d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:31.804609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d80ad44-b4e3-4943-980e-14fb994077d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:31.805930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d80ad44-b4e3-4943-980e-14fb994077d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:31.806629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d80ad44-b4e3-4943-980e-14fb994077d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:31.881444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6d80ad44-b4e3-4943-980e-14fb994077d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:31.890706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6d80ad44-b4e3-4943-980e-14fb994077d0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.104940 Jun 02 19:27:31.891275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1320/2646] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:32.319122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b54c7a87-f44a-468d-a510-4ca25d5612d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:32.319715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b54c7a87-f44a-468d-a510-4ca25d5612d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:32.327328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b54c7a87-f44a-468d-a510-4ca25d5612d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:32.327788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b54c7a87-f44a-468d-a510-4ca25d5612d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:32.328558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b54c7a87-f44a-468d-a510-4ca25d5612d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:32.329014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b54c7a87-f44a-468d-a510-4ca25d5612d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:32.460873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b54c7a87-f44a-468d-a510-4ca25d5612d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:32.469238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b54c7a87-f44a-468d-a510-4ca25d5612d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.154131 Jun 02 19:27:32.469823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1327/2647] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:32 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:32.907844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f61f4263-a8a8-4874-a54e-3809875f4575 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:32.908475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f61f4263-a8a8-4874-a54e-3809875f4575 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:32.915478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f61f4263-a8a8-4874-a54e-3809875f4575 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:32.915936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f61f4263-a8a8-4874-a54e-3809875f4575 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:32.916716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f61f4263-a8a8-4874-a54e-3809875f4575 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:32.917142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f61f4263-a8a8-4874-a54e-3809875f4575 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:32.990020 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f61f4263-a8a8-4874-a54e-3809875f4575 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:32.998510 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f61f4263-a8a8-4874-a54e-3809875f4575 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094631 Jun 02 19:27:32.999069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1321/2648] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:33.487563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ff1a98d2-086f-43fd-b44f-24c671ef10d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:33.488178 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ff1a98d2-086f-43fd-b44f-24c671ef10d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:33.495235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff1a98d2-086f-43fd-b44f-24c671ef10d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:33.495691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff1a98d2-086f-43fd-b44f-24c671ef10d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:33.496559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff1a98d2-086f-43fd-b44f-24c671ef10d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:33.496991 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff1a98d2-086f-43fd-b44f-24c671ef10d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:33.629395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ff1a98d2-086f-43fd-b44f-24c671ef10d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:33.637902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ff1a98d2-086f-43fd-b44f-24c671ef10d5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.154238 Jun 02 19:27:33.638469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1328/2649] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:33 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:34.016670 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5bd68474-885d-4ca5-befd-57302a07eb03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:34.017263 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5bd68474-885d-4ca5-befd-57302a07eb03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:34.024093 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bd68474-885d-4ca5-befd-57302a07eb03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:34.024664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bd68474-885d-4ca5-befd-57302a07eb03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:34.025369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bd68474-885d-4ca5-befd-57302a07eb03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:34.025820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bd68474-885d-4ca5-befd-57302a07eb03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:34.088821 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5bd68474-885d-4ca5-befd-57302a07eb03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:34.097921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5bd68474-885d-4ca5-befd-57302a07eb03 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085298 Jun 02 19:27:34.098472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1322/2650] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:34.655919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-690a0112-6ba7-4e80-9ab2-fd449c144eeb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:34.656532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-690a0112-6ba7-4e80-9ab2-fd449c144eeb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:34.658886 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=52 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:34.664455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-690a0112-6ba7-4e80-9ab2-fd449c144eeb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:34.664904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-690a0112-6ba7-4e80-9ab2-fd449c144eeb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:34.665665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-690a0112-6ba7-4e80-9ab2-fd449c144eeb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:34.666211 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-690a0112-6ba7-4e80-9ab2-fd449c144eeb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:34.802646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-690a0112-6ba7-4e80-9ab2-fd449c144eeb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:34.811746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-690a0112-6ba7-4e80-9ab2-fd449c144eeb tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159934 Jun 02 19:27:34.812326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1329/2651] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:34 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:35.115666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e70181ae-6986-4ada-aa0c-7a8ee432f6f2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:35.116231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e70181ae-6986-4ada-aa0c-7a8ee432f6f2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:35.123138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e70181ae-6986-4ada-aa0c-7a8ee432f6f2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:35.123580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e70181ae-6986-4ada-aa0c-7a8ee432f6f2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:35.124406 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e70181ae-6986-4ada-aa0c-7a8ee432f6f2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:35.124836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e70181ae-6986-4ada-aa0c-7a8ee432f6f2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:35.186960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e70181ae-6986-4ada-aa0c-7a8ee432f6f2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:35.195054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e70181ae-6986-4ada-aa0c-7a8ee432f6f2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.083285 Jun 02 19:27:35.195603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1323/2652] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:35.829073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e7d294b6-cb40-481e-a5e2-d66fe83482bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:35.829659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e7d294b6-cb40-481e-a5e2-d66fe83482bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:35.836729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7d294b6-cb40-481e-a5e2-d66fe83482bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:35.837196 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7d294b6-cb40-481e-a5e2-d66fe83482bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:35.838016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7d294b6-cb40-481e-a5e2-d66fe83482bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:35.838460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e7d294b6-cb40-481e-a5e2-d66fe83482bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:35.972486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e7d294b6-cb40-481e-a5e2-d66fe83482bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:35.981090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e7d294b6-cb40-481e-a5e2-d66fe83482bf tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156034 Jun 02 19:27:35.981658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1330/2653] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:35 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:36.212501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c527f4da-5efc-47e9-ac69-f2cb24701a18 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:36.213140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c527f4da-5efc-47e9-ac69-f2cb24701a18 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:36.220203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c527f4da-5efc-47e9-ac69-f2cb24701a18 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:36.220653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c527f4da-5efc-47e9-ac69-f2cb24701a18 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:36.221401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c527f4da-5efc-47e9-ac69-f2cb24701a18 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:36.221841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c527f4da-5efc-47e9-ac69-f2cb24701a18 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:36.282742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c527f4da-5efc-47e9-ac69-f2cb24701a18 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:36.290773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c527f4da-5efc-47e9-ac69-f2cb24701a18 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.082219 Jun 02 19:27:36.291317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1324/2654] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:36 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:36.999071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-457bd45f-9050-4c60-b5dd-156f2714206d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:36.999921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-457bd45f-9050-4c60-b5dd-156f2714206d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:37.008266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-457bd45f-9050-4c60-b5dd-156f2714206d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:37.009313 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-457bd45f-9050-4c60-b5dd-156f2714206d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:37.010582 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-457bd45f-9050-4c60-b5dd-156f2714206d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:37.011086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-457bd45f-9050-4c60-b5dd-156f2714206d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:37.149321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-457bd45f-9050-4c60-b5dd-156f2714206d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:37.157709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-457bd45f-9050-4c60-b5dd-156f2714206d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162843 Jun 02 19:27:37.158316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1331/2655] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:36 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:37.308200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-84a405c2-d013-417a-9b2d-f6f94e69118e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:37.309256 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84a405c2-d013-417a-9b2d-f6f94e69118e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:37.316969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84a405c2-d013-417a-9b2d-f6f94e69118e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:37.317411 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84a405c2-d013-417a-9b2d-f6f94e69118e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:37.318217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84a405c2-d013-417a-9b2d-f6f94e69118e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:37.318652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84a405c2-d013-417a-9b2d-f6f94e69118e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:37.381018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-84a405c2-d013-417a-9b2d-f6f94e69118e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:37.390008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-84a405c2-d013-417a-9b2d-f6f94e69118e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085726 Jun 02 19:27:37.390576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1325/2656] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:38.175673 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0273b2b2-72a0-4dbb-8feb-3937f5b1eab5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:38.176694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0273b2b2-72a0-4dbb-8feb-3937f5b1eab5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:38.185978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0273b2b2-72a0-4dbb-8feb-3937f5b1eab5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:38.186428 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0273b2b2-72a0-4dbb-8feb-3937f5b1eab5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:38.187197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0273b2b2-72a0-4dbb-8feb-3937f5b1eab5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:38.187637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0273b2b2-72a0-4dbb-8feb-3937f5b1eab5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:38.323612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0273b2b2-72a0-4dbb-8feb-3937f5b1eab5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:38.332157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0273b2b2-72a0-4dbb-8feb-3937f5b1eab5 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161299 Jun 02 19:27:38.332735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1332/2657] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:38 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:38.407301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8d7bea7a-7491-44bf-a1b2-23f06a439110 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:38.407926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8d7bea7a-7491-44bf-a1b2-23f06a439110 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:38.414908 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d7bea7a-7491-44bf-a1b2-23f06a439110 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:38.415363 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d7bea7a-7491-44bf-a1b2-23f06a439110 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:38.416117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d7bea7a-7491-44bf-a1b2-23f06a439110 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:38.416548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8d7bea7a-7491-44bf-a1b2-23f06a439110 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:38.479614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8d7bea7a-7491-44bf-a1b2-23f06a439110 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:38.482432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:38.489726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8d7bea7a-7491-44bf-a1b2-23f06a439110 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086354 Jun 02 19:27:38.490302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1326/2658] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:39.350772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fa5b1352-f499-44cb-8ca4-86922f31a421 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:39.351404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fa5b1352-f499-44cb-8ca4-86922f31a421 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:39.358745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa5b1352-f499-44cb-8ca4-86922f31a421 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:39.359200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa5b1352-f499-44cb-8ca4-86922f31a421 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:39.359968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa5b1352-f499-44cb-8ca4-86922f31a421 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:39.360414 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa5b1352-f499-44cb-8ca4-86922f31a421 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:39.500674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fa5b1352-f499-44cb-8ca4-86922f31a421 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:39.507519 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f25251e3-20c0-4d36-8318-cc0264360874 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:39.508144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f25251e3-20c0-4d36-8318-cc0264360874 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:39.509431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fa5b1352-f499-44cb-8ca4-86922f31a421 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162693 Jun 02 19:27:39.510051 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1333/2659] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:39 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:39.510731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=54 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:39.516814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f25251e3-20c0-4d36-8318-cc0264360874 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:39.517210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f25251e3-20c0-4d36-8318-cc0264360874 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:39.518012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f25251e3-20c0-4d36-8318-cc0264360874 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:39.518426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f25251e3-20c0-4d36-8318-cc0264360874 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:39.581558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f25251e3-20c0-4d36-8318-cc0264360874 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:39.589689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f25251e3-20c0-4d36-8318-cc0264360874 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085973 Jun 02 19:27:39.590279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1327/2660] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:27:40.526442 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-61976109-7f37-475b-9b95-58cb27e00630 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:40.527152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-61976109-7f37-475b-9b95-58cb27e00630 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:40.534490 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61976109-7f37-475b-9b95-58cb27e00630 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:40.535265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61976109-7f37-475b-9b95-58cb27e00630 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:40.535693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61976109-7f37-475b-9b95-58cb27e00630 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:40.536126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61976109-7f37-475b-9b95-58cb27e00630 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:40.607478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-04d4c4e2-59a7-4d39-86d1-a8aa635e5c7c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:40.608104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-04d4c4e2-59a7-4d39-86d1-a8aa635e5c7c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:40.615140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04d4c4e2-59a7-4d39-86d1-a8aa635e5c7c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:40.615596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04d4c4e2-59a7-4d39-86d1-a8aa635e5c7c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:40.616389 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04d4c4e2-59a7-4d39-86d1-a8aa635e5c7c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:40.616818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04d4c4e2-59a7-4d39-86d1-a8aa635e5c7c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:40.694376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-04d4c4e2-59a7-4d39-86d1-a8aa635e5c7c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:40.698898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-61976109-7f37-475b-9b95-58cb27e00630 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:40.703297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-04d4c4e2-59a7-4d39-86d1-a8aa635e5c7c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.100365 Jun 02 19:27:40.703876 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1328/2661] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:40.707712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-61976109-7f37-475b-9b95-58cb27e00630 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.185237 Jun 02 19:27:40.708309 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1334/2662] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:40 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:41.720807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-65304ef9-ee83-4e59-8c0d-b7e94c39b3af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:41.721456 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-65304ef9-ee83-4e59-8c0d-b7e94c39b3af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:41.725011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1c563337-d922-45fa-8a5c-acb0a94804ce tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:41.725644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1c563337-d922-45fa-8a5c-acb0a94804ce tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:41.728419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65304ef9-ee83-4e59-8c0d-b7e94c39b3af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:41.728977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65304ef9-ee83-4e59-8c0d-b7e94c39b3af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:41.729664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65304ef9-ee83-4e59-8c0d-b7e94c39b3af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:41.730371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-65304ef9-ee83-4e59-8c0d-b7e94c39b3af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:41.732682 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c563337-d922-45fa-8a5c-acb0a94804ce tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:41.733144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c563337-d922-45fa-8a5c-acb0a94804ce tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:41.733947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c563337-d922-45fa-8a5c-acb0a94804ce tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:41.734392 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c563337-d922-45fa-8a5c-acb0a94804ce tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:41.826129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-65304ef9-ee83-4e59-8c0d-b7e94c39b3af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:41.834613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-65304ef9-ee83-4e59-8c0d-b7e94c39b3af tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.117741 Jun 02 19:27:41.835187 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1329/2663] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:41.894719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1c563337-d922-45fa-8a5c-acb0a94804ce tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:41.902924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1c563337-d922-45fa-8a5c-acb0a94804ce tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.181872 Jun 02 19:27:41.903541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1335/2664] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:41 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:42.853419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ae203ead-19d9-491f-a8eb-78db5bb68e02 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:42.854189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ae203ead-19d9-491f-a8eb-78db5bb68e02 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:42.861405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae203ead-19d9-491f-a8eb-78db5bb68e02 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:42.861883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae203ead-19d9-491f-a8eb-78db5bb68e02 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:42.862762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae203ead-19d9-491f-a8eb-78db5bb68e02 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:42.863193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae203ead-19d9-491f-a8eb-78db5bb68e02 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:42.922367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-98afb533-3252-4e78-be38-e700739e48f3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:42.923274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-98afb533-3252-4e78-be38-e700739e48f3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:42.928830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ae203ead-19d9-491f-a8eb-78db5bb68e02 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:42.931193 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98afb533-3252-4e78-be38-e700739e48f3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:42.931774 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98afb533-3252-4e78-be38-e700739e48f3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:42.932665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98afb533-3252-4e78-be38-e700739e48f3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:42.933594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-98afb533-3252-4e78-be38-e700739e48f3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:42.937849 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ae203ead-19d9-491f-a8eb-78db5bb68e02 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089372 Jun 02 19:27:42.938640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1330/2665] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:43.075823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-98afb533-3252-4e78-be38-e700739e48f3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:43.084775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-98afb533-3252-4e78-be38-e700739e48f3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167701 Jun 02 19:27:43.085372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1336/2666] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:42 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:27:43.960982 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fa6e3967-398d-4bb4-89e2-2bcca740a61f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:43.961979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fa6e3967-398d-4bb4-89e2-2bcca740a61f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:43.970326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fa6e3967-398d-4bb4-89e2-2bcca740a61f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:43.970770 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fa6e3967-398d-4bb4-89e2-2bcca740a61f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:43.971517 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fa6e3967-398d-4bb4-89e2-2bcca740a61f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:43.971940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fa6e3967-398d-4bb4-89e2-2bcca740a61f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:44.039628 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fa6e3967-398d-4bb4-89e2-2bcca740a61f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:44.049550 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fa6e3967-398d-4bb4-89e2-2bcca740a61f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095318 Jun 02 19:27:44.050155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1331/2667] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:44.106154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e8c4a85b-cc24-48d2-94b1-ff806e12ac97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:44.106728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e8c4a85b-cc24-48d2-94b1-ff806e12ac97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:44.113833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8c4a85b-cc24-48d2-94b1-ff806e12ac97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:44.114334 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8c4a85b-cc24-48d2-94b1-ff806e12ac97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:44.115099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8c4a85b-cc24-48d2-94b1-ff806e12ac97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:44.115539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8c4a85b-cc24-48d2-94b1-ff806e12ac97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:44.257064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8c4a85b-cc24-48d2-94b1-ff806e12ac97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:44.265994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e8c4a85b-cc24-48d2-94b1-ff806e12ac97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166454 Jun 02 19:27:44.266568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1337/2668] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:44 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:45.067249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fd29f940-157c-48f0-b563-39b2e599f7c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:45.067874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fd29f940-157c-48f0-b563-39b2e599f7c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:45.075090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd29f940-157c-48f0-b563-39b2e599f7c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:45.075540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd29f940-157c-48f0-b563-39b2e599f7c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:45.076311 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd29f940-157c-48f0-b563-39b2e599f7c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:45.076742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fd29f940-157c-48f0-b563-39b2e599f7c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:45.139591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fd29f940-157c-48f0-b563-39b2e599f7c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:45.147878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fd29f940-157c-48f0-b563-39b2e599f7c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.084733 Jun 02 19:27:45.148439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1332/2669] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:45.284410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9f181d74-6265-4461-94fe-ccd13e147e3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:45.285035 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9f181d74-6265-4461-94fe-ccd13e147e3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:45.291502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f181d74-6265-4461-94fe-ccd13e147e3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:45.291958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f181d74-6265-4461-94fe-ccd13e147e3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:45.293062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f181d74-6265-4461-94fe-ccd13e147e3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:45.293643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f181d74-6265-4461-94fe-ccd13e147e3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:45.658596 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9f181d74-6265-4461-94fe-ccd13e147e3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:45.667987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9f181d74-6265-4461-94fe-ccd13e147e3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.387457 Jun 02 19:27:45.668895 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1338/2670] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:45 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:46.165216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b68dcd7c-65d3-4f4a-bb99-a12490ea6447 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:46.166468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b68dcd7c-65d3-4f4a-bb99-a12490ea6447 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:46.173604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b68dcd7c-65d3-4f4a-bb99-a12490ea6447 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:46.174085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b68dcd7c-65d3-4f4a-bb99-a12490ea6447 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:46.174848 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b68dcd7c-65d3-4f4a-bb99-a12490ea6447 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:46.175279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b68dcd7c-65d3-4f4a-bb99-a12490ea6447 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:46.237989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b68dcd7c-65d3-4f4a-bb99-a12490ea6447 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:46.246698 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b68dcd7c-65d3-4f4a-bb99-a12490ea6447 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085259 Jun 02 19:27:46.247267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1333/2671] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:46.686755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4d1024c1-fa29-4c07-880b-489d14ae36c8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:46.687381 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4d1024c1-fa29-4c07-880b-489d14ae36c8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:46.694396 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d1024c1-fa29-4c07-880b-489d14ae36c8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:46.694847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d1024c1-fa29-4c07-880b-489d14ae36c8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:46.695609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d1024c1-fa29-4c07-880b-489d14ae36c8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:46.696039 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d1024c1-fa29-4c07-880b-489d14ae36c8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:46.827867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4d1024c1-fa29-4c07-880b-489d14ae36c8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:46.837061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4d1024c1-fa29-4c07-880b-489d14ae36c8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.154500 Jun 02 19:27:46.838036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1339/2672] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:46 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:47.266932 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4edc766c-79b1-4c5d-acdb-59863b51de9e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:47.267676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4edc766c-79b1-4c5d-acdb-59863b51de9e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:47.278050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4edc766c-79b1-4c5d-acdb-59863b51de9e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:47.278549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4edc766c-79b1-4c5d-acdb-59863b51de9e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:47.279648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4edc766c-79b1-4c5d-acdb-59863b51de9e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:47.280298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4edc766c-79b1-4c5d-acdb-59863b51de9e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:47.350696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4edc766c-79b1-4c5d-acdb-59863b51de9e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:47.359304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4edc766c-79b1-4c5d-acdb-59863b51de9e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098026 Jun 02 19:27:47.359868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1334/2673] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:47.856254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c1442bb0-3158-4dbe-ad6a-bc9e23242d8c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:47.856900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c1442bb0-3158-4dbe-ad6a-bc9e23242d8c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:47.863546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1442bb0-3158-4dbe-ad6a-bc9e23242d8c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:47.864008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1442bb0-3158-4dbe-ad6a-bc9e23242d8c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:47.864775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1442bb0-3158-4dbe-ad6a-bc9e23242d8c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:47.865210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1442bb0-3158-4dbe-ad6a-bc9e23242d8c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:47.999900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c1442bb0-3158-4dbe-ad6a-bc9e23242d8c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:48.008952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c1442bb0-3158-4dbe-ad6a-bc9e23242d8c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156925 Jun 02 19:27:48.009728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1340/2674] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:47 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:48.376733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ab0aef9d-9f98-4a96-a60e-1bed1e5811f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:48.378201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ab0aef9d-9f98-4a96-a60e-1bed1e5811f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:48.385609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab0aef9d-9f98-4a96-a60e-1bed1e5811f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:48.386365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab0aef9d-9f98-4a96-a60e-1bed1e5811f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:48.387766 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab0aef9d-9f98-4a96-a60e-1bed1e5811f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:48.388182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab0aef9d-9f98-4a96-a60e-1bed1e5811f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:48.479076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ab0aef9d-9f98-4a96-a60e-1bed1e5811f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:48.492091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ab0aef9d-9f98-4a96-a60e-1bed1e5811f4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.118866 Jun 02 19:27:48.493072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1335/2675] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:49.026857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e17d9b37-10aa-468f-b863-02b4f177560c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:49.028099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e17d9b37-10aa-468f-b863-02b4f177560c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:49.035983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e17d9b37-10aa-468f-b863-02b4f177560c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:49.036433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e17d9b37-10aa-468f-b863-02b4f177560c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:49.037206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e17d9b37-10aa-468f-b863-02b4f177560c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:49.037646 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e17d9b37-10aa-468f-b863-02b4f177560c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:49.174924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e17d9b37-10aa-468f-b863-02b4f177560c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:49.183679 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e17d9b37-10aa-468f-b863-02b4f177560c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160582 Jun 02 19:27:49.195012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1341/2676] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:49 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:49.510528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3bad5fb6-cc04-4045-83f3-0572deae8a97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:49.511123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3bad5fb6-cc04-4045-83f3-0572deae8a97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:49.518700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3bad5fb6-cc04-4045-83f3-0572deae8a97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:49.519962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3bad5fb6-cc04-4045-83f3-0572deae8a97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:49.521367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3bad5fb6-cc04-4045-83f3-0572deae8a97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:49.522158 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3bad5fb6-cc04-4045-83f3-0572deae8a97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:49.597721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3bad5fb6-cc04-4045-83f3-0572deae8a97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:49.606799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3bad5fb6-cc04-4045-83f3-0572deae8a97 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.100141 Jun 02 19:27:49.607419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1336/2677] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:49.975542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-908dd953-6eaf-4d97-bd7c-fd6d2639a425 req-d3a5097b-cd1e-407b-9885-bb238b9348a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55119d3-172d-4b7c-87ad-7423adea1aba", "name": "network-vif-deleted", "tag": "029f6b36-13f6-4804-b5ae-07f754bd87bb"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:27:49.984397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-908dd953-6eaf-4d97-bd7c-fd6d2639a425 req-d3a5097b-cd1e-407b-9885-bb238b9348a8 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:49.984899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-908dd953-6eaf-4d97-bd7c-fd6d2639a425 req-d3a5097b-cd1e-407b-9885-bb238b9348a8 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:49.998114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-908dd953-6eaf-4d97-bd7c-fd6d2639a425 req-d3a5097b-cd1e-407b-9885-bb238b9348a8 service nova] Creating event network-vif-deleted:029f6b36-13f6-4804-b5ae-07f754bd87bb for instance d55119d3-172d-4b7c-87ad-7423adea1aba on hv-cinder-79760 Jun 02 19:27:50.004958 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-908dd953-6eaf-4d97-bd7c-fd6d2639a425 req-d3a5097b-cd1e-407b-9885-bb238b9348a8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033112 Jun 02 19:27:50.005577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1342/2678] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:27:50.204199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b5132edd-3626-4ecb-819b-918cedd21a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:50.204919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b5132edd-3626-4ecb-819b-918cedd21a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:50.211057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5132edd-3626-4ecb-819b-918cedd21a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:50.211516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5132edd-3626-4ecb-819b-918cedd21a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:50.212281 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5132edd-3626-4ecb-819b-918cedd21a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:50.212717 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5132edd-3626-4ecb-819b-918cedd21a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:50.356254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b5132edd-3626-4ecb-819b-918cedd21a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:50.365112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b5132edd-3626-4ecb-819b-918cedd21a1c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165395 Jun 02 19:27:50.365727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1337/2679] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:50 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:50.626079 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d8783530-4eb5-4825-80a8-881b13f61a83 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:50.626744 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d8783530-4eb5-4825-80a8-881b13f61a83 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:50.634180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d8783530-4eb5-4825-80a8-881b13f61a83 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:50.634640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d8783530-4eb5-4825-80a8-881b13f61a83 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:50.635423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d8783530-4eb5-4825-80a8-881b13f61a83 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:50.635864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d8783530-4eb5-4825-80a8-881b13f61a83 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:50.708698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d8783530-4eb5-4825-80a8-881b13f61a83 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:50.712296 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:50.717571 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d8783530-4eb5-4825-80a8-881b13f61a83 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.096015 Jun 02 19:27:50.718223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1343/2680] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:51.383216 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8feb15d9-d5c0-4a63-8351-c8af32fd2d82 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:51.383831 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8feb15d9-d5c0-4a63-8351-c8af32fd2d82 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:51.395915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8feb15d9-d5c0-4a63-8351-c8af32fd2d82 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:51.395915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8feb15d9-d5c0-4a63-8351-c8af32fd2d82 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:51.395915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8feb15d9-d5c0-4a63-8351-c8af32fd2d82 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:51.395915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8feb15d9-d5c0-4a63-8351-c8af32fd2d82 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:51.530639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8feb15d9-d5c0-4a63-8351-c8af32fd2d82 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:51.540940 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8feb15d9-d5c0-4a63-8351-c8af32fd2d82 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161622 Jun 02 19:27:51.541504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1338/2681] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:51 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:51.736941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d9532d97-7ef0-412d-bef4-b7f852d8e5fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:51.737525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d9532d97-7ef0-412d-bef4-b7f852d8e5fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:51.744453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9532d97-7ef0-412d-bef4-b7f852d8e5fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:51.744922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9532d97-7ef0-412d-bef4-b7f852d8e5fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:51.745718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9532d97-7ef0-412d-bef4-b7f852d8e5fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:51.746194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9532d97-7ef0-412d-bef4-b7f852d8e5fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:51.807588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d9532d97-7ef0-412d-bef4-b7f852d8e5fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:51.820425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d9532d97-7ef0-412d-bef4-b7f852d8e5fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.087809 Jun 02 19:27:51.821011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1344/2682] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:52.564644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e768e64d-5b05-4cc7-b3ab-89dd02cd4d45 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:52.565253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e768e64d-5b05-4cc7-b3ab-89dd02cd4d45 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:52.573472 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e768e64d-5b05-4cc7-b3ab-89dd02cd4d45 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:52.573985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e768e64d-5b05-4cc7-b3ab-89dd02cd4d45 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:52.574861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e768e64d-5b05-4cc7-b3ab-89dd02cd4d45 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:52.575288 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e768e64d-5b05-4cc7-b3ab-89dd02cd4d45 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:52.718962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e768e64d-5b05-4cc7-b3ab-89dd02cd4d45 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:52.727824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e768e64d-5b05-4cc7-b3ab-89dd02cd4d45 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168077 Jun 02 19:27:52.728407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1339/2683] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:52 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:52.839443 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1885e57c-2281-4b45-befa-569b5c57b306 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:52.840078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1885e57c-2281-4b45-befa-569b5c57b306 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:52.846946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1885e57c-2281-4b45-befa-569b5c57b306 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:52.847393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1885e57c-2281-4b45-befa-569b5c57b306 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:52.848164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1885e57c-2281-4b45-befa-569b5c57b306 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:52.848627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1885e57c-2281-4b45-befa-569b5c57b306 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:52.919452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1885e57c-2281-4b45-befa-569b5c57b306 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:52.927885 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1885e57c-2281-4b45-befa-569b5c57b306 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092437 Jun 02 19:27:52.928469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1345/2684] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:53.745904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d2a5e3ed-5cf3-420d-abbd-e00371dc24b2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:53.746701 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d2a5e3ed-5cf3-420d-abbd-e00371dc24b2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:53.753564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2a5e3ed-5cf3-420d-abbd-e00371dc24b2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:53.754045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2a5e3ed-5cf3-420d-abbd-e00371dc24b2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:53.754977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2a5e3ed-5cf3-420d-abbd-e00371dc24b2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:53.755410 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2a5e3ed-5cf3-420d-abbd-e00371dc24b2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:53.893464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d2a5e3ed-5cf3-420d-abbd-e00371dc24b2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:53.902024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d2a5e3ed-5cf3-420d-abbd-e00371dc24b2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160003 Jun 02 19:27:53.902988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1340/2685] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:53 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:53.945092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5fde9f91-76db-456a-a9a3-b35c3ce0ec48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:53.945713 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5fde9f91-76db-456a-a9a3-b35c3ce0ec48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:53.953410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5fde9f91-76db-456a-a9a3-b35c3ce0ec48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:53.953902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5fde9f91-76db-456a-a9a3-b35c3ce0ec48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:53.954675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5fde9f91-76db-456a-a9a3-b35c3ce0ec48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:53.955114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5fde9f91-76db-456a-a9a3-b35c3ce0ec48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:54.025354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5fde9f91-76db-456a-a9a3-b35c3ce0ec48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:54.037912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5fde9f91-76db-456a-a9a3-b35c3ce0ec48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.096686 Jun 02 19:27:54.038641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1346/2686] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:54.920855 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e795a039-d7eb-4a46-b102-e5856663c996 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:54.921505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e795a039-d7eb-4a46-b102-e5856663c996 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:54.935674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e795a039-d7eb-4a46-b102-e5856663c996 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:54.936114 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e795a039-d7eb-4a46-b102-e5856663c996 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:54.936882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e795a039-d7eb-4a46-b102-e5856663c996 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:54.937305 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e795a039-d7eb-4a46-b102-e5856663c996 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:55.057938 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-73d937e1-4202-4dde-9f96-1208ff3b79c7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:55.058603 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-73d937e1-4202-4dde-9f96-1208ff3b79c7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:55.066095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d937e1-4202-4dde-9f96-1208ff3b79c7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:55.066562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d937e1-4202-4dde-9f96-1208ff3b79c7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:55.067351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d937e1-4202-4dde-9f96-1208ff3b79c7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:55.067798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d937e1-4202-4dde-9f96-1208ff3b79c7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:55.082772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e795a039-d7eb-4a46-b102-e5856663c996 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:55.091052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e795a039-d7eb-4a46-b102-e5856663c996 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174628 Jun 02 19:27:55.091697 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1341/2687] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:54 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:55.130628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-73d937e1-4202-4dde-9f96-1208ff3b79c7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:55.139138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-73d937e1-4202-4dde-9f96-1208ff3b79c7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085159 Jun 02 19:27:55.139722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1347/2688] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:55 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:56.109217 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ffd040cc-e2f7-4c00-b9ef-dce002acb93c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:56.109881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ffd040cc-e2f7-4c00-b9ef-dce002acb93c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:56.116928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffd040cc-e2f7-4c00-b9ef-dce002acb93c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:56.117369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffd040cc-e2f7-4c00-b9ef-dce002acb93c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:56.118163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffd040cc-e2f7-4c00-b9ef-dce002acb93c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:56.118587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ffd040cc-e2f7-4c00-b9ef-dce002acb93c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:56.156586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-832fa88f-f340-4eb7-9ddf-7a4db55c4e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:56.157232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-832fa88f-f340-4eb7-9ddf-7a4db55c4e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:56.164542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-832fa88f-f340-4eb7-9ddf-7a4db55c4e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:56.165005 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-832fa88f-f340-4eb7-9ddf-7a4db55c4e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:56.165807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-832fa88f-f340-4eb7-9ddf-7a4db55c4e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:56.166269 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-832fa88f-f340-4eb7-9ddf-7a4db55c4e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:56.244162 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-832fa88f-f340-4eb7-9ddf-7a4db55c4e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:56.252970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-832fa88f-f340-4eb7-9ddf-7a4db55c4e34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.100412 Jun 02 19:27:56.253551 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1348/2689] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:56.282069 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ffd040cc-e2f7-4c00-b9ef-dce002acb93c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:56.290154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ffd040cc-e2f7-4c00-b9ef-dce002acb93c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.185087 Jun 02 19:27:56.290716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1342/2690] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:56 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:57.272409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-619530de-bb4e-470c-bc3f-33cedd352e05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:57.273026 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-619530de-bb4e-470c-bc3f-33cedd352e05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:57.280493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-619530de-bb4e-470c-bc3f-33cedd352e05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:57.280954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-619530de-bb4e-470c-bc3f-33cedd352e05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:57.281733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-619530de-bb4e-470c-bc3f-33cedd352e05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:57.282217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-619530de-bb4e-470c-bc3f-33cedd352e05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:57.308274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1573cc8b-e85c-407b-b27e-2219a4c33b2d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:57.309349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1573cc8b-e85c-407b-b27e-2219a4c33b2d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:57.316783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1573cc8b-e85c-407b-b27e-2219a4c33b2d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:57.317230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1573cc8b-e85c-407b-b27e-2219a4c33b2d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:57.318014 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1573cc8b-e85c-407b-b27e-2219a4c33b2d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:57.318455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1573cc8b-e85c-407b-b27e-2219a4c33b2d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:57.334412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:57.344953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-619530de-bb4e-470c-bc3f-33cedd352e05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:57.353394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-619530de-bb4e-470c-bc3f-33cedd352e05 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.084922 Jun 02 19:27:57.354671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1349/2691] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:57.454774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1573cc8b-e85c-407b-b27e-2219a4c33b2d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:57.463009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1573cc8b-e85c-407b-b27e-2219a4c33b2d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.158619 Jun 02 19:27:57.463571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1343/2692] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:57 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:58.371727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4e3fe152-571d-48a8-98ea-a23f71913235 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:58.372542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4e3fe152-571d-48a8-98ea-a23f71913235 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:58.379199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e3fe152-571d-48a8-98ea-a23f71913235 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:58.379652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e3fe152-571d-48a8-98ea-a23f71913235 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:58.380407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e3fe152-571d-48a8-98ea-a23f71913235 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:58.380847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e3fe152-571d-48a8-98ea-a23f71913235 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:58.445500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4e3fe152-571d-48a8-98ea-a23f71913235 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:58.454226 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4e3fe152-571d-48a8-98ea-a23f71913235 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086805 Jun 02 19:27:58.454814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1350/2693] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:58.480805 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b4730e0e-4993-4714-812f-a839736c64a9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:58.481835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b4730e0e-4993-4714-812f-a839736c64a9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:58.488797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4730e0e-4993-4714-812f-a839736c64a9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:58.489270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4730e0e-4993-4714-812f-a839736c64a9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:58.490082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4730e0e-4993-4714-812f-a839736c64a9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:58.490486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4730e0e-4993-4714-812f-a839736c64a9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:58.625144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b4730e0e-4993-4714-812f-a839736c64a9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:58.633660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b4730e0e-4993-4714-812f-a839736c64a9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156945 Jun 02 19:27:58.634287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1344/2694] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:58 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:59.472297 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0bfad6da-5cd2-4d56-bc50-9c6550109591 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:59.472933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0bfad6da-5cd2-4d56-bc50-9c6550109591 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:59.479894 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0bfad6da-5cd2-4d56-bc50-9c6550109591 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:59.480402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0bfad6da-5cd2-4d56-bc50-9c6550109591 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:59.480402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0bfad6da-5cd2-4d56-bc50-9c6550109591 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:59.482203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0bfad6da-5cd2-4d56-bc50-9c6550109591 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:59.564531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0bfad6da-5cd2-4d56-bc50-9c6550109591 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:59.576249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0bfad6da-5cd2-4d56-bc50-9c6550109591 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.107603 Jun 02 19:27:59.576990 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1351/2695] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:27:59.654557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f9b41f5f-9ea1-42f1-a401-1e8e187769b9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:27:59.655190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f9b41f5f-9ea1-42f1-a401-1e8e187769b9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:27:59.661433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9b41f5f-9ea1-42f1-a401-1e8e187769b9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:59.661936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9b41f5f-9ea1-42f1-a401-1e8e187769b9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:59.662691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9b41f5f-9ea1-42f1-a401-1e8e187769b9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:27:59.663119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f9b41f5f-9ea1-42f1-a401-1e8e187769b9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:27:59.805182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f9b41f5f-9ea1-42f1-a401-1e8e187769b9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:27:59.815703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f9b41f5f-9ea1-42f1-a401-1e8e187769b9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167023 Jun 02 19:27:59.816278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1345/2696] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:27:59 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:00.598730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-55b0c7ab-9428-4672-961b-39ee7703be67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:00.599379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-55b0c7ab-9428-4672-961b-39ee7703be67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:00.606213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55b0c7ab-9428-4672-961b-39ee7703be67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:00.606670 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55b0c7ab-9428-4672-961b-39ee7703be67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:00.607408 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55b0c7ab-9428-4672-961b-39ee7703be67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:00.607841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55b0c7ab-9428-4672-961b-39ee7703be67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:00.670511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-55b0c7ab-9428-4672-961b-39ee7703be67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:00.678953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-55b0c7ab-9428-4672-961b-39ee7703be67 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.084162 Jun 02 19:28:00.679773 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1352/2697] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:00.833906 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3245ac22-2345-408e-ad67-128f42c1d1f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:00.834465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3245ac22-2345-408e-ad67-128f42c1d1f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:00.841404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3245ac22-2345-408e-ad67-128f42c1d1f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:00.841815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3245ac22-2345-408e-ad67-128f42c1d1f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:00.842594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3245ac22-2345-408e-ad67-128f42c1d1f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:00.843021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3245ac22-2345-408e-ad67-128f42c1d1f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:00.991866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3245ac22-2345-408e-ad67-128f42c1d1f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:01.000666 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3245ac22-2345-408e-ad67-128f42c1d1f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.170804 Jun 02 19:28:01.001240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1346/2698] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:00 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:01.697485 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ebbc46c1-c345-4fd3-a541-8d48a33c3b6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:01.698136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ebbc46c1-c345-4fd3-a541-8d48a33c3b6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:01.705728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebbc46c1-c345-4fd3-a541-8d48a33c3b6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:01.706388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebbc46c1-c345-4fd3-a541-8d48a33c3b6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:01.707494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebbc46c1-c345-4fd3-a541-8d48a33c3b6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:01.708075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebbc46c1-c345-4fd3-a541-8d48a33c3b6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:01.774912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ebbc46c1-c345-4fd3-a541-8d48a33c3b6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:01.783558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ebbc46c1-c345-4fd3-a541-8d48a33c3b6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090177 Jun 02 19:28:01.784134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1353/2699] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:02.019915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b25d3403-eff7-468a-ab60-55c08b115d9f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:02.020716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b25d3403-eff7-468a-ab60-55c08b115d9f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:02.027644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b25d3403-eff7-468a-ab60-55c08b115d9f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:02.028279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b25d3403-eff7-468a-ab60-55c08b115d9f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:02.029046 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b25d3403-eff7-468a-ab60-55c08b115d9f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:02.029478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b25d3403-eff7-468a-ab60-55c08b115d9f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:02.166418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b25d3403-eff7-468a-ab60-55c08b115d9f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:02.175022 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b25d3403-eff7-468a-ab60-55c08b115d9f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159014 Jun 02 19:28:02.175588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1347/2700] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:02 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:02.801239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ba9d552e-26e4-47d6-826c-390d793cdbe6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:02.801839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ba9d552e-26e4-47d6-826c-390d793cdbe6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:02.808720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba9d552e-26e4-47d6-826c-390d793cdbe6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:02.809174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba9d552e-26e4-47d6-826c-390d793cdbe6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:02.810322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba9d552e-26e4-47d6-826c-390d793cdbe6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:02.810759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba9d552e-26e4-47d6-826c-390d793cdbe6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:02.876242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ba9d552e-26e4-47d6-826c-390d793cdbe6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:02.885121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ba9d552e-26e4-47d6-826c-390d793cdbe6 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.087997 Jun 02 19:28:02.885687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1354/2701] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:03.193135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c8c2f32d-eaf1-48ae-a766-b0b03f077cb9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:03.193740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c8c2f32d-eaf1-48ae-a766-b0b03f077cb9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:03.200759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8c2f32d-eaf1-48ae-a766-b0b03f077cb9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:03.201210 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8c2f32d-eaf1-48ae-a766-b0b03f077cb9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:03.202018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8c2f32d-eaf1-48ae-a766-b0b03f077cb9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:03.202452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8c2f32d-eaf1-48ae-a766-b0b03f077cb9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:03.334015 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c8c2f32d-eaf1-48ae-a766-b0b03f077cb9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:03.342758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c8c2f32d-eaf1-48ae-a766-b0b03f077cb9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.153593 Jun 02 19:28:03.343318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1348/2702] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:03 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:03.903272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-61b0dfbd-b170-4c35-bebd-bad478d8ce37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:03.903897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-61b0dfbd-b170-4c35-bebd-bad478d8ce37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:03.911125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61b0dfbd-b170-4c35-bebd-bad478d8ce37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:03.911564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61b0dfbd-b170-4c35-bebd-bad478d8ce37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:03.912327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61b0dfbd-b170-4c35-bebd-bad478d8ce37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:03.912760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-61b0dfbd-b170-4c35-bebd-bad478d8ce37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:03.977474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-61b0dfbd-b170-4c35-bebd-bad478d8ce37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:03.985979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-61b0dfbd-b170-4c35-bebd-bad478d8ce37 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086966 Jun 02 19:28:03.986547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1355/2703] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:04.362353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0c6ff8a1-ac19-41c1-b8d0-eb5fe98638f7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:04.362930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0c6ff8a1-ac19-41c1-b8d0-eb5fe98638f7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:04.369895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c6ff8a1-ac19-41c1-b8d0-eb5fe98638f7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:04.370345 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c6ff8a1-ac19-41c1-b8d0-eb5fe98638f7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:04.371232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c6ff8a1-ac19-41c1-b8d0-eb5fe98638f7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:04.371708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0c6ff8a1-ac19-41c1-b8d0-eb5fe98638f7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:04.508161 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0c6ff8a1-ac19-41c1-b8d0-eb5fe98638f7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:04.516604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0c6ff8a1-ac19-41c1-b8d0-eb5fe98638f7 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160342 Jun 02 19:28:04.517180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1349/2704] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:04 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:05.003457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2c926ee6-fcd3-4489-80fc-e739489b2352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:05.004106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2c926ee6-fcd3-4489-80fc-e739489b2352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:05.006407 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:05.012918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c926ee6-fcd3-4489-80fc-e739489b2352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:05.013421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c926ee6-fcd3-4489-80fc-e739489b2352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:05.014219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c926ee6-fcd3-4489-80fc-e739489b2352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:05.014659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2c926ee6-fcd3-4489-80fc-e739489b2352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:05.077430 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2c926ee6-fcd3-4489-80fc-e739489b2352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:05.085902 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2c926ee6-fcd3-4489-80fc-e739489b2352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086314 Jun 02 19:28:05.086469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1356/2705] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:05.534462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-03d8ded5-5c66-4651-a68c-b8a55362d4ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:05.535079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-03d8ded5-5c66-4651-a68c-b8a55362d4ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:05.542431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03d8ded5-5c66-4651-a68c-b8a55362d4ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:05.543009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03d8ded5-5c66-4651-a68c-b8a55362d4ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:05.543778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03d8ded5-5c66-4651-a68c-b8a55362d4ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:05.544233 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-03d8ded5-5c66-4651-a68c-b8a55362d4ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:05.677901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-03d8ded5-5c66-4651-a68c-b8a55362d4ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:05.687400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-03d8ded5-5c66-4651-a68c-b8a55362d4ba tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156998 Jun 02 19:28:05.687967 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1350/2706] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:05 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:06.103987 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-07ca2f90-17d5-4e26-a7e3-6817c6ed3661 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:06.104618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-07ca2f90-17d5-4e26-a7e3-6817c6ed3661 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:06.111612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07ca2f90-17d5-4e26-a7e3-6817c6ed3661 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:06.112070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07ca2f90-17d5-4e26-a7e3-6817c6ed3661 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:06.112827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07ca2f90-17d5-4e26-a7e3-6817c6ed3661 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:06.113265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07ca2f90-17d5-4e26-a7e3-6817c6ed3661 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:06.179712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-07ca2f90-17d5-4e26-a7e3-6817c6ed3661 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:06.188825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-07ca2f90-17d5-4e26-a7e3-6817c6ed3661 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088720 Jun 02 19:28:06.189379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1357/2707] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:06.705125 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9317effc-0545-454f-9f21-e61e0154a66c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:06.705840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9317effc-0545-454f-9f21-e61e0154a66c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:06.713001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9317effc-0545-454f-9f21-e61e0154a66c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:06.713447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9317effc-0545-454f-9f21-e61e0154a66c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:06.714231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9317effc-0545-454f-9f21-e61e0154a66c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:06.715017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9317effc-0545-454f-9f21-e61e0154a66c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:06.855546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9317effc-0545-454f-9f21-e61e0154a66c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:06.864164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9317effc-0545-454f-9f21-e61e0154a66c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162955 Jun 02 19:28:06.864741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1351/2708] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:06 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:07.206221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-91beb9c7-c3a6-44d3-8f09-e051518c0664 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:07.206839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-91beb9c7-c3a6-44d3-8f09-e051518c0664 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:07.213954 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91beb9c7-c3a6-44d3-8f09-e051518c0664 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:07.214569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91beb9c7-c3a6-44d3-8f09-e051518c0664 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:07.215595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91beb9c7-c3a6-44d3-8f09-e051518c0664 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:07.216048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-91beb9c7-c3a6-44d3-8f09-e051518c0664 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:07.277790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-91beb9c7-c3a6-44d3-8f09-e051518c0664 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:07.286159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-91beb9c7-c3a6-44d3-8f09-e051518c0664 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.083887 Jun 02 19:28:07.286967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1358/2709] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:07.882123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-570cf5b2-836e-413d-a195-97a71d16d995 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:07.882779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-570cf5b2-836e-413d-a195-97a71d16d995 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:07.889945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-570cf5b2-836e-413d-a195-97a71d16d995 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:07.890372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-570cf5b2-836e-413d-a195-97a71d16d995 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:07.891144 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-570cf5b2-836e-413d-a195-97a71d16d995 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:07.891581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-570cf5b2-836e-413d-a195-97a71d16d995 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:08.025986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-570cf5b2-836e-413d-a195-97a71d16d995 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:08.034219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-570cf5b2-836e-413d-a195-97a71d16d995 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156091 Jun 02 19:28:08.034788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1352/2710] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:07 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:08.303876 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4b881f56-590a-4e6b-bbfb-43aeb987a3da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:08.304502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4b881f56-590a-4e6b-bbfb-43aeb987a3da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:08.311967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4b881f56-590a-4e6b-bbfb-43aeb987a3da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:08.312399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4b881f56-590a-4e6b-bbfb-43aeb987a3da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:08.313174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4b881f56-590a-4e6b-bbfb-43aeb987a3da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:08.313616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4b881f56-590a-4e6b-bbfb-43aeb987a3da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:08.375082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4b881f56-590a-4e6b-bbfb-43aeb987a3da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:08.383491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4b881f56-590a-4e6b-bbfb-43aeb987a3da tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.083555 Jun 02 19:28:08.384047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1359/2711] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:09.051711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e3ba4c47-0899-4a38-92a6-1d886dd42827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:09.052356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e3ba4c47-0899-4a38-92a6-1d886dd42827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:09.059373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3ba4c47-0899-4a38-92a6-1d886dd42827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:09.060162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3ba4c47-0899-4a38-92a6-1d886dd42827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:09.060918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3ba4c47-0899-4a38-92a6-1d886dd42827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:09.061343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e3ba4c47-0899-4a38-92a6-1d886dd42827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:09.200689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e3ba4c47-0899-4a38-92a6-1d886dd42827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:09.209053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e3ba4c47-0899-4a38-92a6-1d886dd42827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161274 Jun 02 19:28:09.209623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1353/2712] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:09 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:09.401181 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0cb30a6c-fe18-4e94-928c-0f0bc4f5a225 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:09.401873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0cb30a6c-fe18-4e94-928c-0f0bc4f5a225 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:09.409732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0cb30a6c-fe18-4e94-928c-0f0bc4f5a225 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:09.410223 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0cb30a6c-fe18-4e94-928c-0f0bc4f5a225 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:09.411009 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0cb30a6c-fe18-4e94-928c-0f0bc4f5a225 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:09.411447 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0cb30a6c-fe18-4e94-928c-0f0bc4f5a225 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:09.432094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:09.488498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0cb30a6c-fe18-4e94-928c-0f0bc4f5a225 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:09.496896 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0cb30a6c-fe18-4e94-928c-0f0bc4f5a225 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.099724 Jun 02 19:28:09.497461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1360/2713] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:10.226979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-58f14f46-621b-4616-b7d3-d9a01295d669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:10.227622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-58f14f46-621b-4616-b7d3-d9a01295d669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:10.229883 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=54 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:10.236084 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58f14f46-621b-4616-b7d3-d9a01295d669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:10.236525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58f14f46-621b-4616-b7d3-d9a01295d669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:10.237271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58f14f46-621b-4616-b7d3-d9a01295d669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:10.237692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-58f14f46-621b-4616-b7d3-d9a01295d669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:10.380795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-58f14f46-621b-4616-b7d3-d9a01295d669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:10.389751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-58f14f46-621b-4616-b7d3-d9a01295d669 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166642 Jun 02 19:28:10.390320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1354/2714] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:10 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:10.514972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d3524b32-6636-4337-9359-d7ae068a01b2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:10.515536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d3524b32-6636-4337-9359-d7ae068a01b2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:10.522567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3524b32-6636-4337-9359-d7ae068a01b2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:10.523016 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3524b32-6636-4337-9359-d7ae068a01b2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:10.523776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3524b32-6636-4337-9359-d7ae068a01b2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:10.524197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3524b32-6636-4337-9359-d7ae068a01b2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:10.587351 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d3524b32-6636-4337-9359-d7ae068a01b2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:10.595843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d3524b32-6636-4337-9359-d7ae068a01b2 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085068 Jun 02 19:28:10.596398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1361/2715] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:11.407739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b5bc34c1-8574-4d31-b199-67b83e588d2b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:11.408344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b5bc34c1-8574-4d31-b199-67b83e588d2b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:11.415332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5bc34c1-8574-4d31-b199-67b83e588d2b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:11.415782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5bc34c1-8574-4d31-b199-67b83e588d2b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:11.416537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5bc34c1-8574-4d31-b199-67b83e588d2b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:11.416975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5bc34c1-8574-4d31-b199-67b83e588d2b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:11.556167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b5bc34c1-8574-4d31-b199-67b83e588d2b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:11.565205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b5bc34c1-8574-4d31-b199-67b83e588d2b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161527 Jun 02 19:28:11.565752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1355/2716] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:11 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:11.614755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8ce8c99f-ad51-4544-befe-863e7fca5b44 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:11.615337 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8ce8c99f-ad51-4544-befe-863e7fca5b44 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:11.623095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ce8c99f-ad51-4544-befe-863e7fca5b44 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:11.623095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ce8c99f-ad51-4544-befe-863e7fca5b44 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:11.623560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ce8c99f-ad51-4544-befe-863e7fca5b44 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:11.623992 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8ce8c99f-ad51-4544-befe-863e7fca5b44 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:11.687038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8ce8c99f-ad51-4544-befe-863e7fca5b44 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:11.695548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8ce8c99f-ad51-4544-befe-863e7fca5b44 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.084756 Jun 02 19:28:11.696125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1362/2717] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:12.583036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d8330756-b720-4b97-885f-cada77fd884a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:12.583604 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d8330756-b720-4b97-885f-cada77fd884a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:12.591068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8330756-b720-4b97-885f-cada77fd884a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:12.591495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8330756-b720-4b97-885f-cada77fd884a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:12.592254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8330756-b720-4b97-885f-cada77fd884a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:12.592686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d8330756-b720-4b97-885f-cada77fd884a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:12.713111 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b0d2c1ec-4de4-4842-bb72-567adcd4fbee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:12.713823 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b0d2c1ec-4de4-4842-bb72-567adcd4fbee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:12.721024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0d2c1ec-4de4-4842-bb72-567adcd4fbee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:12.721451 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0d2c1ec-4de4-4842-bb72-567adcd4fbee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:12.722260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0d2c1ec-4de4-4842-bb72-567adcd4fbee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:12.722723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b0d2c1ec-4de4-4842-bb72-567adcd4fbee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:12.727884 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d8330756-b720-4b97-885f-cada77fd884a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:12.736651 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d8330756-b720-4b97-885f-cada77fd884a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.157499 Jun 02 19:28:12.737431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1356/2718] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:12 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:12.792388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b0d2c1ec-4de4-4842-bb72-567adcd4fbee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:12.800473 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b0d2c1ec-4de4-4842-bb72-567adcd4fbee tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091286 Jun 02 19:28:12.801037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1363/2719] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:28:13.754321 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-74ea46ee-0f1c-426c-ac75-04f7716b57a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:13.754947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-74ea46ee-0f1c-426c-ac75-04f7716b57a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:13.761988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74ea46ee-0f1c-426c-ac75-04f7716b57a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:13.762437 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74ea46ee-0f1c-426c-ac75-04f7716b57a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:13.763182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74ea46ee-0f1c-426c-ac75-04f7716b57a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:13.763606 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74ea46ee-0f1c-426c-ac75-04f7716b57a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:13.818152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-55477524-10fc-4221-b127-4ac468275a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:13.818711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-55477524-10fc-4221-b127-4ac468275a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:13.825254 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55477524-10fc-4221-b127-4ac468275a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:13.825701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55477524-10fc-4221-b127-4ac468275a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:13.826495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55477524-10fc-4221-b127-4ac468275a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:13.826948 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55477524-10fc-4221-b127-4ac468275a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:13.896371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-55477524-10fc-4221-b127-4ac468275a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:13.905076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-55477524-10fc-4221-b127-4ac468275a56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090913 Jun 02 19:28:13.905663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1364/2720] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:28:13.917944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-74ea46ee-0f1c-426c-ac75-04f7716b57a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:13.926346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-74ea46ee-0f1c-426c-ac75-04f7716b57a8 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.176019 Jun 02 19:28:13.926900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1357/2721] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:13 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:14.923087 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-accd0ff3-8a6a-415e-be33-098c02eed9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:14.923724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-accd0ff3-8a6a-415e-be33-098c02eed9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:14.930357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-accd0ff3-8a6a-415e-be33-098c02eed9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:14.930808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-accd0ff3-8a6a-415e-be33-098c02eed9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:14.931576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-accd0ff3-8a6a-415e-be33-098c02eed9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:14.932007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-accd0ff3-8a6a-415e-be33-098c02eed9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:14.948287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4c7280e2-86e6-4cb5-bf5e-a3082b2f61cd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:14.949895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4c7280e2-86e6-4cb5-bf5e-a3082b2f61cd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:14.956933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4c7280e2-86e6-4cb5-bf5e-a3082b2f61cd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:14.957383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4c7280e2-86e6-4cb5-bf5e-a3082b2f61cd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:14.958179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4c7280e2-86e6-4cb5-bf5e-a3082b2f61cd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:14.958615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4c7280e2-86e6-4cb5-bf5e-a3082b2f61cd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:15.002604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-accd0ff3-8a6a-415e-be33-098c02eed9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:15.011460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-accd0ff3-8a6a-415e-be33-098c02eed9d1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092211 Jun 02 19:28:15.012063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1365/2722] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:15.109617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4c7280e2-86e6-4cb5-bf5e-a3082b2f61cd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:15.117817 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4c7280e2-86e6-4cb5-bf5e-a3082b2f61cd tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.175938 Jun 02 19:28:15.118414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1358/2723] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:14 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:15.285429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:28:15.285429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:28:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:28:16.029021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-54912802-0011-47cb-8e6b-e3702a701c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:16.029789 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-54912802-0011-47cb-8e6b-e3702a701c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:16.036719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54912802-0011-47cb-8e6b-e3702a701c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:16.037177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54912802-0011-47cb-8e6b-e3702a701c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:16.038134 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54912802-0011-47cb-8e6b-e3702a701c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:16.038575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54912802-0011-47cb-8e6b-e3702a701c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:16.102601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-54912802-0011-47cb-8e6b-e3702a701c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:16.111632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-54912802-0011-47cb-8e6b-e3702a701c90 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086594 Jun 02 19:28:16.112200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1366/2724] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:16 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:16.135392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-17af5e7d-0a8c-4263-b8f8-5e94e871248e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:16.136062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-17af5e7d-0a8c-4263-b8f8-5e94e871248e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:16.143239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17af5e7d-0a8c-4263-b8f8-5e94e871248e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:16.143694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17af5e7d-0a8c-4263-b8f8-5e94e871248e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:16.144460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17af5e7d-0a8c-4263-b8f8-5e94e871248e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:16.144898 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17af5e7d-0a8c-4263-b8f8-5e94e871248e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:16.280261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-17af5e7d-0a8c-4263-b8f8-5e94e871248e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:16.288618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-17af5e7d-0a8c-4263-b8f8-5e94e871248e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.157099 Jun 02 19:28:16.289184 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1359/2725] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:16 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:17.128776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6a69ed4e-5ebd-4d92-98a3-3817bae5b970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:17.129425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6a69ed4e-5ebd-4d92-98a3-3817bae5b970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:17.137107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a69ed4e-5ebd-4d92-98a3-3817bae5b970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:17.137580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a69ed4e-5ebd-4d92-98a3-3817bae5b970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:17.138393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a69ed4e-5ebd-4d92-98a3-3817bae5b970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:17.138837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a69ed4e-5ebd-4d92-98a3-3817bae5b970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:17.205968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6a69ed4e-5ebd-4d92-98a3-3817bae5b970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:17.214563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6a69ed4e-5ebd-4d92-98a3-3817bae5b970 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089736 Jun 02 19:28:17.215115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1367/2726] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:17.306362 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-07e8d91e-fe5d-45fd-9041-986e4bd32827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:17.306968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-07e8d91e-fe5d-45fd-9041-986e4bd32827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:17.314376 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07e8d91e-fe5d-45fd-9041-986e4bd32827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:17.314830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07e8d91e-fe5d-45fd-9041-986e4bd32827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:17.315594 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07e8d91e-fe5d-45fd-9041-986e4bd32827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:17.316029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-07e8d91e-fe5d-45fd-9041-986e4bd32827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:17.318626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:17.444730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-07e8d91e-fe5d-45fd-9041-986e4bd32827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:17.453116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-07e8d91e-fe5d-45fd-9041-986e4bd32827 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.150676 Jun 02 19:28:17.453678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1360/2727] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:17 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:18.232015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4a923f6c-8f4a-466e-8496-852317abbb23 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:18.232633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4a923f6c-8f4a-466e-8496-852317abbb23 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:18.239457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4a923f6c-8f4a-466e-8496-852317abbb23 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:18.239910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4a923f6c-8f4a-466e-8496-852317abbb23 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:18.240663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4a923f6c-8f4a-466e-8496-852317abbb23 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:18.241097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4a923f6c-8f4a-466e-8496-852317abbb23 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:18.303011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4a923f6c-8f4a-466e-8496-852317abbb23 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:18.312207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4a923f6c-8f4a-466e-8496-852317abbb23 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.084042 Jun 02 19:28:18.312776 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1368/2728] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:18.470710 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dde5bff3-5156-4b0b-be5f-8ca62cc60d81 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:18.471292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dde5bff3-5156-4b0b-be5f-8ca62cc60d81 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:18.478335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dde5bff3-5156-4b0b-be5f-8ca62cc60d81 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:18.478785 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dde5bff3-5156-4b0b-be5f-8ca62cc60d81 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:18.479545 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dde5bff3-5156-4b0b-be5f-8ca62cc60d81 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:18.480024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dde5bff3-5156-4b0b-be5f-8ca62cc60d81 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:18.613230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dde5bff3-5156-4b0b-be5f-8ca62cc60d81 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:18.621642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dde5bff3-5156-4b0b-be5f-8ca62cc60d81 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.154870 Jun 02 19:28:18.622241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1361/2729] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:18 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:19.329664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-677e6dbe-706e-4b12-a5c7-991053bb6243 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:19.330326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-677e6dbe-706e-4b12-a5c7-991053bb6243 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:19.337256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-677e6dbe-706e-4b12-a5c7-991053bb6243 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:19.337643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-677e6dbe-706e-4b12-a5c7-991053bb6243 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:19.338429 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-677e6dbe-706e-4b12-a5c7-991053bb6243 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:19.338870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-677e6dbe-706e-4b12-a5c7-991053bb6243 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:19.401012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-677e6dbe-706e-4b12-a5c7-991053bb6243 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:19.409758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-677e6dbe-706e-4b12-a5c7-991053bb6243 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.084104 Jun 02 19:28:19.410367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1369/2730] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:19.640498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b380caf6-f007-455f-ab74-3ab25bd0d61c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:19.641126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b380caf6-f007-455f-ab74-3ab25bd0d61c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:19.650155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b380caf6-f007-455f-ab74-3ab25bd0d61c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:19.650596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b380caf6-f007-455f-ab74-3ab25bd0d61c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:19.651772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b380caf6-f007-455f-ab74-3ab25bd0d61c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:19.652213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b380caf6-f007-455f-ab74-3ab25bd0d61c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:19.802704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b380caf6-f007-455f-ab74-3ab25bd0d61c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:19.812477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b380caf6-f007-455f-ab74-3ab25bd0d61c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.175919 Jun 02 19:28:19.813062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1362/2731] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:19 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:20.426901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5092bf99-0d17-46db-b0ba-2ff5b34cac34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:20.427564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5092bf99-0d17-46db-b0ba-2ff5b34cac34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:20.435191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5092bf99-0d17-46db-b0ba-2ff5b34cac34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:20.435696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5092bf99-0d17-46db-b0ba-2ff5b34cac34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:20.436438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5092bf99-0d17-46db-b0ba-2ff5b34cac34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:20.436884 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5092bf99-0d17-46db-b0ba-2ff5b34cac34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:20.506257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5092bf99-0d17-46db-b0ba-2ff5b34cac34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:20.516187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5092bf99-0d17-46db-b0ba-2ff5b34cac34 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092995 Jun 02 19:28:20.516999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1370/2732] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:20.831319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3ad179e4-49ee-4f0f-84ab-6cc95d1b8120 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:20.831909 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ad179e4-49ee-4f0f-84ab-6cc95d1b8120 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:20.838964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ad179e4-49ee-4f0f-84ab-6cc95d1b8120 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:20.839412 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ad179e4-49ee-4f0f-84ab-6cc95d1b8120 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:20.840486 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ad179e4-49ee-4f0f-84ab-6cc95d1b8120 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:20.840918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ad179e4-49ee-4f0f-84ab-6cc95d1b8120 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:20.988487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3ad179e4-49ee-4f0f-84ab-6cc95d1b8120 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:21.002967 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3ad179e4-49ee-4f0f-84ab-6cc95d1b8120 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.175577 Jun 02 19:28:21.003567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1363/2733] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:20 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:21.537523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ebe85229-d49a-42c0-b4fc-15b3fd737161 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:21.538163 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ebe85229-d49a-42c0-b4fc-15b3fd737161 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:21.545393 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebe85229-d49a-42c0-b4fc-15b3fd737161 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:21.545866 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebe85229-d49a-42c0-b4fc-15b3fd737161 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:21.546620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebe85229-d49a-42c0-b4fc-15b3fd737161 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:21.547054 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ebe85229-d49a-42c0-b4fc-15b3fd737161 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:21.621256 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ebe85229-d49a-42c0-b4fc-15b3fd737161 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:21.630735 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ebe85229-d49a-42c0-b4fc-15b3fd737161 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.096883 Jun 02 19:28:21.631569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1371/2734] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:22.023279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f3197d12-bf57-4b38-931a-a5deaa963e3d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:22.024227 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f3197d12-bf57-4b38-931a-a5deaa963e3d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:22.034390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3197d12-bf57-4b38-931a-a5deaa963e3d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:22.035074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3197d12-bf57-4b38-931a-a5deaa963e3d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:22.037934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3197d12-bf57-4b38-931a-a5deaa963e3d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:22.038624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3197d12-bf57-4b38-931a-a5deaa963e3d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:22.187570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f3197d12-bf57-4b38-931a-a5deaa963e3d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:22.196393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f3197d12-bf57-4b38-931a-a5deaa963e3d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.178954 Jun 02 19:28:22.197088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1364/2735] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:22 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:22.649310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-afb80ded-7296-4e1b-b1d8-050a2ce19503 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:22.649975 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-afb80ded-7296-4e1b-b1d8-050a2ce19503 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:22.658364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afb80ded-7296-4e1b-b1d8-050a2ce19503 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:22.658829 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afb80ded-7296-4e1b-b1d8-050a2ce19503 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:22.659611 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afb80ded-7296-4e1b-b1d8-050a2ce19503 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:22.660036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-afb80ded-7296-4e1b-b1d8-050a2ce19503 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:22.734755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-afb80ded-7296-4e1b-b1d8-050a2ce19503 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:22.743264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-afb80ded-7296-4e1b-b1d8-050a2ce19503 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098096 Jun 02 19:28:22.743849 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1372/2736] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:23.214657 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d266d9a6-15b6-4156-a4f6-10b3c3d3da7c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:23.215278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d266d9a6-15b6-4156-a4f6-10b3c3d3da7c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:23.223618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d266d9a6-15b6-4156-a4f6-10b3c3d3da7c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:23.224244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d266d9a6-15b6-4156-a4f6-10b3c3d3da7c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:23.225491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d266d9a6-15b6-4156-a4f6-10b3c3d3da7c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:23.225955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d266d9a6-15b6-4156-a4f6-10b3c3d3da7c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:23.379931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d266d9a6-15b6-4156-a4f6-10b3c3d3da7c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:23.390006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d266d9a6-15b6-4156-a4f6-10b3c3d3da7c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.178917 Jun 02 19:28:23.390820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1365/2737] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:23 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:23.761444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-558fb64f-9b51-4805-83df-065d75dfea16 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:23.762318 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-558fb64f-9b51-4805-83df-065d75dfea16 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:23.769388 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-558fb64f-9b51-4805-83df-065d75dfea16 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:23.769832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-558fb64f-9b51-4805-83df-065d75dfea16 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:23.770634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-558fb64f-9b51-4805-83df-065d75dfea16 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:23.771068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-558fb64f-9b51-4805-83df-065d75dfea16 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:23.840357 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-558fb64f-9b51-4805-83df-065d75dfea16 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:23.849186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-558fb64f-9b51-4805-83df-065d75dfea16 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091738 Jun 02 19:28:23.849760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1373/2738] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:24.412988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-67d1cf06-c4d5-4f20-baff-7d84ecb20807 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:24.413627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-67d1cf06-c4d5-4f20-baff-7d84ecb20807 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:24.420807 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67d1cf06-c4d5-4f20-baff-7d84ecb20807 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:24.421302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67d1cf06-c4d5-4f20-baff-7d84ecb20807 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:24.422280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67d1cf06-c4d5-4f20-baff-7d84ecb20807 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:24.422892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67d1cf06-c4d5-4f20-baff-7d84ecb20807 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:24.572642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67d1cf06-c4d5-4f20-baff-7d84ecb20807 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:24.581741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-67d1cf06-c4d5-4f20-baff-7d84ecb20807 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.172618 Jun 02 19:28:24.582381 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1366/2739] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:24 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:24.867020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1ad60ac6-7e07-4d4f-b69d-bfab76baf352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:24.867889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1ad60ac6-7e07-4d4f-b69d-bfab76baf352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:24.874736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ad60ac6-7e07-4d4f-b69d-bfab76baf352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:24.875192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ad60ac6-7e07-4d4f-b69d-bfab76baf352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:24.875949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ad60ac6-7e07-4d4f-b69d-bfab76baf352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:24.876383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ad60ac6-7e07-4d4f-b69d-bfab76baf352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:24.941144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1ad60ac6-7e07-4d4f-b69d-bfab76baf352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:24.953164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1ad60ac6-7e07-4d4f-b69d-bfab76baf352 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090205 Jun 02 19:28:24.953968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1374/2740] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:25.599554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-64627617-cdb2-478c-9e6e-02a7e99c49c4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:25.600169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-64627617-cdb2-478c-9e6e-02a7e99c49c4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:25.608067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64627617-cdb2-478c-9e6e-02a7e99c49c4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:25.608507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64627617-cdb2-478c-9e6e-02a7e99c49c4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:25.609261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64627617-cdb2-478c-9e6e-02a7e99c49c4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:25.609686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64627617-cdb2-478c-9e6e-02a7e99c49c4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:25.761617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-64627617-cdb2-478c-9e6e-02a7e99c49c4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:25.770215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-64627617-cdb2-478c-9e6e-02a7e99c49c4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174531 Jun 02 19:28:25.770796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1367/2741] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:25 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:25.974510 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8070e289-bad4-40d4-b539-67361ba05c94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:25.975151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8070e289-bad4-40d4-b539-67361ba05c94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:25.982317 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8070e289-bad4-40d4-b539-67361ba05c94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:25.982759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8070e289-bad4-40d4-b539-67361ba05c94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:25.983538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8070e289-bad4-40d4-b539-67361ba05c94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:25.983970 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8070e289-bad4-40d4-b539-67361ba05c94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:26.049755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8070e289-bad4-40d4-b539-67361ba05c94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:26.058784 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8070e289-bad4-40d4-b539-67361ba05c94 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088143 Jun 02 19:28:26.059714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1375/2742] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:26.788183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60bea06c-52b7-4e8d-80a1-9e06fe4cba99 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:26.788791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-60bea06c-52b7-4e8d-80a1-9e06fe4cba99 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:26.796944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60bea06c-52b7-4e8d-80a1-9e06fe4cba99 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:26.797398 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60bea06c-52b7-4e8d-80a1-9e06fe4cba99 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:26.798211 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60bea06c-52b7-4e8d-80a1-9e06fe4cba99 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:26.798645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60bea06c-52b7-4e8d-80a1-9e06fe4cba99 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:26.944199 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-60bea06c-52b7-4e8d-80a1-9e06fe4cba99 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:26.952714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-60bea06c-52b7-4e8d-80a1-9e06fe4cba99 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168488 Jun 02 19:28:26.953322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1368/2743] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:26 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:27.077422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fbda8961-c3d7-414a-93cc-1c21271c69b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:27.078064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fbda8961-c3d7-414a-93cc-1c21271c69b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:27.085492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbda8961-c3d7-414a-93cc-1c21271c69b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:27.085993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbda8961-c3d7-414a-93cc-1c21271c69b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:27.086769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbda8961-c3d7-414a-93cc-1c21271c69b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:27.087204 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fbda8961-c3d7-414a-93cc-1c21271c69b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:27.159372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fbda8961-c3d7-414a-93cc-1c21271c69b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:27.172057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fbda8961-c3d7-414a-93cc-1c21271c69b8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098891 Jun 02 19:28:27.172891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1376/2744] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:27.973828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aa453dd8-c782-49b1-9ac9-8910b67a25a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:27.974798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aa453dd8-c782-49b1-9ac9-8910b67a25a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:27.986262 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa453dd8-c782-49b1-9ac9-8910b67a25a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:27.987011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa453dd8-c782-49b1-9ac9-8910b67a25a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:27.988298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa453dd8-c782-49b1-9ac9-8910b67a25a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:27.989039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa453dd8-c782-49b1-9ac9-8910b67a25a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:28.133560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aa453dd8-c782-49b1-9ac9-8910b67a25a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:28.143528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aa453dd8-c782-49b1-9ac9-8910b67a25a0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.176133 Jun 02 19:28:28.144230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1369/2745] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:27 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:28.194497 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-55704945-48fb-41a3-80be-cba30bc2d794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:28.195432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-55704945-48fb-41a3-80be-cba30bc2d794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:28.205765 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55704945-48fb-41a3-80be-cba30bc2d794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:28.206253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55704945-48fb-41a3-80be-cba30bc2d794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:28.207022 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55704945-48fb-41a3-80be-cba30bc2d794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:28.207459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-55704945-48fb-41a3-80be-cba30bc2d794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:28.211623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:28.278065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-55704945-48fb-41a3-80be-cba30bc2d794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:28.286435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-55704945-48fb-41a3-80be-cba30bc2d794 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.096009 Jun 02 19:28:28.287030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1377/2746] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:29.163629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2f7c0575-58a4-454f-8f5d-c33a76a09434 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:29.164255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2f7c0575-58a4-454f-8f5d-c33a76a09434 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:29.171481 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f7c0575-58a4-454f-8f5d-c33a76a09434 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:29.171922 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f7c0575-58a4-454f-8f5d-c33a76a09434 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:29.172679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f7c0575-58a4-454f-8f5d-c33a76a09434 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:29.173087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f7c0575-58a4-454f-8f5d-c33a76a09434 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:29.304727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cbbe6d40-5f0b-403a-b465-f92a24097ee8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:29.305366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cbbe6d40-5f0b-403a-b465-f92a24097ee8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:29.313512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbbe6d40-5f0b-403a-b465-f92a24097ee8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:29.314012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbbe6d40-5f0b-403a-b465-f92a24097ee8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:29.314825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbbe6d40-5f0b-403a-b465-f92a24097ee8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:29.315263 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbbe6d40-5f0b-403a-b465-f92a24097ee8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:29.320426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2f7c0575-58a4-454f-8f5d-c33a76a09434 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:29.328669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2f7c0575-58a4-454f-8f5d-c33a76a09434 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.171053 Jun 02 19:28:29.329260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1370/2747] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:29 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:29.379386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cbbe6d40-5f0b-403a-b465-f92a24097ee8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:29.388214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cbbe6d40-5f0b-403a-b465-f92a24097ee8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.087771 Jun 02 19:28:29.388801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1378/2748] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:28:30.346714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fc5532ba-dd46-4e0b-9dcf-cccc86d35015 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:30.347370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fc5532ba-dd46-4e0b-9dcf-cccc86d35015 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:30.356714 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc5532ba-dd46-4e0b-9dcf-cccc86d35015 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:30.357174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc5532ba-dd46-4e0b-9dcf-cccc86d35015 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:30.358260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc5532ba-dd46-4e0b-9dcf-cccc86d35015 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:30.358865 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fc5532ba-dd46-4e0b-9dcf-cccc86d35015 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:30.406552 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-00015934-c4bf-45f2-b24a-904e36ed9b7a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:30.407542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-00015934-c4bf-45f2-b24a-904e36ed9b7a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:30.414203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00015934-c4bf-45f2-b24a-904e36ed9b7a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:30.414657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00015934-c4bf-45f2-b24a-904e36ed9b7a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:30.415423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00015934-c4bf-45f2-b24a-904e36ed9b7a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:30.415858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00015934-c4bf-45f2-b24a-904e36ed9b7a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:30.492638 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-00015934-c4bf-45f2-b24a-904e36ed9b7a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:30.505616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-00015934-c4bf-45f2-b24a-904e36ed9b7a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.103175 Jun 02 19:28:30.506828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1379/2749] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:30.538384 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fc5532ba-dd46-4e0b-9dcf-cccc86d35015 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:30.549568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fc5532ba-dd46-4e0b-9dcf-cccc86d35015 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.206558 Jun 02 19:28:30.550497 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1371/2750] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:30 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:31.524496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3dfe3647-bf0c-46b0-9dc3-47de6f402e6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:31.525130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3dfe3647-bf0c-46b0-9dc3-47de6f402e6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:31.534100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3dfe3647-bf0c-46b0-9dc3-47de6f402e6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:31.534563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3dfe3647-bf0c-46b0-9dc3-47de6f402e6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:31.535344 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3dfe3647-bf0c-46b0-9dc3-47de6f402e6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:31.535786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3dfe3647-bf0c-46b0-9dc3-47de6f402e6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:31.568157 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4f06f98e-90dc-44bc-9b1f-263103602be9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:31.568957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4f06f98e-90dc-44bc-9b1f-263103602be9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:31.577169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f06f98e-90dc-44bc-9b1f-263103602be9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:31.578016 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f06f98e-90dc-44bc-9b1f-263103602be9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:31.579370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f06f98e-90dc-44bc-9b1f-263103602be9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:31.579826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f06f98e-90dc-44bc-9b1f-263103602be9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:31.602499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3dfe3647-bf0c-46b0-9dc3-47de6f402e6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:31.611533 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3dfe3647-bf0c-46b0-9dc3-47de6f402e6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091087 Jun 02 19:28:31.612124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1380/2751] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:31.726859 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4f06f98e-90dc-44bc-9b1f-263103602be9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:31.735589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4f06f98e-90dc-44bc-9b1f-263103602be9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.171228 Jun 02 19:28:31.736197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1372/2752] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:31 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:32.628957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-faf2482c-12ff-4420-931f-6f362316b371 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:32.629583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-faf2482c-12ff-4420-931f-6f362316b371 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:32.636657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-faf2482c-12ff-4420-931f-6f362316b371 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:32.637200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-faf2482c-12ff-4420-931f-6f362316b371 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:32.638021 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-faf2482c-12ff-4420-931f-6f362316b371 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:32.638463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-faf2482c-12ff-4420-931f-6f362316b371 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:32.712933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-faf2482c-12ff-4420-931f-6f362316b371 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:32.724805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-faf2482c-12ff-4420-931f-6f362316b371 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.099446 Jun 02 19:28:32.725449 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1381/2753] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:32.756502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3faa3d6b-23c2-47a9-b8ee-b90ddd84bcf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:32.757104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3faa3d6b-23c2-47a9-b8ee-b90ddd84bcf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:32.763955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3faa3d6b-23c2-47a9-b8ee-b90ddd84bcf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:32.764404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3faa3d6b-23c2-47a9-b8ee-b90ddd84bcf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:32.765178 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3faa3d6b-23c2-47a9-b8ee-b90ddd84bcf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:32.765608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3faa3d6b-23c2-47a9-b8ee-b90ddd84bcf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:32.908334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3faa3d6b-23c2-47a9-b8ee-b90ddd84bcf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:32.917241 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3faa3d6b-23c2-47a9-b8ee-b90ddd84bcf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164596 Jun 02 19:28:32.918004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1373/2754] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:32 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:33.748102 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-daf5580f-2b16-4233-aaa6-9fed82e3bb3c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:33.748779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-daf5580f-2b16-4233-aaa6-9fed82e3bb3c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:33.756234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-daf5580f-2b16-4233-aaa6-9fed82e3bb3c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:33.756694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-daf5580f-2b16-4233-aaa6-9fed82e3bb3c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:33.757476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-daf5580f-2b16-4233-aaa6-9fed82e3bb3c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:33.757951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-daf5580f-2b16-4233-aaa6-9fed82e3bb3c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:33.825003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-daf5580f-2b16-4233-aaa6-9fed82e3bb3c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:33.833462 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-daf5580f-2b16-4233-aaa6-9fed82e3bb3c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089844 Jun 02 19:28:33.834105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1382/2755] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:33.935924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dc973d88-a44b-4015-ac2d-acf10f686b9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:33.936553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dc973d88-a44b-4015-ac2d-acf10f686b9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:33.943782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc973d88-a44b-4015-ac2d-acf10f686b9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:33.944231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc973d88-a44b-4015-ac2d-acf10f686b9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:33.944978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc973d88-a44b-4015-ac2d-acf10f686b9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:33.945408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dc973d88-a44b-4015-ac2d-acf10f686b9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:34.097521 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dc973d88-a44b-4015-ac2d-acf10f686b9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:34.106590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dc973d88-a44b-4015-ac2d-acf10f686b9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174876 Jun 02 19:28:34.107254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1374/2756] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:33 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:34.851982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f1abdb2-7fe3-4089-8536-fe9db43bebf7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:34.852602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1f1abdb2-7fe3-4089-8536-fe9db43bebf7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:34.861374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f1abdb2-7fe3-4089-8536-fe9db43bebf7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:34.862048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f1abdb2-7fe3-4089-8536-fe9db43bebf7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:34.863222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f1abdb2-7fe3-4089-8536-fe9db43bebf7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:34.863806 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f1abdb2-7fe3-4089-8536-fe9db43bebf7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:34.939654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1f1abdb2-7fe3-4089-8536-fe9db43bebf7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:34.949189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1f1abdb2-7fe3-4089-8536-fe9db43bebf7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.101172 Jun 02 19:28:34.949809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1383/2757] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:35.126622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cfa4b7a7-bfd7-479b-8bb8-8a49ba714656 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:35.127356 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cfa4b7a7-bfd7-479b-8bb8-8a49ba714656 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:35.136206 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfa4b7a7-bfd7-479b-8bb8-8a49ba714656 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:35.136653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfa4b7a7-bfd7-479b-8bb8-8a49ba714656 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:35.137569 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfa4b7a7-bfd7-479b-8bb8-8a49ba714656 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:35.138038 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cfa4b7a7-bfd7-479b-8bb8-8a49ba714656 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:35.278815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cfa4b7a7-bfd7-479b-8bb8-8a49ba714656 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:35.287390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cfa4b7a7-bfd7-479b-8bb8-8a49ba714656 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165098 Jun 02 19:28:35.287966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1375/2758] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:35 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:35.969521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e00ec5be-84ce-4a2f-bf3a-33ec8c1f5d68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:35.970174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e00ec5be-84ce-4a2f-bf3a-33ec8c1f5d68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:35.972532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=56 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:35.978499 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e00ec5be-84ce-4a2f-bf3a-33ec8c1f5d68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:35.978949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e00ec5be-84ce-4a2f-bf3a-33ec8c1f5d68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:35.979724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e00ec5be-84ce-4a2f-bf3a-33ec8c1f5d68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:35.980160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e00ec5be-84ce-4a2f-bf3a-33ec8c1f5d68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:36.153917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e00ec5be-84ce-4a2f-bf3a-33ec8c1f5d68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:36.162469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e00ec5be-84ce-4a2f-bf3a-33ec8c1f5d68 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.197403 Jun 02 19:28:36.163038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1384/2759] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:36.306373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-df43e823-411f-4aac-b2ed-1423855b2bc0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:36.307003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-df43e823-411f-4aac-b2ed-1423855b2bc0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:36.315686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df43e823-411f-4aac-b2ed-1423855b2bc0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:36.316126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df43e823-411f-4aac-b2ed-1423855b2bc0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:36.316887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df43e823-411f-4aac-b2ed-1423855b2bc0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:36.317314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-df43e823-411f-4aac-b2ed-1423855b2bc0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:36.514873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-df43e823-411f-4aac-b2ed-1423855b2bc0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:36.517164 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:36.524588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-df43e823-411f-4aac-b2ed-1423855b2bc0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.222148 Jun 02 19:28:36.525172 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1376/2760] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:36 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:37.184708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-67632f58-451a-45cb-8dc6-daeae187195a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:37.185361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-67632f58-451a-45cb-8dc6-daeae187195a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:37.192417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67632f58-451a-45cb-8dc6-daeae187195a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:37.192865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67632f58-451a-45cb-8dc6-daeae187195a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:37.193639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67632f58-451a-45cb-8dc6-daeae187195a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:37.194110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67632f58-451a-45cb-8dc6-daeae187195a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:37.263904 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-67632f58-451a-45cb-8dc6-daeae187195a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:37.272270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-67632f58-451a-45cb-8dc6-daeae187195a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094555 Jun 02 19:28:37.272841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1385/2761] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:37.542820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-740c6da5-a374-41c7-87d1-f1b376035dec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:37.544260 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-740c6da5-a374-41c7-87d1-f1b376035dec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:37.551264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-740c6da5-a374-41c7-87d1-f1b376035dec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:37.551719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-740c6da5-a374-41c7-87d1-f1b376035dec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:37.552484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-740c6da5-a374-41c7-87d1-f1b376035dec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:37.552912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-740c6da5-a374-41c7-87d1-f1b376035dec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:37.697725 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-740c6da5-a374-41c7-87d1-f1b376035dec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:37.709767 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-740c6da5-a374-41c7-87d1-f1b376035dec tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.170697 Jun 02 19:28:37.710736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1377/2762] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:37 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:38.290270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-586a144f-ff60-4c8b-b3b9-ab9b4a7ab1f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:38.290917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-586a144f-ff60-4c8b-b3b9-ab9b4a7ab1f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:38.298891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-586a144f-ff60-4c8b-b3b9-ab9b4a7ab1f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:38.299343 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-586a144f-ff60-4c8b-b3b9-ab9b4a7ab1f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:38.300114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-586a144f-ff60-4c8b-b3b9-ab9b4a7ab1f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:38.300549 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-586a144f-ff60-4c8b-b3b9-ab9b4a7ab1f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:38.367480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-586a144f-ff60-4c8b-b3b9-ab9b4a7ab1f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:38.376703 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-586a144f-ff60-4c8b-b3b9-ab9b4a7ab1f0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090503 Jun 02 19:28:38.377270 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1386/2763] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:38.728488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-11c99c19-de7b-4fea-a88c-3ae4f73b0dde tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:38.729128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-11c99c19-de7b-4fea-a88c-3ae4f73b0dde tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:38.736526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11c99c19-de7b-4fea-a88c-3ae4f73b0dde tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:38.737002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11c99c19-de7b-4fea-a88c-3ae4f73b0dde tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:38.737749 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11c99c19-de7b-4fea-a88c-3ae4f73b0dde tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:38.738219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11c99c19-de7b-4fea-a88c-3ae4f73b0dde tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:38.876092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-11c99c19-de7b-4fea-a88c-3ae4f73b0dde tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:38.884457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-11c99c19-de7b-4fea-a88c-3ae4f73b0dde tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159882 Jun 02 19:28:38.884994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1378/2764] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:38 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:39.394692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5daebfc2-991b-4a98-ae79-5699d2520511 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:39.395323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5daebfc2-991b-4a98-ae79-5699d2520511 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:39.402612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5daebfc2-991b-4a98-ae79-5699d2520511 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:39.403189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5daebfc2-991b-4a98-ae79-5699d2520511 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:39.403972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5daebfc2-991b-4a98-ae79-5699d2520511 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:39.404410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5daebfc2-991b-4a98-ae79-5699d2520511 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:39.479122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5daebfc2-991b-4a98-ae79-5699d2520511 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:39.487980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5daebfc2-991b-4a98-ae79-5699d2520511 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097221 Jun 02 19:28:39.488608 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1387/2765] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:39.904461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f6229548-87d1-4490-9a16-1b6adf500e05 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:39.905103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f6229548-87d1-4490-9a16-1b6adf500e05 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:39.912119 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6229548-87d1-4490-9a16-1b6adf500e05 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:39.912567 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6229548-87d1-4490-9a16-1b6adf500e05 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:39.913325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6229548-87d1-4490-9a16-1b6adf500e05 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:39.913748 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6229548-87d1-4490-9a16-1b6adf500e05 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:40.056520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f6229548-87d1-4490-9a16-1b6adf500e05 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:40.066834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f6229548-87d1-4490-9a16-1b6adf500e05 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167687 Jun 02 19:28:40.067386 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1379/2766] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:39 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:40.507225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7f8d0644-62f0-4293-ac7e-8db6d5bb346e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:40.507828 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7f8d0644-62f0-4293-ac7e-8db6d5bb346e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:40.515516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f8d0644-62f0-4293-ac7e-8db6d5bb346e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:40.515964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f8d0644-62f0-4293-ac7e-8db6d5bb346e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:40.516754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f8d0644-62f0-4293-ac7e-8db6d5bb346e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:40.517187 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f8d0644-62f0-4293-ac7e-8db6d5bb346e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:40.591538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f8d0644-62f0-4293-ac7e-8db6d5bb346e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:40.599986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7f8d0644-62f0-4293-ac7e-8db6d5bb346e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098739 Jun 02 19:28:40.600558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1388/2767] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:40.843882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:28:40.844142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:28:41.085179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fb6f8bfd-f543-47e1-89a2-c70dc416c6f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:41.085949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fb6f8bfd-f543-47e1-89a2-c70dc416c6f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:41.088302 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:41.094885 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb6f8bfd-f543-47e1-89a2-c70dc416c6f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:41.095244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb6f8bfd-f543-47e1-89a2-c70dc416c6f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:41.096022 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb6f8bfd-f543-47e1-89a2-c70dc416c6f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:41.096451 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb6f8bfd-f543-47e1-89a2-c70dc416c6f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:41.241534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fb6f8bfd-f543-47e1-89a2-c70dc416c6f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:41.250430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fb6f8bfd-f543-47e1-89a2-c70dc416c6f1 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.169172 Jun 02 19:28:41.250996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1380/2768] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:41 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:41.618236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1a5c56d1-cf75-44fd-ad39-980efcf2c3e8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:41.618857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1a5c56d1-cf75-44fd-ad39-980efcf2c3e8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:41.628097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5c56d1-cf75-44fd-ad39-980efcf2c3e8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:41.628555 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5c56d1-cf75-44fd-ad39-980efcf2c3e8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:41.629346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5c56d1-cf75-44fd-ad39-980efcf2c3e8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:41.629759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a5c56d1-cf75-44fd-ad39-980efcf2c3e8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:41.695685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1a5c56d1-cf75-44fd-ad39-980efcf2c3e8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:41.704210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1a5c56d1-cf75-44fd-ad39-980efcf2c3e8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089880 Jun 02 19:28:41.704809 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1389/2769] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:42.270067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-722abe43-e58a-496d-8787-93620425fcc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:42.270659 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-722abe43-e58a-496d-8787-93620425fcc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:42.277747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-722abe43-e58a-496d-8787-93620425fcc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:42.278407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-722abe43-e58a-496d-8787-93620425fcc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:42.279438 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-722abe43-e58a-496d-8787-93620425fcc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:42.279963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-722abe43-e58a-496d-8787-93620425fcc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:42.419960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-722abe43-e58a-496d-8787-93620425fcc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:42.429245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-722abe43-e58a-496d-8787-93620425fcc4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.163102 Jun 02 19:28:42.429824 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1381/2770] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:42 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:42.725321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-347a4caf-89d7-478f-8d99-8a0bb62142fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:42.725979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-347a4caf-89d7-478f-8d99-8a0bb62142fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:42.734560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-347a4caf-89d7-478f-8d99-8a0bb62142fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:42.735206 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-347a4caf-89d7-478f-8d99-8a0bb62142fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:42.736633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-347a4caf-89d7-478f-8d99-8a0bb62142fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:42.737065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-347a4caf-89d7-478f-8d99-8a0bb62142fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:42.805671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-347a4caf-89d7-478f-8d99-8a0bb62142fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:42.816207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-347a4caf-89d7-478f-8d99-8a0bb62142fc tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094768 Jun 02 19:28:42.816799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1390/2771] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:43.447624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-34c69162-1968-4be7-bd8d-c5185a5843d3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:43.448291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-34c69162-1968-4be7-bd8d-c5185a5843d3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:43.455636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34c69162-1968-4be7-bd8d-c5185a5843d3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:43.456105 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34c69162-1968-4be7-bd8d-c5185a5843d3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:43.456881 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34c69162-1968-4be7-bd8d-c5185a5843d3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:43.457318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34c69162-1968-4be7-bd8d-c5185a5843d3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:43.600571 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-34c69162-1968-4be7-bd8d-c5185a5843d3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:43.611872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-34c69162-1968-4be7-bd8d-c5185a5843d3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168185 Jun 02 19:28:43.612445 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1382/2772] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:43 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:43.835387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-77cdfb08-813b-428b-8b9d-43944c11a5a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:43.836007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-77cdfb08-813b-428b-8b9d-43944c11a5a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:43.845400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77cdfb08-813b-428b-8b9d-43944c11a5a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:43.845871 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77cdfb08-813b-428b-8b9d-43944c11a5a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:43.846628 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77cdfb08-813b-428b-8b9d-43944c11a5a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:43.847075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-77cdfb08-813b-428b-8b9d-43944c11a5a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:43.916433 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-77cdfb08-813b-428b-8b9d-43944c11a5a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:43.925953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-77cdfb08-813b-428b-8b9d-43944c11a5a8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095350 Jun 02 19:28:43.926542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1391/2773] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:44.629563 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6a865f0d-ddc3-4204-a41d-bffb59a876d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:44.630189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6a865f0d-ddc3-4204-a41d-bffb59a876d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:44.637254 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a865f0d-ddc3-4204-a41d-bffb59a876d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:44.637713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a865f0d-ddc3-4204-a41d-bffb59a876d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:44.638484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a865f0d-ddc3-4204-a41d-bffb59a876d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:44.638988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6a865f0d-ddc3-4204-a41d-bffb59a876d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:44.785102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6a865f0d-ddc3-4204-a41d-bffb59a876d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:44.793621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6a865f0d-ddc3-4204-a41d-bffb59a876d6 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167983 Jun 02 19:28:44.794220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1383/2774] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:44 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:28:44.943957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4dd2dc1b-0b17-4d4c-a1dd-894ca8bbad6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:44.944609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4dd2dc1b-0b17-4d4c-a1dd-894ca8bbad6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:44.951337 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4dd2dc1b-0b17-4d4c-a1dd-894ca8bbad6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:44.952180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4dd2dc1b-0b17-4d4c-a1dd-894ca8bbad6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:44.952964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4dd2dc1b-0b17-4d4c-a1dd-894ca8bbad6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:44.953403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4dd2dc1b-0b17-4d4c-a1dd-894ca8bbad6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:45.017015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4dd2dc1b-0b17-4d4c-a1dd-894ca8bbad6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:45.025531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4dd2dc1b-0b17-4d4c-a1dd-894ca8bbad6d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085481 Jun 02 19:28:45.026146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1392/2775] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:45.814368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-316d7d6b-4dd2-4356-b8f1-3e0bb4e60ac2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:45.814925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-316d7d6b-4dd2-4356-b8f1-3e0bb4e60ac2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:45.822090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-316d7d6b-4dd2-4356-b8f1-3e0bb4e60ac2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:45.822537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-316d7d6b-4dd2-4356-b8f1-3e0bb4e60ac2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:45.823298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-316d7d6b-4dd2-4356-b8f1-3e0bb4e60ac2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:45.823731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-316d7d6b-4dd2-4356-b8f1-3e0bb4e60ac2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:45.961312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-316d7d6b-4dd2-4356-b8f1-3e0bb4e60ac2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:45.970146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-316d7d6b-4dd2-4356-b8f1-3e0bb4e60ac2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160842 Jun 02 19:28:45.970731 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1384/2776] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:45 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:46.043785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-764d1abe-1efc-4b6d-8882-47dd7492a34d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:46.044419 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-764d1abe-1efc-4b6d-8882-47dd7492a34d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:46.051943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-764d1abe-1efc-4b6d-8882-47dd7492a34d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:46.052400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-764d1abe-1efc-4b6d-8882-47dd7492a34d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:46.053186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-764d1abe-1efc-4b6d-8882-47dd7492a34d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:46.053648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-764d1abe-1efc-4b6d-8882-47dd7492a34d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:46.126032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-764d1abe-1efc-4b6d-8882-47dd7492a34d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:46.129547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:46.135572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-764d1abe-1efc-4b6d-8882-47dd7492a34d tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095697 Jun 02 19:28:46.136194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1393/2777] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:46.987997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-deb3e5af-db20-4dc3-b7d2-e44fdb954da9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:46.988654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-deb3e5af-db20-4dc3-b7d2-e44fdb954da9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:46.995706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-deb3e5af-db20-4dc3-b7d2-e44fdb954da9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:46.996153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-deb3e5af-db20-4dc3-b7d2-e44fdb954da9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:46.996912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-deb3e5af-db20-4dc3-b7d2-e44fdb954da9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:46.997338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-deb3e5af-db20-4dc3-b7d2-e44fdb954da9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:47.151092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-deb3e5af-db20-4dc3-b7d2-e44fdb954da9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:47.154019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-74336377-b4c2-4eb8-9b2a-ad72c0a25039 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:47.154672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-74336377-b4c2-4eb8-9b2a-ad72c0a25039 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:47.160441 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-deb3e5af-db20-4dc3-b7d2-e44fdb954da9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.176506 Jun 02 19:28:47.161307 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1385/2778] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:46 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:47.162488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-74336377-b4c2-4eb8-9b2a-ad72c0a25039 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:47.162962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-74336377-b4c2-4eb8-9b2a-ad72c0a25039 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:47.163783 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-74336377-b4c2-4eb8-9b2a-ad72c0a25039 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:47.164221 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-74336377-b4c2-4eb8-9b2a-ad72c0a25039 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:47.237495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-74336377-b4c2-4eb8-9b2a-ad72c0a25039 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:47.247266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-74336377-b4c2-4eb8-9b2a-ad72c0a25039 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097317 Jun 02 19:28:47.247779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1394/2779] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:47 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:48.178067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8b7f9f31-e75d-46e2-9512-8050a3ec4779 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:48.178715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8b7f9f31-e75d-46e2-9512-8050a3ec4779 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:48.186318 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b7f9f31-e75d-46e2-9512-8050a3ec4779 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:48.186939 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b7f9f31-e75d-46e2-9512-8050a3ec4779 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:48.187856 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b7f9f31-e75d-46e2-9512-8050a3ec4779 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:48.188285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8b7f9f31-e75d-46e2-9512-8050a3ec4779 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:48.266364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f7b10ff2-7ae8-4a04-9add-412b08745dfe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:48.267071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f7b10ff2-7ae8-4a04-9add-412b08745dfe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:48.273972 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f7b10ff2-7ae8-4a04-9add-412b08745dfe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:48.274425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f7b10ff2-7ae8-4a04-9add-412b08745dfe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:48.275200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f7b10ff2-7ae8-4a04-9add-412b08745dfe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:48.275636 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f7b10ff2-7ae8-4a04-9add-412b08745dfe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:48.355014 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f7b10ff2-7ae8-4a04-9add-412b08745dfe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:48.363023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8b7f9f31-e75d-46e2-9512-8050a3ec4779 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:48.363801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f7b10ff2-7ae8-4a04-9add-412b08745dfe tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.101662 Jun 02 19:28:48.364471 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1395/2780] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:48.372274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8b7f9f31-e75d-46e2-9512-8050a3ec4779 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.198112 Jun 02 19:28:48.372837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1386/2781] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:48 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:49.383455 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d7639887-06d0-4594-bf17-366c056870c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:49.384205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d7639887-06d0-4594-bf17-366c056870c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:49.390135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e390a958-4b29-408b-ac98-266a8cfa69ef tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:49.390721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e390a958-4b29-408b-ac98-266a8cfa69ef tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:49.392546 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7639887-06d0-4594-bf17-366c056870c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:49.393031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7639887-06d0-4594-bf17-366c056870c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:49.393839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7639887-06d0-4594-bf17-366c056870c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:49.394298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7639887-06d0-4594-bf17-366c056870c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:49.397558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e390a958-4b29-408b-ac98-266a8cfa69ef tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:49.398035 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e390a958-4b29-408b-ac98-266a8cfa69ef tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:49.398813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e390a958-4b29-408b-ac98-266a8cfa69ef tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:49.399251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e390a958-4b29-408b-ac98-266a8cfa69ef tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:49.474094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d7639887-06d0-4594-bf17-366c056870c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:49.484959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d7639887-06d0-4594-bf17-366c056870c5 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.105937 Jun 02 19:28:49.485558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1396/2782] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:49 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:49.566348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e390a958-4b29-408b-ac98-266a8cfa69ef tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:49.574320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e390a958-4b29-408b-ac98-266a8cfa69ef tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.188415 Jun 02 19:28:49.574872 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1387/2783] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:49 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:28:50.502457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-70c81f1f-1c34-4831-86ac-7320727d3e0e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:50.503077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-70c81f1f-1c34-4831-86ac-7320727d3e0e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:50.510195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-70c81f1f-1c34-4831-86ac-7320727d3e0e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:50.510649 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-70c81f1f-1c34-4831-86ac-7320727d3e0e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:50.511409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-70c81f1f-1c34-4831-86ac-7320727d3e0e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:50.511962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-70c81f1f-1c34-4831-86ac-7320727d3e0e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:50.579722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-70c81f1f-1c34-4831-86ac-7320727d3e0e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:50.588377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-70c81f1f-1c34-4831-86ac-7320727d3e0e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089796 Jun 02 19:28:50.589052 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1397/2784] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:50 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:50.592895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-de1d5b77-6448-4c4d-8592-4b291385d890 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:50.593642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-de1d5b77-6448-4c4d-8592-4b291385d890 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:50.600512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de1d5b77-6448-4c4d-8592-4b291385d890 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:50.600959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de1d5b77-6448-4c4d-8592-4b291385d890 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:50.601720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de1d5b77-6448-4c4d-8592-4b291385d890 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:50.602172 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-de1d5b77-6448-4c4d-8592-4b291385d890 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:50.742716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-de1d5b77-6448-4c4d-8592-4b291385d890 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:50.754133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-de1d5b77-6448-4c4d-8592-4b291385d890 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164857 Jun 02 19:28:50.755012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1388/2785] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:50 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:51.607361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c37e4ef0-57ce-4a23-a4e5-d268a2bff6be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:51.608085 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c37e4ef0-57ce-4a23-a4e5-d268a2bff6be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:51.615133 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c37e4ef0-57ce-4a23-a4e5-d268a2bff6be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:51.615584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c37e4ef0-57ce-4a23-a4e5-d268a2bff6be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:51.616358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c37e4ef0-57ce-4a23-a4e5-d268a2bff6be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:51.616794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c37e4ef0-57ce-4a23-a4e5-d268a2bff6be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:51.682816 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c37e4ef0-57ce-4a23-a4e5-d268a2bff6be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:51.692011 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c37e4ef0-57ce-4a23-a4e5-d268a2bff6be tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090316 Jun 02 19:28:51.692598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1398/2786] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:51 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:51.777303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-163e855d-617f-4462-947c-8c0b844ffbf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:51.777989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-163e855d-617f-4462-947c-8c0b844ffbf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:51.785223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-163e855d-617f-4462-947c-8c0b844ffbf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:51.785590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-163e855d-617f-4462-947c-8c0b844ffbf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:51.786392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-163e855d-617f-4462-947c-8c0b844ffbf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:51.786819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-163e855d-617f-4462-947c-8c0b844ffbf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:51.931295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-163e855d-617f-4462-947c-8c0b844ffbf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:51.940480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-163e855d-617f-4462-947c-8c0b844ffbf0 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167406 Jun 02 19:28:51.941049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1389/2787] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:51 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:52.713426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b7e059c0-cbff-4c6d-afbe-66ac6943c846 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:52.714107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b7e059c0-cbff-4c6d-afbe-66ac6943c846 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:52.721431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b7e059c0-cbff-4c6d-afbe-66ac6943c846 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:52.721925 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b7e059c0-cbff-4c6d-afbe-66ac6943c846 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:52.722715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b7e059c0-cbff-4c6d-afbe-66ac6943c846 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:52.723160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b7e059c0-cbff-4c6d-afbe-66ac6943c846 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:52.786404 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b7e059c0-cbff-4c6d-afbe-66ac6943c846 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:52.794741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b7e059c0-cbff-4c6d-afbe-66ac6943c846 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085227 Jun 02 19:28:52.795323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1399/2788] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:52 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:52.958786 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c7ee8ed4-f7c1-46c3-8a92-718dbd85eb9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:52.959420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c7ee8ed4-f7c1-46c3-8a92-718dbd85eb9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:52.966522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c7ee8ed4-f7c1-46c3-8a92-718dbd85eb9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:52.966968 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c7ee8ed4-f7c1-46c3-8a92-718dbd85eb9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:52.967979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c7ee8ed4-f7c1-46c3-8a92-718dbd85eb9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:52.968214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c7ee8ed4-f7c1-46c3-8a92-718dbd85eb9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:53.107032 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c7ee8ed4-f7c1-46c3-8a92-718dbd85eb9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:53.116172 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c7ee8ed4-f7c1-46c3-8a92-718dbd85eb9e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161234 Jun 02 19:28:53.116724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1390/2789] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:52 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:53.814629 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4adbaf8-1565-4478-b32b-ae1dda32ac8e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:53.815457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c4adbaf8-1565-4478-b32b-ae1dda32ac8e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:53.824010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4adbaf8-1565-4478-b32b-ae1dda32ac8e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:53.824536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4adbaf8-1565-4478-b32b-ae1dda32ac8e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:53.825298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4adbaf8-1565-4478-b32b-ae1dda32ac8e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:53.825761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4adbaf8-1565-4478-b32b-ae1dda32ac8e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:53.897748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c4adbaf8-1565-4478-b32b-ae1dda32ac8e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:53.908772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c4adbaf8-1565-4478-b32b-ae1dda32ac8e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.100829 Jun 02 19:28:53.909364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1400/2790] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:53 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:54.134158 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-32dd0bf7-9e68-4a93-aed6-1b9997dada3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:54.134769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-32dd0bf7-9e68-4a93-aed6-1b9997dada3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:54.141989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-32dd0bf7-9e68-4a93-aed6-1b9997dada3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:54.142440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-32dd0bf7-9e68-4a93-aed6-1b9997dada3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:54.143226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-32dd0bf7-9e68-4a93-aed6-1b9997dada3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:54.143658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-32dd0bf7-9e68-4a93-aed6-1b9997dada3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:54.508466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-32dd0bf7-9e68-4a93-aed6-1b9997dada3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:54.517333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-32dd0bf7-9e68-4a93-aed6-1b9997dada3b tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.387189 Jun 02 19:28:54.517934 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1391/2791] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:54 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:54.933402 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c374f57c-d609-4720-ac45-fe4e55125182 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:54.934833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c374f57c-d609-4720-ac45-fe4e55125182 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:54.942982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c374f57c-d609-4720-ac45-fe4e55125182 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:54.943441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c374f57c-d609-4720-ac45-fe4e55125182 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:54.944225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c374f57c-d609-4720-ac45-fe4e55125182 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:54.944664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c374f57c-d609-4720-ac45-fe4e55125182 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:55.017264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c374f57c-d609-4720-ac45-fe4e55125182 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:55.025930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c374f57c-d609-4720-ac45-fe4e55125182 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098903 Jun 02 19:28:55.026516 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1401/2792] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:54 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:55.535713 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2a109607-a6b3-4f9e-b82d-03e3fbb4735c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:55.536364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2a109607-a6b3-4f9e-b82d-03e3fbb4735c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:55.543508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a109607-a6b3-4f9e-b82d-03e3fbb4735c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:55.543989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a109607-a6b3-4f9e-b82d-03e3fbb4735c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:55.544783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a109607-a6b3-4f9e-b82d-03e3fbb4735c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:55.545218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a109607-a6b3-4f9e-b82d-03e3fbb4735c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:55.691081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2a109607-a6b3-4f9e-b82d-03e3fbb4735c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:55.700498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2a109607-a6b3-4f9e-b82d-03e3fbb4735c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168907 Jun 02 19:28:55.701274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1392/2793] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:55 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:56.046353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3b45f25c-5351-40b9-b8d4-39b05e0bf242 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:56.047350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3b45f25c-5351-40b9-b8d4-39b05e0bf242 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:56.054476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b45f25c-5351-40b9-b8d4-39b05e0bf242 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:56.054933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b45f25c-5351-40b9-b8d4-39b05e0bf242 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:56.055711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b45f25c-5351-40b9-b8d4-39b05e0bf242 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:56.056205 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b45f25c-5351-40b9-b8d4-39b05e0bf242 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:56.120760 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3b45f25c-5351-40b9-b8d4-39b05e0bf242 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:56.130129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3b45f25c-5351-40b9-b8d4-39b05e0bf242 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090260 Jun 02 19:28:56.130720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1402/2794] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:56 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:56.720979 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-38b2ab81-9672-4848-8177-4bbc8f56d30a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:56.722010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-38b2ab81-9672-4848-8177-4bbc8f56d30a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:56.730728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38b2ab81-9672-4848-8177-4bbc8f56d30a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:56.731392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38b2ab81-9672-4848-8177-4bbc8f56d30a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:56.732531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38b2ab81-9672-4848-8177-4bbc8f56d30a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:56.733169 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38b2ab81-9672-4848-8177-4bbc8f56d30a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:56.750452 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:56.870802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-38b2ab81-9672-4848-8177-4bbc8f56d30a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:56.879577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-38b2ab81-9672-4848-8177-4bbc8f56d30a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164699 Jun 02 19:28:56.880180 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1393/2795] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:56 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:57.151273 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dc112f85-31a0-4a7c-b79f-e2b328875f48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:57.152214 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dc112f85-31a0-4a7c-b79f-e2b328875f48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:57.160526 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc112f85-31a0-4a7c-b79f-e2b328875f48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:57.160980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc112f85-31a0-4a7c-b79f-e2b328875f48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:57.161785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc112f85-31a0-4a7c-b79f-e2b328875f48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:57.162262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc112f85-31a0-4a7c-b79f-e2b328875f48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:57.227749 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dc112f85-31a0-4a7c-b79f-e2b328875f48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:57.236234 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dc112f85-31a0-4a7c-b79f-e2b328875f48 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092075 Jun 02 19:28:57.236801 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1403/2796] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:57 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:57.900205 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-93712ae0-dbe4-4dbc-9119-f2df3146497e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:57.901209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-93712ae0-dbe4-4dbc-9119-f2df3146497e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:57.909991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93712ae0-dbe4-4dbc-9119-f2df3146497e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:57.910439 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93712ae0-dbe4-4dbc-9119-f2df3146497e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:57.911229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93712ae0-dbe4-4dbc-9119-f2df3146497e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:57.911658 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-93712ae0-dbe4-4dbc-9119-f2df3146497e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:58.052840 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-93712ae0-dbe4-4dbc-9119-f2df3146497e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:58.061896 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-93712ae0-dbe4-4dbc-9119-f2df3146497e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.167686 Jun 02 19:28:58.063009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1394/2797] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:57 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:58.255056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-310d18ed-eb93-4389-a39b-3abc573a445e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:58.255665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-310d18ed-eb93-4389-a39b-3abc573a445e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:58.262804 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-310d18ed-eb93-4389-a39b-3abc573a445e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:58.263260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-310d18ed-eb93-4389-a39b-3abc573a445e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:58.264028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-310d18ed-eb93-4389-a39b-3abc573a445e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:58.264459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-310d18ed-eb93-4389-a39b-3abc573a445e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:58.330346 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-310d18ed-eb93-4389-a39b-3abc573a445e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:58.338798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-310d18ed-eb93-4389-a39b-3abc573a445e tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088328 Jun 02 19:28:58.339412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1404/2798] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:58 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:59.081313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-34a19fc1-4861-49f8-8e56-364548de6e02 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:59.081985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-34a19fc1-4861-49f8-8e56-364548de6e02 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:59.089113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34a19fc1-4861-49f8-8e56-364548de6e02 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:59.089593 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34a19fc1-4861-49f8-8e56-364548de6e02 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:59.090413 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34a19fc1-4861-49f8-8e56-364548de6e02 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:59.090846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34a19fc1-4861-49f8-8e56-364548de6e02 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:59.232974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-34a19fc1-4861-49f8-8e56-364548de6e02 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:59.242461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-34a19fc1-4861-49f8-8e56-364548de6e02 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165744 Jun 02 19:28:59.243031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1395/2799] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:59 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:28:59.356644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d3546cc4-0cb2-4499-aebf-8c9081441a3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:28:59.357227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d3546cc4-0cb2-4499-aebf-8c9081441a3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:28:59.365063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3546cc4-0cb2-4499-aebf-8c9081441a3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:59.365515 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3546cc4-0cb2-4499-aebf-8c9081441a3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:59.366339 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3546cc4-0cb2-4499-aebf-8c9081441a3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:28:59.366786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d3546cc4-0cb2-4499-aebf-8c9081441a3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:28:59.445199 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d3546cc4-0cb2-4499-aebf-8c9081441a3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:28:59.453746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d3546cc4-0cb2-4499-aebf-8c9081441a3a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.101033 Jun 02 19:28:59.454391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1405/2800] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:28:59 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:00.264523 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1e552a23-a56c-4499-acd5-ae7550672899 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:00.265155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1e552a23-a56c-4499-acd5-ae7550672899 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:00.274568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e552a23-a56c-4499-acd5-ae7550672899 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:00.275021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e552a23-a56c-4499-acd5-ae7550672899 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:00.275796 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e552a23-a56c-4499-acd5-ae7550672899 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:00.276228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e552a23-a56c-4499-acd5-ae7550672899 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:00.409788 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e552a23-a56c-4499-acd5-ae7550672899 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:00.421493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1e552a23-a56c-4499-acd5-ae7550672899 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162928 Jun 02 19:29:00.422454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1396/2801] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:00 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:00.471363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0d3760a2-6f66-41cb-b07e-0626230147a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:00.472010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0d3760a2-6f66-41cb-b07e-0626230147a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:00.479962 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0d3760a2-6f66-41cb-b07e-0626230147a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:00.480395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0d3760a2-6f66-41cb-b07e-0626230147a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:00.481203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0d3760a2-6f66-41cb-b07e-0626230147a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:00.481674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0d3760a2-6f66-41cb-b07e-0626230147a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:00.557650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0d3760a2-6f66-41cb-b07e-0626230147a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:00.571794 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0d3760a2-6f66-41cb-b07e-0626230147a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.104361 Jun 02 19:29:00.572412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1406/2802] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:00 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:01.441448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-466ed624-e7e0-4d55-b07c-bb31b114d89d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:01.442135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-466ed624-e7e0-4d55-b07c-bb31b114d89d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:01.451231 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-466ed624-e7e0-4d55-b07c-bb31b114d89d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:01.451984 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-466ed624-e7e0-4d55-b07c-bb31b114d89d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:01.452818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-466ed624-e7e0-4d55-b07c-bb31b114d89d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:01.453270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-466ed624-e7e0-4d55-b07c-bb31b114d89d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:01.589953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f4cf5b7c-a578-45b4-af96-32c0cf296a2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:01.590641 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f4cf5b7c-a578-45b4-af96-32c0cf296a2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:01.598333 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4cf5b7c-a578-45b4-af96-32c0cf296a2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:01.598792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4cf5b7c-a578-45b4-af96-32c0cf296a2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:01.599610 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4cf5b7c-a578-45b4-af96-32c0cf296a2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:01.600050 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4cf5b7c-a578-45b4-af96-32c0cf296a2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:01.620219 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-466ed624-e7e0-4d55-b07c-bb31b114d89d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:01.628836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-466ed624-e7e0-4d55-b07c-bb31b114d89d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.192901 Jun 02 19:29:01.633998 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1397/2803] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:01 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:01.667200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f4cf5b7c-a578-45b4-af96-32c0cf296a2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:01.675731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f4cf5b7c-a578-45b4-af96-32c0cf296a2a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089634 Jun 02 19:29:01.676312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1407/2804] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:01 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:02.646869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d2b8769b-ea73-407a-bd01-e51df93e22be tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:02.647513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d2b8769b-ea73-407a-bd01-e51df93e22be tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:02.654600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2b8769b-ea73-407a-bd01-e51df93e22be tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:02.655052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2b8769b-ea73-407a-bd01-e51df93e22be tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:02.655815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2b8769b-ea73-407a-bd01-e51df93e22be tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:02.656221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2b8769b-ea73-407a-bd01-e51df93e22be tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:02.692839 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bbde3409-c221-4a7d-b9e6-387b2127f004 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:02.693472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bbde3409-c221-4a7d-b9e6-387b2127f004 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:02.700718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbde3409-c221-4a7d-b9e6-387b2127f004 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:02.701176 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbde3409-c221-4a7d-b9e6-387b2127f004 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:02.702031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbde3409-c221-4a7d-b9e6-387b2127f004 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:02.702469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbde3409-c221-4a7d-b9e6-387b2127f004 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:02.783197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bbde3409-c221-4a7d-b9e6-387b2127f004 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:02.792280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bbde3409-c221-4a7d-b9e6-387b2127f004 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.103289 Jun 02 19:29:02.792790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1408/2805] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:02 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:02.816369 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d2b8769b-ea73-407a-bd01-e51df93e22be tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:02.825828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d2b8769b-ea73-407a-bd01-e51df93e22be tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.182774 Jun 02 19:29:02.826424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1398/2806] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:02 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:03.810249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-35c1aa5e-6b9c-45c9-ab45-6f7f3c306a49 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:03.810833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-35c1aa5e-6b9c-45c9-ab45-6f7f3c306a49 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:03.818412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35c1aa5e-6b9c-45c9-ab45-6f7f3c306a49 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:03.818865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35c1aa5e-6b9c-45c9-ab45-6f7f3c306a49 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:03.819634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35c1aa5e-6b9c-45c9-ab45-6f7f3c306a49 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:03.820069 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-35c1aa5e-6b9c-45c9-ab45-6f7f3c306a49 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:03.843527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1d593812-ba50-47d7-a851-fdc986788c97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:03.844792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1d593812-ba50-47d7-a851-fdc986788c97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:03.851197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d593812-ba50-47d7-a851-fdc986788c97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:03.851636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d593812-ba50-47d7-a851-fdc986788c97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:03.852395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d593812-ba50-47d7-a851-fdc986788c97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:03.852818 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d593812-ba50-47d7-a851-fdc986788c97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:03.888619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-35c1aa5e-6b9c-45c9-ab45-6f7f3c306a49 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:03.897478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-35c1aa5e-6b9c-45c9-ab45-6f7f3c306a49 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.091540 Jun 02 19:29:03.898106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1409/2807] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:03 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:03.998186 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1d593812-ba50-47d7-a851-fdc986788c97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:04.008767 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1d593812-ba50-47d7-a851-fdc986788c97 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.169079 Jun 02 19:29:04.009349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1399/2808] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:03 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:29:04.914724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-18f261bb-1e65-40a9-827a-950a15ce8756 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:04.915377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-18f261bb-1e65-40a9-827a-950a15ce8756 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:04.922374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18f261bb-1e65-40a9-827a-950a15ce8756 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:04.923040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18f261bb-1e65-40a9-827a-950a15ce8756 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:04.923814 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18f261bb-1e65-40a9-827a-950a15ce8756 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:04.924267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18f261bb-1e65-40a9-827a-950a15ce8756 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:04.947818 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:04.999664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-18f261bb-1e65-40a9-827a-950a15ce8756 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:05.009372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-18f261bb-1e65-40a9-827a-950a15ce8756 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098495 Jun 02 19:29:05.009981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1410/2809] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:04 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:05.026661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-90ec9ecc-c33f-4834-80e7-4e60009d021a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:05.027266 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-90ec9ecc-c33f-4834-80e7-4e60009d021a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:05.035102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-90ec9ecc-c33f-4834-80e7-4e60009d021a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:05.035552 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-90ec9ecc-c33f-4834-80e7-4e60009d021a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:05.036297 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-90ec9ecc-c33f-4834-80e7-4e60009d021a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:05.036741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-90ec9ecc-c33f-4834-80e7-4e60009d021a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:05.175963 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-90ec9ecc-c33f-4834-80e7-4e60009d021a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:05.184694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-90ec9ecc-c33f-4834-80e7-4e60009d021a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161938 Jun 02 19:29:05.185261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1400/2810] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:05 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:06.027341 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8a968a38-4c09-486d-a7f4-93cf703e87e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:06.027980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8a968a38-4c09-486d-a7f4-93cf703e87e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:06.030787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=54 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:06.036943 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a968a38-4c09-486d-a7f4-93cf703e87e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:06.037398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a968a38-4c09-486d-a7f4-93cf703e87e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:06.038231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a968a38-4c09-486d-a7f4-93cf703e87e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:06.038661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a968a38-4c09-486d-a7f4-93cf703e87e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:06.104598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8a968a38-4c09-486d-a7f4-93cf703e87e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:06.113327 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8a968a38-4c09-486d-a7f4-93cf703e87e0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089936 Jun 02 19:29:06.113937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1411/2811] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:06 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:06.202912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-236ce306-d2c7-477e-bbd8-f31563ebc7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:06.203539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-236ce306-d2c7-477e-bbd8-f31563ebc7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:06.210642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-236ce306-d2c7-477e-bbd8-f31563ebc7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:06.211085 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-236ce306-d2c7-477e-bbd8-f31563ebc7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:06.211851 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-236ce306-d2c7-477e-bbd8-f31563ebc7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:06.212280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-236ce306-d2c7-477e-bbd8-f31563ebc7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:06.355128 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-236ce306-d2c7-477e-bbd8-f31563ebc7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:06.365916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-236ce306-d2c7-477e-bbd8-f31563ebc7c3 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166808 Jun 02 19:29:06.366503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1401/2812] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:06 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:07.132450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8538e81e-af8c-4a73-9013-d5e9fb4c3b40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:07.133103 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8538e81e-af8c-4a73-9013-d5e9fb4c3b40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:07.140980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8538e81e-af8c-4a73-9013-d5e9fb4c3b40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:07.141891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8538e81e-af8c-4a73-9013-d5e9fb4c3b40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:07.142672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8538e81e-af8c-4a73-9013-d5e9fb4c3b40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:07.143106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8538e81e-af8c-4a73-9013-d5e9fb4c3b40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:07.210454 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8538e81e-af8c-4a73-9013-d5e9fb4c3b40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:07.221080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8538e81e-af8c-4a73-9013-d5e9fb4c3b40 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094133 Jun 02 19:29:07.221702 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1412/2813] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:07 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:07.383477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a8a1fd84-690d-44d0-be59-f6df2edff433 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:07.384098 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a8a1fd84-690d-44d0-be59-f6df2edff433 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:07.392270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8a1fd84-690d-44d0-be59-f6df2edff433 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:07.392270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8a1fd84-690d-44d0-be59-f6df2edff433 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:07.393080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8a1fd84-690d-44d0-be59-f6df2edff433 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:07.393505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8a1fd84-690d-44d0-be59-f6df2edff433 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:07.539820 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a8a1fd84-690d-44d0-be59-f6df2edff433 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:07.549183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a8a1fd84-690d-44d0-be59-f6df2edff433 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.169562 Jun 02 19:29:07.549918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1402/2814] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:07 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:08.242715 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-43a27354-8bd7-4550-b27f-f5e34f590f4c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:08.243371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43a27354-8bd7-4550-b27f-f5e34f590f4c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:08.250258 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43a27354-8bd7-4550-b27f-f5e34f590f4c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:08.250748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43a27354-8bd7-4550-b27f-f5e34f590f4c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:08.251524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43a27354-8bd7-4550-b27f-f5e34f590f4c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:08.251965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43a27354-8bd7-4550-b27f-f5e34f590f4c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:08.321048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43a27354-8bd7-4550-b27f-f5e34f590f4c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:08.329466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-43a27354-8bd7-4550-b27f-f5e34f590f4c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.093322 Jun 02 19:29:08.330089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1413/2815] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:08 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:08.571252 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-75165a52-cae2-4ab7-bc4e-2186369015d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:08.571878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-75165a52-cae2-4ab7-bc4e-2186369015d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:08.579052 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-75165a52-cae2-4ab7-bc4e-2186369015d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:08.579505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-75165a52-cae2-4ab7-bc4e-2186369015d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:08.580272 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-75165a52-cae2-4ab7-bc4e-2186369015d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:08.580706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-75165a52-cae2-4ab7-bc4e-2186369015d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:08.724926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-75165a52-cae2-4ab7-bc4e-2186369015d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:08.733596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-75165a52-cae2-4ab7-bc4e-2186369015d4 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.166349 Jun 02 19:29:08.734214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1403/2816] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:08 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:09.347208 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-12a689d4-0c7f-421b-a630-f0c097479666 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:09.347844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-12a689d4-0c7f-421b-a630-f0c097479666 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:09.355012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12a689d4-0c7f-421b-a630-f0c097479666 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:09.355469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12a689d4-0c7f-421b-a630-f0c097479666 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:09.356249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12a689d4-0c7f-421b-a630-f0c097479666 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:09.356689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12a689d4-0c7f-421b-a630-f0c097479666 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:09.426612 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-12a689d4-0c7f-421b-a630-f0c097479666 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:09.435564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-12a689d4-0c7f-421b-a630-f0c097479666 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092479 Jun 02 19:29:09.436142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1414/2817] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:09 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:09.752579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-36740bc6-9400-44ff-8ed4-08f74449ca93 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:09.753364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-36740bc6-9400-44ff-8ed4-08f74449ca93 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:09.760301 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36740bc6-9400-44ff-8ed4-08f74449ca93 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:09.760746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36740bc6-9400-44ff-8ed4-08f74449ca93 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:09.761502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36740bc6-9400-44ff-8ed4-08f74449ca93 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:09.761966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36740bc6-9400-44ff-8ed4-08f74449ca93 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:09.901299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-36740bc6-9400-44ff-8ed4-08f74449ca93 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:09.912461 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-36740bc6-9400-44ff-8ed4-08f74449ca93 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.163586 Jun 02 19:29:09.913141 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1404/2818] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:09 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:10.455200 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89962b90-154b-4878-a289-facffa3bb857 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:10.455999 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-89962b90-154b-4878-a289-facffa3bb857 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:10.463151 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89962b90-154b-4878-a289-facffa3bb857 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:10.463599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89962b90-154b-4878-a289-facffa3bb857 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:10.464367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89962b90-154b-4878-a289-facffa3bb857 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:10.464833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89962b90-154b-4878-a289-facffa3bb857 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:10.533356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-89962b90-154b-4878-a289-facffa3bb857 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:10.542509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-89962b90-154b-4878-a289-facffa3bb857 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.093569 Jun 02 19:29:10.543095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1415/2819] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:10 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:10.930360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f4909390-11fa-42dc-a9dc-554436596161 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:10.931003 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f4909390-11fa-42dc-a9dc-554436596161 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:10.939525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f4909390-11fa-42dc-a9dc-554436596161 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:10.940192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f4909390-11fa-42dc-a9dc-554436596161 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:10.941434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f4909390-11fa-42dc-a9dc-554436596161 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:10.942462 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f4909390-11fa-42dc-a9dc-554436596161 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:11.090959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f4909390-11fa-42dc-a9dc-554436596161 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:11.099952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f4909390-11fa-42dc-a9dc-554436596161 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.173859 Jun 02 19:29:11.100541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1405/2820] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:10 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:11.560693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fd7df1df-44dc-4f4e-a98a-487ec5fc25a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:11.561276 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fd7df1df-44dc-4f4e-a98a-487ec5fc25a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:11.569841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd7df1df-44dc-4f4e-a98a-487ec5fc25a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:11.570411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd7df1df-44dc-4f4e-a98a-487ec5fc25a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:11.571335 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd7df1df-44dc-4f4e-a98a-487ec5fc25a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:11.571792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fd7df1df-44dc-4f4e-a98a-487ec5fc25a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:11.643491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fd7df1df-44dc-4f4e-a98a-487ec5fc25a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:11.653601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fd7df1df-44dc-4f4e-a98a-487ec5fc25a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097137 Jun 02 19:29:11.654479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1416/2821] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:11 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:12.118285 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92a8e0df-90ef-4582-8edb-7b2aa89abe26 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:12.118974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92a8e0df-90ef-4582-8edb-7b2aa89abe26 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:12.121232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:12.126745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92a8e0df-90ef-4582-8edb-7b2aa89abe26 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:12.127193 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92a8e0df-90ef-4582-8edb-7b2aa89abe26 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:12.127966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92a8e0df-90ef-4582-8edb-7b2aa89abe26 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:12.128387 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92a8e0df-90ef-4582-8edb-7b2aa89abe26 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:12.269023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-92a8e0df-90ef-4582-8edb-7b2aa89abe26 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:12.279576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92a8e0df-90ef-4582-8edb-7b2aa89abe26 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165531 Jun 02 19:29:12.280223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1406/2822] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:12 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:12.672319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0ce8d4a6-3642-4ea8-a517-bbe67034f031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:12.672978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0ce8d4a6-3642-4ea8-a517-bbe67034f031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:12.680507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ce8d4a6-3642-4ea8-a517-bbe67034f031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:12.680967 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ce8d4a6-3642-4ea8-a517-bbe67034f031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:12.681742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ce8d4a6-3642-4ea8-a517-bbe67034f031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:12.682218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0ce8d4a6-3642-4ea8-a517-bbe67034f031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:12.757415 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0ce8d4a6-3642-4ea8-a517-bbe67034f031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:12.765772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0ce8d4a6-3642-4ea8-a517-bbe67034f031 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098086 Jun 02 19:29:12.766367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1417/2823] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:12 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:13.297882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f3f91276-0344-4670-98f4-4b417b3d5598 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:13.298535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f3f91276-0344-4670-98f4-4b417b3d5598 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:13.310455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3f91276-0344-4670-98f4-4b417b3d5598 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:13.310887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3f91276-0344-4670-98f4-4b417b3d5598 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:13.311724 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3f91276-0344-4670-98f4-4b417b3d5598 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:13.312165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f3f91276-0344-4670-98f4-4b417b3d5598 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:13.460059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f3f91276-0344-4670-98f4-4b417b3d5598 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:13.468360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f3f91276-0344-4670-98f4-4b417b3d5598 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.175090 Jun 02 19:29:13.468974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1407/2824] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:13 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:13.783576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c7dec091-5dde-4069-9494-e4954477adcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:13.784179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c7dec091-5dde-4069-9494-e4954477adcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:13.791219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7dec091-5dde-4069-9494-e4954477adcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:13.791668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7dec091-5dde-4069-9494-e4954477adcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:13.792434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7dec091-5dde-4069-9494-e4954477adcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:13.792852 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7dec091-5dde-4069-9494-e4954477adcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:13.856965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c7dec091-5dde-4069-9494-e4954477adcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:13.866282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c7dec091-5dde-4069-9494-e4954477adcb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086335 Jun 02 19:29:13.867115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1418/2825] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:13 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:14.490999 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-64792037-4982-4387-ad87-c6f5c50ae607 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:14.491637 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-64792037-4982-4387-ad87-c6f5c50ae607 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:14.498588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64792037-4982-4387-ad87-c6f5c50ae607 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:14.499034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64792037-4982-4387-ad87-c6f5c50ae607 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:14.499792 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64792037-4982-4387-ad87-c6f5c50ae607 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:14.500213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-64792037-4982-4387-ad87-c6f5c50ae607 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:14.637755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-64792037-4982-4387-ad87-c6f5c50ae607 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:14.646058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-64792037-4982-4387-ad87-c6f5c50ae607 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.158964 Jun 02 19:29:14.646612 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1408/2826] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:14 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:14.888524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d7869bff-d6a8-47d6-8579-d2fea5ad2dc4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:14.889468 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d7869bff-d6a8-47d6-8579-d2fea5ad2dc4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:14.899135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7869bff-d6a8-47d6-8579-d2fea5ad2dc4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:14.899590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7869bff-d6a8-47d6-8579-d2fea5ad2dc4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:14.900364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7869bff-d6a8-47d6-8579-d2fea5ad2dc4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:14.900798 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7869bff-d6a8-47d6-8579-d2fea5ad2dc4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:14.977034 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d7869bff-d6a8-47d6-8579-d2fea5ad2dc4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:14.985508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d7869bff-d6a8-47d6-8579-d2fea5ad2dc4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.103485 Jun 02 19:29:14.986201 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1419/2827] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:14 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:15.663546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6f13ed28-c7ae-4599-ac8a-8bf0c97a9fa9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:15.664127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6f13ed28-c7ae-4599-ac8a-8bf0c97a9fa9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:15.670861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f13ed28-c7ae-4599-ac8a-8bf0c97a9fa9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:15.671276 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f13ed28-c7ae-4599-ac8a-8bf0c97a9fa9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:15.672040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f13ed28-c7ae-4599-ac8a-8bf0c97a9fa9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:15.672478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f13ed28-c7ae-4599-ac8a-8bf0c97a9fa9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:15.812176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6f13ed28-c7ae-4599-ac8a-8bf0c97a9fa9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:15.820622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6f13ed28-c7ae-4599-ac8a-8bf0c97a9fa9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161053 Jun 02 19:29:15.821393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1409/2828] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:15 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:16.004466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-817508bf-c14e-44c9-904c-ca4e6230701c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:16.005322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-817508bf-c14e-44c9-904c-ca4e6230701c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:16.012131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-817508bf-c14e-44c9-904c-ca4e6230701c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:16.012595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-817508bf-c14e-44c9-904c-ca4e6230701c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:16.013394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-817508bf-c14e-44c9-904c-ca4e6230701c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:16.013868 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-817508bf-c14e-44c9-904c-ca4e6230701c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:16.077146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-817508bf-c14e-44c9-904c-ca4e6230701c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:16.085420 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-817508bf-c14e-44c9-904c-ca4e6230701c tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.084873 Jun 02 19:29:16.086023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1420/2829] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:15 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:16.846218 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3ead8267-ce63-4df4-882a-5d5195fbe22d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:16.846771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ead8267-ce63-4df4-882a-5d5195fbe22d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:16.853861 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ead8267-ce63-4df4-882a-5d5195fbe22d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:16.854330 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ead8267-ce63-4df4-882a-5d5195fbe22d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:16.855080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ead8267-ce63-4df4-882a-5d5195fbe22d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:16.855507 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ead8267-ce63-4df4-882a-5d5195fbe22d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:16.858056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:16.991028 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3ead8267-ce63-4df4-882a-5d5195fbe22d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:17.001857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3ead8267-ce63-4df4-882a-5d5195fbe22d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159524 Jun 02 19:29:17.002539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1410/2830] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:16 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:17.103813 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f4efbd30-e04f-48dc-b4de-6cbea3f18e1a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:17.104394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f4efbd30-e04f-48dc-b4de-6cbea3f18e1a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:17.111983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4efbd30-e04f-48dc-b4de-6cbea3f18e1a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:17.112550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4efbd30-e04f-48dc-b4de-6cbea3f18e1a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:17.113328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4efbd30-e04f-48dc-b4de-6cbea3f18e1a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:17.113764 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f4efbd30-e04f-48dc-b4de-6cbea3f18e1a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:17.177048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f4efbd30-e04f-48dc-b4de-6cbea3f18e1a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:17.185945 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f4efbd30-e04f-48dc-b4de-6cbea3f18e1a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086226 Jun 02 19:29:17.186500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1421/2831] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:17 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:18.020573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-69a05613-dd70-4cd7-b133-69d67d82c443 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:18.021636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-69a05613-dd70-4cd7-b133-69d67d82c443 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:18.027919 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69a05613-dd70-4cd7-b133-69d67d82c443 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:18.028368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69a05613-dd70-4cd7-b133-69d67d82c443 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:18.029166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69a05613-dd70-4cd7-b133-69d67d82c443 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:18.029600 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-69a05613-dd70-4cd7-b133-69d67d82c443 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:18.167508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-69a05613-dd70-4cd7-b133-69d67d82c443 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:18.175707 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-69a05613-dd70-4cd7-b133-69d67d82c443 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159169 Jun 02 19:29:18.176265 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1411/2832] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:18 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:18.203348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-73242f93-c105-4ed2-9909-4182bf7b112a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:18.203961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-73242f93-c105-4ed2-9909-4182bf7b112a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:18.211061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73242f93-c105-4ed2-9909-4182bf7b112a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:18.211525 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73242f93-c105-4ed2-9909-4182bf7b112a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:18.212271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73242f93-c105-4ed2-9909-4182bf7b112a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:18.212718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73242f93-c105-4ed2-9909-4182bf7b112a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:18.279550 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-73242f93-c105-4ed2-9909-4182bf7b112a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:18.287883 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-73242f93-c105-4ed2-9909-4182bf7b112a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088445 Jun 02 19:29:18.288435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1422/2833] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:18 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:19.193160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9ec6e24d-ff12-4691-a572-6be5c73db01a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:19.193738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9ec6e24d-ff12-4691-a572-6be5c73db01a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:19.200700 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ec6e24d-ff12-4691-a572-6be5c73db01a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:19.201137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ec6e24d-ff12-4691-a572-6be5c73db01a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:19.201928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ec6e24d-ff12-4691-a572-6be5c73db01a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:19.202377 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ec6e24d-ff12-4691-a572-6be5c73db01a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:19.304910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5c311198-bba5-4e2c-b014-e2c5a87cae74 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:19.305508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5c311198-bba5-4e2c-b014-e2c5a87cae74 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:19.312775 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c311198-bba5-4e2c-b014-e2c5a87cae74 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:19.313227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c311198-bba5-4e2c-b014-e2c5a87cae74 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:19.314048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c311198-bba5-4e2c-b014-e2c5a87cae74 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:19.314486 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5c311198-bba5-4e2c-b014-e2c5a87cae74 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:19.335652 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9ec6e24d-ff12-4691-a572-6be5c73db01a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:19.344132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9ec6e24d-ff12-4691-a572-6be5c73db01a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.155243 Jun 02 19:29:19.344711 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1412/2834] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:19 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:19.377854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5c311198-bba5-4e2c-b014-e2c5a87cae74 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:19.386586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5c311198-bba5-4e2c-b014-e2c5a87cae74 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085851 Jun 02 19:29:19.387161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1423/2835] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:19 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:20.361728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c5349424-c5ca-423c-b6da-5545126cd0db tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:20.362361 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c5349424-c5ca-423c-b6da-5545126cd0db tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:20.369480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5349424-c5ca-423c-b6da-5545126cd0db tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:20.370017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5349424-c5ca-423c-b6da-5545126cd0db tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:20.370868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5349424-c5ca-423c-b6da-5545126cd0db tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:20.371506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5349424-c5ca-423c-b6da-5545126cd0db tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:20.404140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ac786121-e7ae-47e9-be64-8772c3ae99f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:20.404725 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ac786121-e7ae-47e9-be64-8772c3ae99f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:20.411689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac786121-e7ae-47e9-be64-8772c3ae99f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:20.412146 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac786121-e7ae-47e9-be64-8772c3ae99f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:20.412932 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac786121-e7ae-47e9-be64-8772c3ae99f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:20.413373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ac786121-e7ae-47e9-be64-8772c3ae99f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:20.495825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ac786121-e7ae-47e9-be64-8772c3ae99f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:20.504535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ac786121-e7ae-47e9-be64-8772c3ae99f8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.104256 Jun 02 19:29:20.505409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1424/2836] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:20 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:20.536160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c5349424-c5ca-423c-b6da-5545126cd0db tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:20.544737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c5349424-c5ca-423c-b6da-5545126cd0db tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.186803 Jun 02 19:29:20.545226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1413/2837] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:20 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:21.522124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-74465fe0-095e-42ef-9c94-e9af715385c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:21.522748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-74465fe0-095e-42ef-9c94-e9af715385c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:21.529785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-74465fe0-095e-42ef-9c94-e9af715385c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:21.530267 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-74465fe0-095e-42ef-9c94-e9af715385c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:21.531040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-74465fe0-095e-42ef-9c94-e9af715385c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:21.531476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-74465fe0-095e-42ef-9c94-e9af715385c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:21.565334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6785480c-81ec-4bf0-9751-e09611f8c6a2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:21.565978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6785480c-81ec-4bf0-9751-e09611f8c6a2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:21.574229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6785480c-81ec-4bf0-9751-e09611f8c6a2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:21.574771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6785480c-81ec-4bf0-9751-e09611f8c6a2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:21.575627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6785480c-81ec-4bf0-9751-e09611f8c6a2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:21.576060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6785480c-81ec-4bf0-9751-e09611f8c6a2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:21.598027 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-74465fe0-095e-42ef-9c94-e9af715385c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:21.606761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-74465fe0-095e-42ef-9c94-e9af715385c8 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088675 Jun 02 19:29:21.607547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1425/2838] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:21 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:21.720325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6785480c-81ec-4bf0-9751-e09611f8c6a2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:21.730544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6785480c-81ec-4bf0-9751-e09611f8c6a2 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.169410 Jun 02 19:29:21.730844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1414/2839] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:21 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:29:22.626091 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5ab5347f-a048-4194-bb96-693e02a09184 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:22.626812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5ab5347f-a048-4194-bb96-693e02a09184 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:22.638639 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5ab5347f-a048-4194-bb96-693e02a09184 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:22.639097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5ab5347f-a048-4194-bb96-693e02a09184 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:22.640019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5ab5347f-a048-4194-bb96-693e02a09184 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:22.640465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5ab5347f-a048-4194-bb96-693e02a09184 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:22.711132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5ab5347f-a048-4194-bb96-693e02a09184 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:22.719779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5ab5347f-a048-4194-bb96-693e02a09184 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.097701 Jun 02 19:29:22.720326 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1426/2840] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:22 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:22.751148 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-501c3a4c-7d03-4b7e-9589-f85efffe9902 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:22.751769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-501c3a4c-7d03-4b7e-9589-f85efffe9902 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:22.759506 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-501c3a4c-7d03-4b7e-9589-f85efffe9902 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:22.760236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-501c3a4c-7d03-4b7e-9589-f85efffe9902 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:22.761010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-501c3a4c-7d03-4b7e-9589-f85efffe9902 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:22.761436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-501c3a4c-7d03-4b7e-9589-f85efffe9902 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:22.900434 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-501c3a4c-7d03-4b7e-9589-f85efffe9902 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:22.913673 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-501c3a4c-7d03-4b7e-9589-f85efffe9902 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165776 Jun 02 19:29:22.915340 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1415/2841] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:22 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:23.737384 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dc9a7c63-98db-4afe-a907-3f6320c40c9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:23.738046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dc9a7c63-98db-4afe-a907-3f6320c40c9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:23.745339 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc9a7c63-98db-4afe-a907-3f6320c40c9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:23.745820 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc9a7c63-98db-4afe-a907-3f6320c40c9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:23.746690 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc9a7c63-98db-4afe-a907-3f6320c40c9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:23.747135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dc9a7c63-98db-4afe-a907-3f6320c40c9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:23.751190 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:23.826235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dc9a7c63-98db-4afe-a907-3f6320c40c9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:23.840197 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dc9a7c63-98db-4afe-a907-3f6320c40c9a tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.106405 Jun 02 19:29:23.841057 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1427/2842] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:23 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:23.935960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14c30cf0-2158-45d9-9d59-91757d80c024 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:23.936587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14c30cf0-2158-45d9-9d59-91757d80c024 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:23.946349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14c30cf0-2158-45d9-9d59-91757d80c024 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:23.946912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14c30cf0-2158-45d9-9d59-91757d80c024 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:23.948102 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14c30cf0-2158-45d9-9d59-91757d80c024 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:23.948721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14c30cf0-2158-45d9-9d59-91757d80c024 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:24.094546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-14c30cf0-2158-45d9-9d59-91757d80c024 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:24.103425 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14c30cf0-2158-45d9-9d59-91757d80c024 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.174113 Jun 02 19:29:24.103997 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1416/2843] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:23 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:24.862630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bbf341f2-a95e-47ec-b90d-421aaf3e3548 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:24.863249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bbf341f2-a95e-47ec-b90d-421aaf3e3548 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:24.870374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbf341f2-a95e-47ec-b90d-421aaf3e3548 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:24.870825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbf341f2-a95e-47ec-b90d-421aaf3e3548 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:24.871613 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbf341f2-a95e-47ec-b90d-421aaf3e3548 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:24.872046 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbf341f2-a95e-47ec-b90d-421aaf3e3548 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:24.934220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bbf341f2-a95e-47ec-b90d-421aaf3e3548 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:24.942752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bbf341f2-a95e-47ec-b90d-421aaf3e3548 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.084141 Jun 02 19:29:24.943336 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1428/2844] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:24 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:25.120847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-87f7c310-754e-49b7-8fe3-88f692ae483e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:25.121487 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-87f7c310-754e-49b7-8fe3-88f692ae483e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:25.128251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87f7c310-754e-49b7-8fe3-88f692ae483e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:25.128838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87f7c310-754e-49b7-8fe3-88f692ae483e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:25.129391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87f7c310-754e-49b7-8fe3-88f692ae483e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:25.129969 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-87f7c310-754e-49b7-8fe3-88f692ae483e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:25.259220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-87f7c310-754e-49b7-8fe3-88f692ae483e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:25.267791 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-87f7c310-754e-49b7-8fe3-88f692ae483e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.150965 Jun 02 19:29:25.268332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1417/2845] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:25 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:25.959568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-71f3d917-9470-4ba3-b090-ab1b78e65a28 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:25.960213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-71f3d917-9470-4ba3-b090-ab1b78e65a28 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:25.967167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71f3d917-9470-4ba3-b090-ab1b78e65a28 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:25.967659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71f3d917-9470-4ba3-b090-ab1b78e65a28 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:25.968438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71f3d917-9470-4ba3-b090-ab1b78e65a28 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:25.968878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-71f3d917-9470-4ba3-b090-ab1b78e65a28 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:26.036028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-71f3d917-9470-4ba3-b090-ab1b78e65a28 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:26.044523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-71f3d917-9470-4ba3-b090-ab1b78e65a28 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.088887 Jun 02 19:29:26.045114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1429/2846] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:25 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:26.286181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-80e3b9e8-7dbb-4f4b-b4d7-ed9e5f03ea4d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:26.286891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-80e3b9e8-7dbb-4f4b-b4d7-ed9e5f03ea4d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:26.293839 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-80e3b9e8-7dbb-4f4b-b4d7-ed9e5f03ea4d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:26.294296 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-80e3b9e8-7dbb-4f4b-b4d7-ed9e5f03ea4d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:26.295055 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-80e3b9e8-7dbb-4f4b-b4d7-ed9e5f03ea4d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:26.295485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-80e3b9e8-7dbb-4f4b-b4d7-ed9e5f03ea4d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:26.433778 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-80e3b9e8-7dbb-4f4b-b4d7-ed9e5f03ea4d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:26.441976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-80e3b9e8-7dbb-4f4b-b4d7-ed9e5f03ea4d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.160049 Jun 02 19:29:26.442579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1418/2847] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:26 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:27.064331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4eaa3d82-7d4f-44c1-8b76-14d971a349b7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:27.064953 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4eaa3d82-7d4f-44c1-8b76-14d971a349b7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:27.072354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4eaa3d82-7d4f-44c1-8b76-14d971a349b7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:27.072806 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4eaa3d82-7d4f-44c1-8b76-14d971a349b7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:27.073599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4eaa3d82-7d4f-44c1-8b76-14d971a349b7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:27.074065 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4eaa3d82-7d4f-44c1-8b76-14d971a349b7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:27.137268 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4eaa3d82-7d4f-44c1-8b76-14d971a349b7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:27.145722 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4eaa3d82-7d4f-44c1-8b76-14d971a349b7 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085141 Jun 02 19:29:27.146340 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1430/2848] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:27 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:27.459630 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5dbeb32b-fbbf-487a-927b-307edebe4c5f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:27.460264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5dbeb32b-fbbf-487a-927b-307edebe4c5f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:27.467070 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5dbeb32b-fbbf-487a-927b-307edebe4c5f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:27.467515 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5dbeb32b-fbbf-487a-927b-307edebe4c5f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:27.468273 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5dbeb32b-fbbf-487a-927b-307edebe4c5f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:27.468705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5dbeb32b-fbbf-487a-927b-307edebe4c5f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:27.604312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5dbeb32b-fbbf-487a-927b-307edebe4c5f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:27.612609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5dbeb32b-fbbf-487a-927b-307edebe4c5f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156989 Jun 02 19:29:27.613146 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1419/2849] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:27 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:28.163238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c647c0c5-3340-4fb4-b15b-18f046c74f5f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:28.163875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c647c0c5-3340-4fb4-b15b-18f046c74f5f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:28.170833 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c647c0c5-3340-4fb4-b15b-18f046c74f5f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:28.171285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c647c0c5-3340-4fb4-b15b-18f046c74f5f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:28.172053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c647c0c5-3340-4fb4-b15b-18f046c74f5f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:28.172492 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c647c0c5-3340-4fb4-b15b-18f046c74f5f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:28.236012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c647c0c5-3340-4fb4-b15b-18f046c74f5f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:28.244380 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c647c0c5-3340-4fb4-b15b-18f046c74f5f tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085669 Jun 02 19:29:28.244959 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1431/2850] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:28 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:28.633751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-43ee56e7-30d0-4ebf-8d68-9f036204841c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:28.634721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-43ee56e7-30d0-4ebf-8d68-9f036204841c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:28.644200 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43ee56e7-30d0-4ebf-8d68-9f036204841c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:28.644650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43ee56e7-30d0-4ebf-8d68-9f036204841c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:28.645591 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43ee56e7-30d0-4ebf-8d68-9f036204841c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:28.646077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43ee56e7-30d0-4ebf-8d68-9f036204841c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:28.784280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-43ee56e7-30d0-4ebf-8d68-9f036204841c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:28.793329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-43ee56e7-30d0-4ebf-8d68-9f036204841c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165497 Jun 02 19:29:28.793841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1420/2851] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:28 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:29.261994 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5aca23c7-37d9-4b2e-98b7-71f2c52d0038 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:29.262600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5aca23c7-37d9-4b2e-98b7-71f2c52d0038 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:29.269577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aca23c7-37d9-4b2e-98b7-71f2c52d0038 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:29.270352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aca23c7-37d9-4b2e-98b7-71f2c52d0038 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:29.271154 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aca23c7-37d9-4b2e-98b7-71f2c52d0038 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:29.271564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aca23c7-37d9-4b2e-98b7-71f2c52d0038 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:29.336567 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5aca23c7-37d9-4b2e-98b7-71f2c52d0038 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:29.344676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5aca23c7-37d9-4b2e-98b7-71f2c52d0038 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086664 Jun 02 19:29:29.345249 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1432/2852] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:29 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:29.811344 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3871ae48-5fb0-4fe1-a7f9-fc8ad8a0330d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:29.811957 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3871ae48-5fb0-4fe1-a7f9-fc8ad8a0330d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:29.819372 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3871ae48-5fb0-4fe1-a7f9-fc8ad8a0330d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:29.819815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3871ae48-5fb0-4fe1-a7f9-fc8ad8a0330d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:29.820573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3871ae48-5fb0-4fe1-a7f9-fc8ad8a0330d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:29.820994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3871ae48-5fb0-4fe1-a7f9-fc8ad8a0330d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:29.955429 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3871ae48-5fb0-4fe1-a7f9-fc8ad8a0330d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:29.964642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3871ae48-5fb0-4fe1-a7f9-fc8ad8a0330d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.157757 Jun 02 19:29:29.965190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1421/2853] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:29 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:30.362637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5b9f8f64-58f4-4375-ba49-f0439a2267cb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:30.363286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5b9f8f64-58f4-4375-ba49-f0439a2267cb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:30.370984 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b9f8f64-58f4-4375-ba49-f0439a2267cb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:30.371446 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b9f8f64-58f4-4375-ba49-f0439a2267cb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:30.372227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b9f8f64-58f4-4375-ba49-f0439a2267cb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:30.372672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b9f8f64-58f4-4375-ba49-f0439a2267cb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:30.440179 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5b9f8f64-58f4-4375-ba49-f0439a2267cb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:30.448877 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5b9f8f64-58f4-4375-ba49-f0439a2267cb tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.090096 Jun 02 19:29:30.449445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1433/2854] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:30 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:30.982858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-909eac28-ba7d-42ed-8d1e-02613ddfc6cc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:30.983446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-909eac28-ba7d-42ed-8d1e-02613ddfc6cc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:30.991676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-909eac28-ba7d-42ed-8d1e-02613ddfc6cc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:30.992173 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-909eac28-ba7d-42ed-8d1e-02613ddfc6cc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:30.992985 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-909eac28-ba7d-42ed-8d1e-02613ddfc6cc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:30.993416 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-909eac28-ba7d-42ed-8d1e-02613ddfc6cc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:31.141947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-909eac28-ba7d-42ed-8d1e-02613ddfc6cc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:31.150560 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-909eac28-ba7d-42ed-8d1e-02613ddfc6cc tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.171592 Jun 02 19:29:31.151134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1422/2855] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:30 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:31.470235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ad9a42f8-cbc7-4830-91e3-03ab84524872 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:31.471028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ad9a42f8-cbc7-4830-91e3-03ab84524872 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:31.477975 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad9a42f8-cbc7-4830-91e3-03ab84524872 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:31.478459 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad9a42f8-cbc7-4830-91e3-03ab84524872 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:31.479238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad9a42f8-cbc7-4830-91e3-03ab84524872 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:31.479651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad9a42f8-cbc7-4830-91e3-03ab84524872 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:31.556303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ad9a42f8-cbc7-4830-91e3-03ab84524872 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:31.569019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ad9a42f8-cbc7-4830-91e3-03ab84524872 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.102709 Jun 02 19:29:31.569616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1434/2856] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:31 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:32.169595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9f5a26a5-3b45-444c-8153-5777f1bcd315 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:32.170221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9f5a26a5-3b45-444c-8153-5777f1bcd315 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:32.179793 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f5a26a5-3b45-444c-8153-5777f1bcd315 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:32.180249 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f5a26a5-3b45-444c-8153-5777f1bcd315 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:32.181023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f5a26a5-3b45-444c-8153-5777f1bcd315 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:32.181466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f5a26a5-3b45-444c-8153-5777f1bcd315 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:32.321436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9f5a26a5-3b45-444c-8153-5777f1bcd315 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:32.330197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9f5a26a5-3b45-444c-8153-5777f1bcd315 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164559 Jun 02 19:29:32.330745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1423/2857] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:32 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:32.588768 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-84e5610f-e9f2-499c-ba1a-6e998cc844ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:32.589400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-84e5610f-e9f2-499c-ba1a-6e998cc844ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:32.596586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84e5610f-e9f2-499c-ba1a-6e998cc844ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:32.597037 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84e5610f-e9f2-499c-ba1a-6e998cc844ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:32.597822 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84e5610f-e9f2-499c-ba1a-6e998cc844ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:32.598465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84e5610f-e9f2-499c-ba1a-6e998cc844ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:32.663220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84e5610f-e9f2-499c-ba1a-6e998cc844ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:32.671740 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-84e5610f-e9f2-499c-ba1a-6e998cc844ad tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.086876 Jun 02 19:29:32.672323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1435/2858] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:32 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:33.349665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6e04bdbe-c099-45d3-ad4c-7fbdf26cb145 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:33.350332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6e04bdbe-c099-45d3-ad4c-7fbdf26cb145 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:33.357557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e04bdbe-c099-45d3-ad4c-7fbdf26cb145 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:33.358063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e04bdbe-c099-45d3-ad4c-7fbdf26cb145 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:33.358907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e04bdbe-c099-45d3-ad4c-7fbdf26cb145 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:33.359339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6e04bdbe-c099-45d3-ad4c-7fbdf26cb145 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:33.498198 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6e04bdbe-c099-45d3-ad4c-7fbdf26cb145 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:33.507081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6e04bdbe-c099-45d3-ad4c-7fbdf26cb145 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.162882 Jun 02 19:29:33.507674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1424/2859] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:33 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:33.690319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8e938858-0a8f-4cb7-b0c7-7dea05e4b5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:33.690986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8e938858-0a8f-4cb7-b0c7-7dea05e4b5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:33.699556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e938858-0a8f-4cb7-b0c7-7dea05e4b5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:33.699940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e938858-0a8f-4cb7-b0c7-7dea05e4b5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:33.700719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e938858-0a8f-4cb7-b0c7-7dea05e4b5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:33.701164 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e938858-0a8f-4cb7-b0c7-7dea05e4b5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:33.772905 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8e938858-0a8f-4cb7-b0c7-7dea05e4b5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:33.784917 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8e938858-0a8f-4cb7-b0c7-7dea05e4b5a9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098249 Jun 02 19:29:33.785699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1436/2860] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:33 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:34.527751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-82bbbaba-296c-4a70-bfdd-b825996bc99c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:34.527751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-82bbbaba-296c-4a70-bfdd-b825996bc99c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:34.533143 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82bbbaba-296c-4a70-bfdd-b825996bc99c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:34.533592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82bbbaba-296c-4a70-bfdd-b825996bc99c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:34.534395 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82bbbaba-296c-4a70-bfdd-b825996bc99c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:34.535154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82bbbaba-296c-4a70-bfdd-b825996bc99c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:34.688935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-82bbbaba-296c-4a70-bfdd-b825996bc99c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:34.698115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-82bbbaba-296c-4a70-bfdd-b825996bc99c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.177175 Jun 02 19:29:34.698687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1425/2861] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:34 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:34.810117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bf315eef-b847-4a5a-bdce-b4483db09b24 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:34.810117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bf315eef-b847-4a5a-bdce-b4483db09b24 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:34.812867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf315eef-b847-4a5a-bdce-b4483db09b24 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:34.813323 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf315eef-b847-4a5a-bdce-b4483db09b24 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:34.814128 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf315eef-b847-4a5a-bdce-b4483db09b24 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:34.814568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bf315eef-b847-4a5a-bdce-b4483db09b24 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:34.890694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bf315eef-b847-4a5a-bdce-b4483db09b24 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:34.899445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bf315eef-b847-4a5a-bdce-b4483db09b24 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.098588 Jun 02 19:29:34.900006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1437/2862] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:34 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:35.715008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-024dae22-b63d-44da-834d-670adfb1609e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:35.715641 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-024dae22-b63d-44da-834d-670adfb1609e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:35.722640 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-024dae22-b63d-44da-834d-670adfb1609e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:35.723088 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-024dae22-b63d-44da-834d-670adfb1609e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:35.723850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-024dae22-b63d-44da-834d-670adfb1609e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:35.724280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-024dae22-b63d-44da-834d-670adfb1609e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:35.870390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-024dae22-b63d-44da-834d-670adfb1609e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:35.872639 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:35.880048 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-024dae22-b63d-44da-834d-670adfb1609e tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.168964 Jun 02 19:29:35.880588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1426/2863] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:35 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:35.917359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d0475e1-2538-4b61-816a-5cc7388156d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:35.918006 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d0475e1-2538-4b61-816a-5cc7388156d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:35.924908 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0475e1-2538-4b61-816a-5cc7388156d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:35.925397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0475e1-2538-4b61-816a-5cc7388156d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:35.926224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0475e1-2538-4b61-816a-5cc7388156d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:35.926661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d0475e1-2538-4b61-816a-5cc7388156d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:36.000242 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d0475e1-2538-4b61-816a-5cc7388156d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:36.009753 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d0475e1-2538-4b61-816a-5cc7388156d4 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.096224 Jun 02 19:29:36.013319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1438/2864] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:35 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:36.901587 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0a0f1a05-a248-4558-9948-e7532ae177c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:36.902385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0a0f1a05-a248-4558-9948-e7532ae177c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:36.910925 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0f1a05-a248-4558-9948-e7532ae177c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:36.911478 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0f1a05-a248-4558-9948-e7532ae177c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:36.912405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0f1a05-a248-4558-9948-e7532ae177c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:36.913278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a0f1a05-a248-4558-9948-e7532ae177c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:37.027637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-db4ef24a-aa47-4ac2-9649-6904222f3359 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:37.028257 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-db4ef24a-aa47-4ac2-9649-6904222f3359 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:37.030630 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=56 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:37.036076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db4ef24a-aa47-4ac2-9649-6904222f3359 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:37.036530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db4ef24a-aa47-4ac2-9649-6904222f3359 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:37.037299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db4ef24a-aa47-4ac2-9649-6904222f3359 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:37.037922 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db4ef24a-aa47-4ac2-9649-6904222f3359 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:37.052494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0a0f1a05-a248-4558-9948-e7532ae177c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:37.061631 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0a0f1a05-a248-4558-9948-e7532ae177c9 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165771 Jun 02 19:29:37.062207 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1427/2865] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:36 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:37.100161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-db4ef24a-aa47-4ac2-9649-6904222f3359 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:37.108530 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-db4ef24a-aa47-4ac2-9649-6904222f3359 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085048 Jun 02 19:29:37.109101 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1439/2866] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:37 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:38.078801 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-162e303c-ce4e-4ca1-8286-dc57adb6f41d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:38.079460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-162e303c-ce4e-4ca1-8286-dc57adb6f41d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:38.086886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-162e303c-ce4e-4ca1-8286-dc57adb6f41d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:38.087347 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-162e303c-ce4e-4ca1-8286-dc57adb6f41d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:38.088110 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-162e303c-ce4e-4ca1-8286-dc57adb6f41d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:38.088533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-162e303c-ce4e-4ca1-8286-dc57adb6f41d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:38.126417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d6c31e40-b86e-4a82-887f-651c30e43586 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:38.127259 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d6c31e40-b86e-4a82-887f-651c30e43586 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:38.134654 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6c31e40-b86e-4a82-887f-651c30e43586 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:38.135114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6c31e40-b86e-4a82-887f-651c30e43586 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:38.135918 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6c31e40-b86e-4a82-887f-651c30e43586 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:38.136363 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d6c31e40-b86e-4a82-887f-651c30e43586 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:38.220757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d6c31e40-b86e-4a82-887f-651c30e43586 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:38.230514 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d6c31e40-b86e-4a82-887f-651c30e43586 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.107946 Jun 02 19:29:38.231106 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1440/2867] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:38 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:38.253558 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-162e303c-ce4e-4ca1-8286-dc57adb6f41d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:38.262681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-162e303c-ce4e-4ca1-8286-dc57adb6f41d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.187766 Jun 02 19:29:38.263433 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1428/2868] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:38 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:39.248129 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-11e1198b-d2e0-4caa-82b0-de9158ae98bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:39.248746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-11e1198b-d2e0-4caa-82b0-de9158ae98bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:39.255919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11e1198b-d2e0-4caa-82b0-de9158ae98bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:39.256618 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11e1198b-d2e0-4caa-82b0-de9158ae98bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:39.257225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11e1198b-d2e0-4caa-82b0-de9158ae98bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:39.257653 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-11e1198b-d2e0-4caa-82b0-de9158ae98bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:39.280759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f52c15b3-6e7c-42cc-8fa9-148c558d8376 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:39.281360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f52c15b3-6e7c-42cc-8fa9-148c558d8376 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:39.288466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f52c15b3-6e7c-42cc-8fa9-148c558d8376 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:39.288869 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f52c15b3-6e7c-42cc-8fa9-148c558d8376 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:39.289650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f52c15b3-6e7c-42cc-8fa9-148c558d8376 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:39.290127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f52c15b3-6e7c-42cc-8fa9-148c558d8376 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:39.319830 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-11e1198b-d2e0-4caa-82b0-de9158ae98bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:39.328194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-11e1198b-d2e0-4caa-82b0-de9158ae98bd tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.083997 Jun 02 19:29:39.328732 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1441/2869] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:39 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:39.432625 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f52c15b3-6e7c-42cc-8fa9-148c558d8376 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:39.441268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f52c15b3-6e7c-42cc-8fa9-148c558d8376 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.164538 Jun 02 19:29:39.441835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1429/2870] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:39 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:40.345481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c831553d-af9f-4def-8d6a-9189566650a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:40.346152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c831553d-af9f-4def-8d6a-9189566650a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:40.353856 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c831553d-af9f-4def-8d6a-9189566650a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:40.354338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c831553d-af9f-4def-8d6a-9189566650a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:40.355119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c831553d-af9f-4def-8d6a-9189566650a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:40.355558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c831553d-af9f-4def-8d6a-9189566650a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:40.425772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c831553d-af9f-4def-8d6a-9189566650a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:40.435067 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c831553d-af9f-4def-8d6a-9189566650a1 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.093524 Jun 02 19:29:40.435681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1442/2871] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:40 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:40.459024 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6fd1141d-ffcd-4308-9717-655d90cab63a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:40.459617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6fd1141d-ffcd-4308-9717-655d90cab63a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:40.466782 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6fd1141d-ffcd-4308-9717-655d90cab63a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:40.467240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6fd1141d-ffcd-4308-9717-655d90cab63a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:40.468009 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6fd1141d-ffcd-4308-9717-655d90cab63a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:40.468443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6fd1141d-ffcd-4308-9717-655d90cab63a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:40.604915 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6fd1141d-ffcd-4308-9717-655d90cab63a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:40.613238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6fd1141d-ffcd-4308-9717-655d90cab63a tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.158178 Jun 02 19:29:40.613825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1430/2872] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:40 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:41.455031 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f1e7e87a-a244-47f1-b52b-6bfa35bd7be0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:41.455986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f1e7e87a-a244-47f1-b52b-6bfa35bd7be0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:41.466791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1e7e87a-a244-47f1-b52b-6bfa35bd7be0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:41.467544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1e7e87a-a244-47f1-b52b-6bfa35bd7be0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:41.468799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1e7e87a-a244-47f1-b52b-6bfa35bd7be0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:41.469521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1e7e87a-a244-47f1-b52b-6bfa35bd7be0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:41.534265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f1e7e87a-a244-47f1-b52b-6bfa35bd7be0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:41.537727 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:41.543278 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f1e7e87a-a244-47f1-b52b-6bfa35bd7be0 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094043 Jun 02 19:29:41.543826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1443/2873] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:41 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:41.631232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-918309fe-d7e4-4fb3-b8a6-f032f5190895 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:41.632116 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-918309fe-d7e4-4fb3-b8a6-f032f5190895 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:41.639063 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-918309fe-d7e4-4fb3-b8a6-f032f5190895 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:41.639500 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-918309fe-d7e4-4fb3-b8a6-f032f5190895 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:41.640270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-918309fe-d7e4-4fb3-b8a6-f032f5190895 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:41.640705 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-918309fe-d7e4-4fb3-b8a6-f032f5190895 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:41.784068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-918309fe-d7e4-4fb3-b8a6-f032f5190895 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:41.792326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-918309fe-d7e4-4fb3-b8a6-f032f5190895 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.165068 Jun 02 19:29:41.792901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1431/2874] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:41 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:42.561716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6f73a6e9-7fe7-4e14-a858-335e6029dc56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:42.562662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6f73a6e9-7fe7-4e14-a858-335e6029dc56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:42.573136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6f73a6e9-7fe7-4e14-a858-335e6029dc56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:42.573860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6f73a6e9-7fe7-4e14-a858-335e6029dc56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:42.575142 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6f73a6e9-7fe7-4e14-a858-335e6029dc56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:42.575841 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6f73a6e9-7fe7-4e14-a858-335e6029dc56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:42.642083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6f73a6e9-7fe7-4e14-a858-335e6029dc56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:42.650758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6f73a6e9-7fe7-4e14-a858-335e6029dc56 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.094014 Jun 02 19:29:42.651347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1444/2875] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:42 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:42.810467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-72513335-ee65-4bdd-9e91-ca36e536055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:42.811067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-72513335-ee65-4bdd-9e91-ca36e536055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:42.814488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:42.818421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72513335-ee65-4bdd-9e91-ca36e536055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:42.818862 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72513335-ee65-4bdd-9e91-ca36e536055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:42.819643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72513335-ee65-4bdd-9e91-ca36e536055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:42.820075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72513335-ee65-4bdd-9e91-ca36e536055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:42.953887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-72513335-ee65-4bdd-9e91-ca36e536055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:42.962589 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-72513335-ee65-4bdd-9e91-ca36e536055d tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.156587 Jun 02 19:29:42.963163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1432/2876] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:42 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:43.668723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-43193d69-bc5a-45c8-821c-553348fd7085 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:43.669358 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43193d69-bc5a-45c8-821c-553348fd7085 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:43.676343 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43193d69-bc5a-45c8-821c-553348fd7085 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:43.676792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43193d69-bc5a-45c8-821c-553348fd7085 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:43.677556 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43193d69-bc5a-45c8-821c-553348fd7085 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:43.678032 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43193d69-bc5a-45c8-821c-553348fd7085 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:43.745153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43193d69-bc5a-45c8-821c-553348fd7085 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:43.754110 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-43193d69-bc5a-45c8-821c-553348fd7085 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.089268 Jun 02 19:29:43.754719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1445/2877] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:43 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:43.980204 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-afe42f93-0c0f-417f-b599-db83a1c5f92c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:43.980835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-afe42f93-0c0f-417f-b599-db83a1c5f92c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:43.988039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe42f93-0c0f-417f-b599-db83a1c5f92c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:43.988492 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe42f93-0c0f-417f-b599-db83a1c5f92c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:43.989240 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe42f93-0c0f-417f-b599-db83a1c5f92c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:43.989668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe42f93-0c0f-417f-b599-db83a1c5f92c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:44.121324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-afe42f93-0c0f-417f-b599-db83a1c5f92c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:44.129756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-afe42f93-0c0f-417f-b599-db83a1c5f92c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.153452 Jun 02 19:29:44.130358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1433/2878] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:43 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:44.776757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ed1549bb-e409-44fb-9bd3-12a3db0973c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:44.777658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ed1549bb-e409-44fb-9bd3-12a3db0973c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:44.788290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed1549bb-e409-44fb-9bd3-12a3db0973c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:44.788754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed1549bb-e409-44fb-9bd3-12a3db0973c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:44.789538 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed1549bb-e409-44fb-9bd3-12a3db0973c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:44.790019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed1549bb-e409-44fb-9bd3-12a3db0973c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:44.854086 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ed1549bb-e409-44fb-9bd3-12a3db0973c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:44.862398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ed1549bb-e409-44fb-9bd3-12a3db0973c9 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.092961 Jun 02 19:29:44.862986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1446/2879] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:44 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:45.147393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9ecf41b7-62af-41cd-8876-e418747f243f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:45.148010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9ecf41b7-62af-41cd-8876-e418747f243f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:45.155367 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ecf41b7-62af-41cd-8876-e418747f243f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:45.155815 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ecf41b7-62af-41cd-8876-e418747f243f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:45.156570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ecf41b7-62af-41cd-8876-e418747f243f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:45.156994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ecf41b7-62af-41cd-8876-e418747f243f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:45.294401 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9ecf41b7-62af-41cd-8876-e418747f243f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:45.302719 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9ecf41b7-62af-41cd-8876-e418747f243f tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.159366 Jun 02 19:29:45.303621 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1434/2880] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:45 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:45.490676 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:29:45.490940 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:29:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:29:45.883675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90495821-7296-48a9-9147-909ba2def409 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:45.884403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-90495821-7296-48a9-9147-909ba2def409 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:45.891174 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90495821-7296-48a9-9147-909ba2def409 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:45.891644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90495821-7296-48a9-9147-909ba2def409 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:45.892379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90495821-7296-48a9-9147-909ba2def409 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:45.892844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90495821-7296-48a9-9147-909ba2def409 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:45.956028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-90495821-7296-48a9-9147-909ba2def409 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:45.964623 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-90495821-7296-48a9-9147-909ba2def409 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.085001 Jun 02 19:29:45.965195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1447/2881] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:45 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:46.321120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-241ae798-a6d2-428f-9941-9da04e2184ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:46.321708 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-241ae798-a6d2-428f-9941-9da04e2184ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:46.328629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-241ae798-a6d2-428f-9941-9da04e2184ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:46.329077 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-241ae798-a6d2-428f-9941-9da04e2184ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:46.329823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-241ae798-a6d2-428f-9941-9da04e2184ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:46.330290 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-241ae798-a6d2-428f-9941-9da04e2184ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:46.469836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-241ae798-a6d2-428f-9941-9da04e2184ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:46.478087 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-241ae798-a6d2-428f-9941-9da04e2184ac tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161306 Jun 02 19:29:46.478629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1435/2882] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:46 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:47.030878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1d773432-b70a-49a7-b0f3-978b2b36ef69 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:47.031480 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1d773432-b70a-49a7-b0f3-978b2b36ef69 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:47.037825 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d773432-b70a-49a7-b0f3-978b2b36ef69 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:47.038361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d773432-b70a-49a7-b0f3-978b2b36ef69 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:47.039127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d773432-b70a-49a7-b0f3-978b2b36ef69 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:47.039544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d773432-b70a-49a7-b0f3-978b2b36ef69 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:47.104239 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1d773432-b70a-49a7-b0f3-978b2b36ef69 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:47.112325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1d773432-b70a-49a7-b0f3-978b2b36ef69 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.133978 Jun 02 19:29:47.112890 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1448/2883] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:46 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:47.495737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-84caa607-5a01-428b-8941-ad2c29704170 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:47.496371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84caa607-5a01-428b-8941-ad2c29704170 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:47.503329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84caa607-5a01-428b-8941-ad2c29704170 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:47.503779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84caa607-5a01-428b-8941-ad2c29704170 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:47.504532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84caa607-5a01-428b-8941-ad2c29704170 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:47.504959 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84caa607-5a01-428b-8941-ad2c29704170 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:47.637535 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-84caa607-5a01-428b-8941-ad2c29704170 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:47.645784 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-84caa607-5a01-428b-8941-ad2c29704170 tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.154115 Jun 02 19:29:47.646383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1436/2884] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:47 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:48.130117 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eb6a052b-577d-4954-a0b7-0de433d77f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:48.132121 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-eb6a052b-577d-4954-a0b7-0de433d77f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [instance: 721b511d-9547-41f5-a72c-47179f69b6af] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:48.138469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eb6a052b-577d-4954-a0b7-0de433d77f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:48.138937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eb6a052b-577d-4954-a0b7-0de433d77f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:48.139843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eb6a052b-577d-4954-a0b7-0de433d77f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:48.140366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eb6a052b-577d-4954-a0b7-0de433d77f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:48.209144 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eb6a052b-577d-4954-a0b7-0de433d77f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9791fd04ff4045578041a3c7f613f495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cefe0d5fbae4b6ca7578bf08f275bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:48.220355 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eb6a052b-577d-4954-a0b7-0de433d77f12 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af" status: 200 len: 1387 microversion: 2.1 time: 0.095178 Jun 02 19:29:48.221143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1449/2885] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:48 2022] GET /compute/v2.1/servers/721b511d-9547-41f5-a72c-47179f69b6af => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:48.238323 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b2c64d02-6df4-4f66-b811-988bf144cc64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] Calling method '.version_select at 0x7f5b7ac3e430>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:48.241511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b2c64d02-6df4-4f66-b811-988bf144cc64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [9df42a23-8693-4f37-be6e-14c3eef8297e] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 19:29:48.663040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b2bad284-0e1d-499b-a920-638098e7d58c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:29:48.663694 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b2bad284-0e1d-499b-a920-638098e7d58c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] [instance: 423ad810-dacf-4ac6-9fa1-68964373fa1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:29:48.669989 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2bad284-0e1d-499b-a920-638098e7d58c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:48.670438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2bad284-0e1d-499b-a920-638098e7d58c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:48.671228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2bad284-0e1d-499b-a920-638098e7d58c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:29:48.671657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2bad284-0e1d-499b-a920-638098e7d58c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:29:48.812386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b2bad284-0e1d-499b-a920-638098e7d58c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5875c5cba841a28560a475bb18d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad466a7fdbb4ef18dddf54fb200971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:29:48.820535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b2bad284-0e1d-499b-a920-638098e7d58c tempest-VolumesSnapshotTestJSON-453344377 tempest-VolumesSnapshotTestJSON-453344377-project] 10.222.0.15 "GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a" status: 200 len: 1560 microversion: 2.1 time: 0.161699 Jun 02 19:29:48.821089 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1450/2886] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:29:48 2022] GET /compute/v2.1/servers/423ad810-dacf-4ac6-9fa1-68964373fa1a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:29:49.249390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [None req-b2c64d02-6df4-4f66-b811-988bf144cc64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] [9df42a23-8693-4f37-be6e-14c3eef8297e] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 43962. Jun 02 19:29:49.271480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b2c64d02-6df4-4f66-b811-988bf144cc64 tempest-TestMinimumBasicScenario-27484978 tempest-TestMinimumBasicScenario-27484978-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-53525394" status: 202 len: 0 microversion: 2.1 time: 1.036995 Jun 02 19:29:49.272080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1437/2887] 10.222.0.15 () {58 vars in 1265 bytes} [Thu Jun 2 19:29:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-53525394 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:30:10.918386 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:30:10.919047 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:30:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:30:11.000892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:30:11.001436 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:30:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:31:35.294372 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:31:35.295192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:31:49.468689 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8cff8f0-937c-49b9-8b1d-71cc2693df62] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 02 19:31:49.472010 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:31:49.474280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:31:49.477375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=23 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:49.478470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=42 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:49.484382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:31:49.484848 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:31:49.485840 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:31:49.486544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:31:49.502148 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] HTTP exception thrown: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Request method failure captured: Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 HTTP/1.1 Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkIsLrDQ-Sep8fVWW8sMgeg65pJE5fqKzPb74Xea6N68lP22aiLkZPvpplpXL05mdDhRtAgaeMJyKt9HFgRG9phpHZ_ttbkyNakNeLY6lOaTTfy9BXKpoqFbN_NnmuZb9sekJblGCGCWrzfs9hwzmKRtysKDNTERTV-Liljdga5KME Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:31:49.503916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: cef7ac127d2f4284a1808c580148c9e0 Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.505846 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '3d2f3bad-3acd-4fe8-87bb-29f1424ea788'} Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:31:49.506792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.508236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.509659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Returning 404 to user: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:31:49.509659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e0242e1e-4e3c-4507-9d1e-ea8d49e93716 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 404 len: 111 microversion: 2.20 time: 0.039467 Jun 02 19:31:49.509659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1451/2888] 10.222.0.15 () {60 vars in 1279 bytes} [Thu Jun 2 19:31:49 2022] DELETE /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 19:31:49.512246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=61 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:49.513443 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:49.522973 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:31:49.523736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] [instance: 3d2f3bad-3acd-4fe8-87bb-29f1424ea788] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:31:49.535308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:31:49.535763 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:31:49.536776 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:31:49.537181 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:31:49.557704 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] HTTP exception thrown: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Request method failure captured: Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 HTTP/1.1 Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkIsLrDQ-Sep8fVWW8sMgeg65pJE5fqKzPb74Xea6N68lP22aiLkZPvpplpXL05mdDhRtAgaeMJyKt9HFgRG9phpHZ_ttbkyNakNeLY6lOaTTfy9BXKpoqFbN_NnmuZb9sekJblGCGCWrzfs9hwzmKRtysKDNTERTV-Liljdga5KME Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:31:49.559325 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a23ef70d937643f8a1c8597a8cfac596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: a23ef70d937643f8a1c8597a8cfac596 Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1148788540 Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: cef7ac127d2f4284a1808c580148c9e0 Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1148788540-project Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.561136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '3d2f3bad-3acd-4fe8-87bb-29f1424ea788'} Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:31:49.562315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. Jun 02 19:31:49.563871 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:31:49.565300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] Returning 404 to user: Instance 3d2f3bad-3acd-4fe8-87bb-29f1424ea788 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:31:49.565300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8e7b3b38-475a-43da-af52-73e089ca0c03 tempest-AttachVolumeShelveTestJSON-1148788540 tempest-AttachVolumeShelveTestJSON-1148788540-project] 10.222.0.15 "GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788" status: 404 len: 111 microversion: 2.20 time: 0.050581 Jun 02 19:31:49.565300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1438/2889] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Jun 2 19:31:49 2022] GET /compute/v2.1/servers/3d2f3bad-3acd-4fe8-87bb-29f1424ea788 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 02 19:32:00.853777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:32:00.854627 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:32:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:33:05.500115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:33:05.500805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:33:30.927159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:33:30.928042 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:33:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:33:31.010029 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:33:31.010643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:33:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:33:49.697597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:33:49.698125 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:33:49.701787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:49.702815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:49.708441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:33:49.708893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:33:49.709819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:33:49.710286 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:33:49.733444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8cff8f0-937c-49b9-8b1d-71cc2693df62] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 44270. Jun 02 19:33:49.733444 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 HTTP/1.1 Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:33:49.734859 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.736669 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '0cada17e-c4a7-434f-adc8-fea531c47cd8'} Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:33:49.738686 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.740634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.742733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:33:49.742733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-90e7e4de-6a08-452e-985a-4f43fb2b94f6 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 404 len: 111 microversion: 2.1 time: 0.043337 Jun 02 19:33:49.742733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1452/2890] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:33:49 2022] DELETE /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:33:49.743581 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e52ad2b3-959d-4eee-9ebb-179cc0cf755d] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 02 19:33:49.744121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:49.745224 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:49.749929 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:33:49.750653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] [instance: 0cada17e-c4a7-434f-adc8-fea531c47cd8] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:33:49.759090 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:33:49.759540 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:33:49.761391 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:33:49.761860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:33:49.778917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] HTTP exception thrown: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Request method failure captured: Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 HTTP/1.1 Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQkS4qxsjF7ZhPKtHfjDVCM6yARw_wOEpPCdCxviWGll225q6Or12DocnWwCU-IeMlQRsTgwHpnEIr_5C1Qnz_Z6d88SKeMDtwQypAxJUTbYWEt7CgysoGBRiojmIZN9Qp1kkiPKuHNXAtf3H5jv3A6NJG4ExRN-Ayr-socUxTmUv28 Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:33:49.780512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5a66e7666ca24a079738eea09c470cdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 5a66e7666ca24a079738eea09c470cdd Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-685545148 Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 4a660a47927140d6b4d0543de5e281a1 Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-685545148-project Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.782317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '0cada17e-c4a7-434f-adc8-fea531c47cd8'} Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:33:49.788691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. Jun 02 19:33:49.790799 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:33:49.792324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] Returning 404 to user: Instance 0cada17e-c4a7-434f-adc8-fea531c47cd8 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:33:49.792324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9e41edec-689c-447b-a36e-dd7addbcc551 tempest-AttachVolumeNegativeTest-685545148 tempest-AttachVolumeNegativeTest-685545148-project] 10.222.0.15 "GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8" status: 404 len: 111 microversion: 2.1 time: 0.040752 Jun 02 19:33:49.792324 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1439/2891] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:33:49 2022] GET /compute/v2.1/servers/0cada17e-c4a7-434f-adc8-fea531c47cd8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:34:49.976162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:34:49.977269 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:34:55.306246 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:34:55.307379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:34:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:35:20.863358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:35:20.864300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:35:50.128709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:50.129456 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:50.133450 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-43bac6fd-ae59-42c1-8296-9abcc89b63ae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:35:50.133978 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43bac6fd-ae59-42c1-8296-9abcc89b63ae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:35:50.141216 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43bac6fd-ae59-42c1-8296-9abcc89b63ae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:50.141672 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43bac6fd-ae59-42c1-8296-9abcc89b63ae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:50.142464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43bac6fd-ae59-42c1-8296-9abcc89b63ae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:50.142898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43bac6fd-ae59-42c1-8296-9abcc89b63ae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:50.169576 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43bac6fd-ae59-42c1-8296-9abcc89b63ae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:35:50.266458 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-43bac6fd-ae59-42c1-8296-9abcc89b63ae tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 204 len: 0 microversion: 2.1 time: 0.139165 Jun 02 19:35:50.267842 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1453/2892] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:35:50 2022] DELETE /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:35:50.279549 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d2e0ff65-7be5-4ec9-b017-2e6fb2964b5a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:35:50.280165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d2e0ff65-7be5-4ec9-b017-2e6fb2964b5a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:35:50.285268 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:50.287332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:50.292870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2e0ff65-7be5-4ec9-b017-2e6fb2964b5a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:50.293320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2e0ff65-7be5-4ec9-b017-2e6fb2964b5a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:50.294113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2e0ff65-7be5-4ec9-b017-2e6fb2964b5a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:50.294730 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d2e0ff65-7be5-4ec9-b017-2e6fb2964b5a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:50.314642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] [e52ad2b3-959d-4eee-9ebb-179cc0cf755d] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 44386. Jun 02 19:35:50.646841 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d2e0ff65-7be5-4ec9-b017-2e6fb2964b5a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:35:50.654727 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d2e0ff65-7be5-4ec9-b017-2e6fb2964b5a tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1508 microversion: 2.1 time: 0.381805 Jun 02 19:35:50.655679 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1440/2893] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:35:50 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:35:51.674136 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:35:51.676122 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:35:51.686228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:51.687058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:51.688228 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:51.689329 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:51.752860 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:51.753315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:51.753781 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lazy-loading 'fault' on Instance uuid c64c4128-397d-4c23-bdd1-a288b7627bba {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:35:51.763664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-893b363a-da38-477d-9184-b7ded8c532dd req-27ef3ff2-8a5a-4619-93b0-472c020c3d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64c4128-397d-4c23-bdd1-a288b7627bba", "name": "network-vif-deleted", "tag": "2ea7d55f-1945-4da5-8db7-67bf31ec73ce"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:35:51.778488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-893b363a-da38-477d-9184-b7ded8c532dd req-27ef3ff2-8a5a-4619-93b0-472c020c3d36 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:51.779277 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-893b363a-da38-477d-9184-b7ded8c532dd req-27ef3ff2-8a5a-4619-93b0-472c020c3d36 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:51.794097 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-893b363a-da38-477d-9184-b7ded8c532dd req-27ef3ff2-8a5a-4619-93b0-472c020c3d36 service nova] Creating event network-vif-deleted:2ea7d55f-1945-4da5-8db7-67bf31ec73ce for instance c64c4128-397d-4c23-bdd1-a288b7627bba on hv-cinder-79760 Jun 02 19:35:51.802736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-893b363a-da38-477d-9184-b7ded8c532dd req-27ef3ff2-8a5a-4619-93b0-472c020c3d36 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334435 Jun 02 19:35:51.809159 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1454/2894] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:35:51.822149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:35:51.830118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-720d4c9b-0c3b-472c-813c-1b2125e167df tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 200 len: 1312 microversion: 2.1 time: 0.160559 Jun 02 19:35:51.830687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1441/2895] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:35:51 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:35:52.849674 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:35:52.850520 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: c64c4128-397d-4c23-bdd1-a288b7627bba] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:35:52.858373 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:52.859098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:52.860033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:52.860810 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:52.875395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] HTTP exception thrown: Instance c64c4128-397d-4c23-bdd1-a288b7627bba could not be found. Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Request method failure captured: Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba HTTP/1.1 Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimQlS38G4DqtPiu3--ZxyayK6aSUxhLl-IYR-CTZyPuOEknapclGJxD19tyQbaOemAzNQqEbm7bIXrn0EpBoQJPbPyonI29v-O6oMXWhs7lPHfR2GtPoPY24Cexwy6IItuS6WPutF8nmEFt5TWOF6-2AsZdf3ggFOZbUpdX-xLTx4jwU Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: e2d79077c0654e55973512bc6d36a9e8 Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:35:52.877247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: e2d79077c0654e55973512bc6d36a9e8 Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-ServerRescueNegativeTestJSON-1063453713-project Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: 4eda4b85484844ab8b424a1a42a97704 Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1063453713-project Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance c64c4128-397d-4c23-bdd1-a288b7627bba could not be found. Jun 02 19:35:52.879020 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'c64c4128-397d-4c23-bdd1-a288b7627bba'} Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64c4128-397d-4c23-bdd1-a288b7627bba could not be found. Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:35:52.879891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64c4128-397d-4c23-bdd1-a288b7627bba could not be found. Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64c4128-397d-4c23-bdd1-a288b7627bba could not be found. Jun 02 19:35:52.881657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:35:52.884202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Returning 404 to user: Instance c64c4128-397d-4c23-bdd1-a288b7627bba could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:35:52.885328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b7594a97-7811-4e9c-951b-e5b8b0e32268 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba" status: 404 len: 111 microversion: 2.1 time: 0.040676 Jun 02 19:35:52.886073 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1455/2896] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:35:52 2022] GET /compute/v2.1/servers/c64c4128-397d-4c23-bdd1-a288b7627bba => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:35:52.894945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef254564-9d48-4642-bce4-c5d575bdc2b1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:35:52.896092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef254564-9d48-4642-bce4-c5d575bdc2b1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:35:52.903465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef254564-9d48-4642-bce4-c5d575bdc2b1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:52.904226 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef254564-9d48-4642-bce4-c5d575bdc2b1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:52.904987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef254564-9d48-4642-bce4-c5d575bdc2b1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:52.905414 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef254564-9d48-4642-bce4-c5d575bdc2b1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:52.936274 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef254564-9d48-4642-bce4-c5d575bdc2b1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:35:53.031722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef254564-9d48-4642-bce4-c5d575bdc2b1 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 204 len: 0 microversion: 2.1 time: 0.140770 Jun 02 19:35:53.032769 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1442/2897] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:35:52 2022] DELETE /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 19:35:53.041169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e531db4b-025b-4433-bf50-c0358247fc59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:35:53.041952 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e531db4b-025b-4433-bf50-c0358247fc59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:35:53.053861 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e531db4b-025b-4433-bf50-c0358247fc59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:53.054864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e531db4b-025b-4433-bf50-c0358247fc59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:53.055644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e531db4b-025b-4433-bf50-c0358247fc59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:53.056083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e531db4b-025b-4433-bf50-c0358247fc59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:53.432253 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e531db4b-025b-4433-bf50-c0358247fc59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:35:53.443008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e531db4b-025b-4433-bf50-c0358247fc59 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1521 microversion: 2.1 time: 0.405827 Jun 02 19:35:53.443593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1456/2898] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:35:53 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:35:54.078642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-8df35a78-3710-4918-b1b0-ece82233c497 req-9b930b52-8d6e-4a6c-87d2-00d6e8ee5775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc057ea-7c78-4621-9e75-8f9654f6157c", "name": "network-vif-deleted", "tag": "7bd66668-c08e-4f9a-8f25-71d8c0bf8627"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:35:54.087962 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-8df35a78-3710-4918-b1b0-ece82233c497 req-9b930b52-8d6e-4a6c-87d2-00d6e8ee5775 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:54.088615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-8df35a78-3710-4918-b1b0-ece82233c497 req-9b930b52-8d6e-4a6c-87d2-00d6e8ee5775 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:54.101477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-8df35a78-3710-4918-b1b0-ece82233c497 req-9b930b52-8d6e-4a6c-87d2-00d6e8ee5775 service nova] Creating event network-vif-deleted:7bd66668-c08e-4f9a-8f25-71d8c0bf8627 for instance 9dc057ea-7c78-4621-9e75-8f9654f6157c on hv-cinder-79760 Jun 02 19:35:54.106239 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-8df35a78-3710-4918-b1b0-ece82233c497 req-9b930b52-8d6e-4a6c-87d2-00d6e8ee5775 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031698 Jun 02 19:35:54.106825 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1443/2899] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:35:54.462709 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:35:54.466847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:35:54.485512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:54.486416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:54.487816 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:54.488807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:54.550724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:54.551569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:54.552580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lazy-loading 'fault' on Instance uuid 9dc057ea-7c78-4621-9e75-8f9654f6157c {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:35:54.610974 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eda4b85484844ab8b424a1a42a97704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d79077c0654e55973512bc6d36a9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:35:54.618225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ba0ca905-41cc-49f0-a986-0d971bc17133 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 200 len: 1311 microversion: 2.1 time: 0.161259 Jun 02 19:35:54.619391 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1457/2900] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:35:54 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 1311 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:35:55.637402 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:35:55.638081 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] [instance: 9dc057ea-7c78-4621-9e75-8f9654f6157c] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:35:55.644812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:55.645267 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:55.646053 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:35:55.646491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:35:55.660129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] HTTP exception thrown: Instance 9dc057ea-7c78-4621-9e75-8f9654f6157c could not be found. Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Request method failure captured: Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c HTTP/1.1 Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimQlS38G4DqtPiu3--ZxyayK6aSUxhLl-IYR-CTZyPuOEknapclGJxD19tyQbaOemAzNQqEbm7bIXrn0EpBoQJPbPyonI29v-O6oMXWhs7lPHfR2GtPoPY24Cexwy6IItuS6WPutF8nmEFt5TWOF6-2AsZdf3ggFOZbUpdX-xLTx4jwU Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: e2d79077c0654e55973512bc6d36a9e8 Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:35:55.661758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2d79077c0654e55973512bc6d36a9e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: e2d79077c0654e55973512bc6d36a9e8 Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1063453713 Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-ServerRescueNegativeTestJSON-1063453713-project Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 4eda4b85484844ab8b424a1a42a97704 Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1063453713-project Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 9dc057ea-7c78-4621-9e75-8f9654f6157c could not be found. Jun 02 19:35:55.663691 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '9dc057ea-7c78-4621-9e75-8f9654f6157c'} Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc057ea-7c78-4621-9e75-8f9654f6157c could not be found. Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:35:55.664926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc057ea-7c78-4621-9e75-8f9654f6157c could not be found. Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc057ea-7c78-4621-9e75-8f9654f6157c could not be found. Jun 02 19:35:55.666595 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:35:55.668171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] Returning 404 to user: Instance 9dc057ea-7c78-4621-9e75-8f9654f6157c could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:35:55.668171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7b1bfb92-9901-42f5-a0cb-d111ac834c85 tempest-ServerRescueNegativeTestJSON-1063453713 tempest-ServerRescueNegativeTestJSON-1063453713-project] 10.222.0.15 "GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c" status: 404 len: 111 microversion: 2.1 time: 0.030717 Jun 02 19:35:55.668171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1444/2901] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:35:55 2022] GET /compute/v2.1/servers/9dc057ea-7c78-4621-9e75-8f9654f6157c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:36:05.095721 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:05.096586 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:05.248614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7891e948-eb28-4803-b2c5-739e9578ff83 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'create', calling method: .version_select at 0x7f5b78cb1d30>, body: {"keypair": {"name": "tempest-keypair-399839843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALFy5nqsNFGaUpGRogNvVABi753oRO5iStMYnhecH0t1uaEgDMCdwRfjAsYkK95d4KLmYKO+Spi09Fg42sVFk8sjZxJm3dBtuCq0MExtYIAdJeee6Ue//qq6vueQ1mfkA=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:36:05.263671 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-7891e948-eb28-4803-b2c5-739e9578ff83 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Getting quotas for project 119263b9683e44eba604fc24eca20061. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:36:05.267910 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-7891e948-eb28-4803-b2c5-739e9578ff83 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Getting quotas for user d160ccef27104953beadc68e74b2d49e and project 119263b9683e44eba604fc24eca20061. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:36:05.299912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7891e948-eb28-4803-b2c5-739e9578ff83 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209131 Jun 02 19:36:05.300843 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1458/2902] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:36:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:36:06.917432 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1950948001", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2194255b-05f0-42dc-8cf5-100db25c9d89"}], "security_groups": [{"name": "tempest-securitygroup--979051046"}], "key_name": "tempest-keypair-399839843", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:36:06.926823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:06.927907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:07.089754 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] validate_networks() for [('2194255b-05f0-42dc-8cf5-100db25c9d89', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:36:07.732220 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:36:07.732866 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:36:07.733350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:36:07.733917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:36:07.734333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:36:07.745633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:07.746113 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:07.747315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:07.747928 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:07.772271 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Getting quotas for project 119263b9683e44eba604fc24eca20061. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:36:07.777008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Getting quotas for user d160ccef27104953beadc68e74b2d49e and project 119263b9683e44eba604fc24eca20061. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:36:07.793176 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:36:07.798234 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:36:07.865752 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8392b56a-b816-4aca-a0c5-4e48947bc0c4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.952638 Jun 02 19:36:07.867080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1445/2903] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:36:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:36:07.878739 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-668e9fd3-c7bc-4a33-896e-7b6b6862d6bd tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:07.879432 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-668e9fd3-c7bc-4a33-896e-7b6b6862d6bd tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:07.972092 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-668e9fd3-c7bc-4a33-896e-7b6b6862d6bd tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:07.980375 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-668e9fd3-c7bc-4a33-896e-7b6b6862d6bd tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1237 microversion: 2.1 time: 0.107160 Jun 02 19:36:07.992378 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1459/2904] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:07 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:09.001527 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a150b4b6-9317-4555-9684-57448f851c4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:09.002355 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a150b4b6-9317-4555-9684-57448f851c4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:09.020755 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a150b4b6-9317-4555-9684-57448f851c4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:09.021740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a150b4b6-9317-4555-9684-57448f851c4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:09.024004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a150b4b6-9317-4555-9684-57448f851c4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:09.025166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a150b4b6-9317-4555-9684-57448f851c4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:09.124284 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a150b4b6-9317-4555-9684-57448f851c4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:09.134261 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a150b4b6-9317-4555-9684-57448f851c4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1289 microversion: 2.1 time: 0.138523 Jun 02 19:36:09.135237 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1446/2905] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:08 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:10.151315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9235e1a6-9027-49ab-8277-6c29166253cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:10.151933 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9235e1a6-9027-49ab-8277-6c29166253cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:10.158299 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9235e1a6-9027-49ab-8277-6c29166253cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:10.158949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9235e1a6-9027-49ab-8277-6c29166253cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:10.159906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9235e1a6-9027-49ab-8277-6c29166253cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:10.160502 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9235e1a6-9027-49ab-8277-6c29166253cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:10.345730 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9235e1a6-9027-49ab-8277-6c29166253cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:10.354606 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9235e1a6-9027-49ab-8277-6c29166253cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1362 microversion: 2.1 time: 0.206930 Jun 02 19:36:10.355577 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1460/2906] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:10 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:11.040165 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-dbc28c81-97c2-4165-97d3-3b8b554ac067 req-d0b55fdc-8e4c-4881-8202-85362dc3ff03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d47d4c-7e0a-4ff5-b560-557ef9c7493e", "tag": "7f72f3b1-8fa8-44f3-a759-0f39264573fc"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:36:11.050457 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-dbc28c81-97c2-4165-97d3-3b8b554ac067 req-d0b55fdc-8e4c-4881-8202-85362dc3ff03 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:11.050847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-dbc28c81-97c2-4165-97d3-3b8b554ac067 req-d0b55fdc-8e4c-4881-8202-85362dc3ff03 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:11.067900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-dbc28c81-97c2-4165-97d3-3b8b554ac067 req-d0b55fdc-8e4c-4881-8202-85362dc3ff03 service nova] Creating event network-changed:7f72f3b1-8fa8-44f3-a759-0f39264573fc for instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e on hv-cinder-79760 Jun 02 19:36:11.073091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-dbc28c81-97c2-4165-97d3-3b8b554ac067 req-d0b55fdc-8e4c-4881-8202-85362dc3ff03 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036661 Jun 02 19:36:11.073623 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1447/2907] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:36:11.374767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c2de3d39-1b9e-4e7a-b781-3f011c2268e7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:11.375521 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c2de3d39-1b9e-4e7a-b781-3f011c2268e7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:11.383647 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2de3d39-1b9e-4e7a-b781-3f011c2268e7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:11.384105 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2de3d39-1b9e-4e7a-b781-3f011c2268e7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:11.384916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2de3d39-1b9e-4e7a-b781-3f011c2268e7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:11.385303 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c2de3d39-1b9e-4e7a-b781-3f011c2268e7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:11.553973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c2de3d39-1b9e-4e7a-b781-3f011c2268e7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:11.564888 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c2de3d39-1b9e-4e7a-b781-3f011c2268e7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1362 microversion: 2.1 time: 0.195167 Jun 02 19:36:11.565604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1461/2908] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:11 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:12.583798 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d48b5cce-cc29-4b2d-bded-5c4e138f973e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:12.584588 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d48b5cce-cc29-4b2d-bded-5c4e138f973e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:12.591179 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d48b5cce-cc29-4b2d-bded-5c4e138f973e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:12.591633 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d48b5cce-cc29-4b2d-bded-5c4e138f973e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:12.592396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d48b5cce-cc29-4b2d-bded-5c4e138f973e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:12.592828 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d48b5cce-cc29-4b2d-bded-5c4e138f973e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:12.726854 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d48b5cce-cc29-4b2d-bded-5c4e138f973e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:12.739287 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d48b5cce-cc29-4b2d-bded-5c4e138f973e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1362 microversion: 2.1 time: 0.159892 Jun 02 19:36:12.740040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1448/2909] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:12 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:13.761937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a766b5ca-5ff5-48df-9bab-8500b50536f1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:13.762926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a766b5ca-5ff5-48df-9bab-8500b50536f1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:13.774724 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a766b5ca-5ff5-48df-9bab-8500b50536f1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:13.775481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a766b5ca-5ff5-48df-9bab-8500b50536f1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:13.776805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a766b5ca-5ff5-48df-9bab-8500b50536f1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:13.777542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a766b5ca-5ff5-48df-9bab-8500b50536f1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:13.927237 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a766b5ca-5ff5-48df-9bab-8500b50536f1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:13.934870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a766b5ca-5ff5-48df-9bab-8500b50536f1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1362 microversion: 2.1 time: 0.180346 Jun 02 19:36:13.935452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1462/2910] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:13 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:14.953690 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fb10a12b-c19b-4de7-a813-0c8ee84df712 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:14.954471 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fb10a12b-c19b-4de7-a813-0c8ee84df712 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:14.962332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb10a12b-c19b-4de7-a813-0c8ee84df712 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:14.962779 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb10a12b-c19b-4de7-a813-0c8ee84df712 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:14.963513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb10a12b-c19b-4de7-a813-0c8ee84df712 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:14.963935 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb10a12b-c19b-4de7-a813-0c8ee84df712 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:15.110332 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fb10a12b-c19b-4de7-a813-0c8ee84df712 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:15.118056 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fb10a12b-c19b-4de7-a813-0c8ee84df712 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1362 microversion: 2.1 time: 0.169397 Jun 02 19:36:15.118619 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1449/2911] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:14 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:16.137394 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9d1a5189-53d1-4bb0-8cc6-b02f2f0e748e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:16.138124 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9d1a5189-53d1-4bb0-8cc6-b02f2f0e748e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:16.146265 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d1a5189-53d1-4bb0-8cc6-b02f2f0e748e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:16.146811 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d1a5189-53d1-4bb0-8cc6-b02f2f0e748e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:16.147710 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d1a5189-53d1-4bb0-8cc6-b02f2f0e748e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:16.148228 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d1a5189-53d1-4bb0-8cc6-b02f2f0e748e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:16.295422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9d1a5189-53d1-4bb0-8cc6-b02f2f0e748e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:16.304557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9d1a5189-53d1-4bb0-8cc6-b02f2f0e748e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1362 microversion: 2.1 time: 0.171900 Jun 02 19:36:16.305423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1463/2912] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:16 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:16.512837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-d1b19012-8d6e-4a6f-a2c0-bddf52e662ac req-de2e2a57-1d60-4aad-ad6b-00a26cfa80da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d47d4c-7e0a-4ff5-b560-557ef9c7493e", "name": "network-vif-plugged", "status": "completed", "tag": "7f72f3b1-8fa8-44f3-a759-0f39264573fc"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:36:16.521025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-d1b19012-8d6e-4a6f-a2c0-bddf52e662ac req-de2e2a57-1d60-4aad-ad6b-00a26cfa80da service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:16.521479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-d1b19012-8d6e-4a6f-a2c0-bddf52e662ac req-de2e2a57-1d60-4aad-ad6b-00a26cfa80da service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:16.532930 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-d1b19012-8d6e-4a6f-a2c0-bddf52e662ac req-de2e2a57-1d60-4aad-ad6b-00a26cfa80da service nova] Creating event network-vif-plugged:7f72f3b1-8fa8-44f3-a759-0f39264573fc for instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e on hv-cinder-79760 Jun 02 19:36:16.538197 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-d1b19012-8d6e-4a6f-a2c0-bddf52e662ac req-de2e2a57-1d60-4aad-ad6b-00a26cfa80da service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158753 Jun 02 19:36:16.538864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1450/2913] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:36:17.325687 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0f9c191d-7850-4bda-9d1c-e7bfea2436b8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:17.326733 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0f9c191d-7850-4bda-9d1c-e7bfea2436b8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:17.337319 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f9c191d-7850-4bda-9d1c-e7bfea2436b8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:17.338007 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f9c191d-7850-4bda-9d1c-e7bfea2436b8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:17.339185 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f9c191d-7850-4bda-9d1c-e7bfea2436b8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:17.339787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0f9c191d-7850-4bda-9d1c-e7bfea2436b8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:17.479426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0f9c191d-7850-4bda-9d1c-e7bfea2436b8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:17.487060 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0f9c191d-7850-4bda-9d1c-e7bfea2436b8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1362 microversion: 2.1 time: 0.167975 Jun 02 19:36:17.487619 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1464/2914] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:17 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:18.503753 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:18.504643 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:18.511617 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-757249ee-f862-4493-8909-686be3b59731 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:18.512674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-757249ee-f862-4493-8909-686be3b59731 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:18.523123 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-757249ee-f862-4493-8909-686be3b59731 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:18.523665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-757249ee-f862-4493-8909-686be3b59731 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:18.524874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-757249ee-f862-4493-8909-686be3b59731 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:18.524874 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-757249ee-f862-4493-8909-686be3b59731 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:18.666608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-757249ee-f862-4493-8909-686be3b59731 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:36:18.674746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-757249ee-f862-4493-8909-686be3b59731 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1549 microversion: 2.1 time: 0.173630 Jun 02 19:36:18.675304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1451/2915] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:36:18 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:36:18.691899 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d30179e3-bbc0-4cd7-9280-57653d907b5f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:36:18.692466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d30179e3-bbc0-4cd7-9280-57653d907b5f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:36:18.694352 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:18.700805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d30179e3-bbc0-4cd7-9280-57653d907b5f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:18.701262 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d30179e3-bbc0-4cd7-9280-57653d907b5f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:18.702062 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d30179e3-bbc0-4cd7-9280-57653d907b5f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:18.702506 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d30179e3-bbc0-4cd7-9280-57653d907b5f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:18.788965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d30179e3-bbc0-4cd7-9280-57653d907b5f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100862 Jun 02 19:36:18.789598 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1465/2916] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Jun 2 19:36:18 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:36:19.799111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-041344ca-a53b-4af1-9736-e70ee18b1e5f req-73908d3c-aa8a-48aa-996c-d7a97a7e31dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d47d4c-7e0a-4ff5-b560-557ef9c7493e", "tag": "7f72f3b1-8fa8-44f3-a759-0f39264573fc"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:36:19.807385 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-041344ca-a53b-4af1-9736-e70ee18b1e5f req-73908d3c-aa8a-48aa-996c-d7a97a7e31dc service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:19.808025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-041344ca-a53b-4af1-9736-e70ee18b1e5f req-73908d3c-aa8a-48aa-996c-d7a97a7e31dc service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:19.819000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-041344ca-a53b-4af1-9736-e70ee18b1e5f req-73908d3c-aa8a-48aa-996c-d7a97a7e31dc service nova] Creating event network-changed:7f72f3b1-8fa8-44f3-a759-0f39264573fc for instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e on hv-cinder-79760 Jun 02 19:36:19.824476 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-041344ca-a53b-4af1-9736-e70ee18b1e5f req-73908d3c-aa8a-48aa-996c-d7a97a7e31dc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085046 Jun 02 19:36:19.825140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1452/2917] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:36:25.510615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:36:25.511177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:36:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:36:43.373202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-76bf1df7-6ebe-4687-bf09-fe4149b795fa req-7134b683-70f9-479a-836a-9e1a337259e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423ad810-dacf-4ac6-9fa1-68964373fa1a", "name": "network-vif-deleted", "tag": "f7d313b1-4be3-4e8e-b816-59916cddd268"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:36:43.384469 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:43.385389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=34 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:43.388587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-76bf1df7-6ebe-4687-bf09-fe4149b795fa req-7134b683-70f9-479a-836a-9e1a337259e9 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:36:43.389219 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-76bf1df7-6ebe-4687-bf09-fe4149b795fa req-7134b683-70f9-479a-836a-9e1a337259e9 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:36:43.406048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-76bf1df7-6ebe-4687-bf09-fe4149b795fa req-7134b683-70f9-479a-836a-9e1a337259e9 service nova] Creating event network-vif-deleted:f7d313b1-4be3-4e8e-b816-59916cddd268 for instance 423ad810-dacf-4ac6-9fa1-68964373fa1a on hv-cinder-79760 Jun 02 19:36:43.412198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-76bf1df7-6ebe-4687-bf09-fe4149b795fa req-7134b683-70f9-479a-836a-9e1a337259e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043170 Jun 02 19:36:43.412867 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1466/2918] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:37:03.485280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9edf5361-208d-4e41-9ba6-8bcff521dbe9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:03.486454 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9edf5361-208d-4e41-9ba6-8bcff521dbe9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:03.489444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:03.490243 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=32 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:03.496050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9edf5361-208d-4e41-9ba6-8bcff521dbe9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:03.496477 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9edf5361-208d-4e41-9ba6-8bcff521dbe9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:03.497775 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9edf5361-208d-4e41-9ba6-8bcff521dbe9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:03.498134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9edf5361-208d-4e41-9ba6-8bcff521dbe9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:03.524762 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9edf5361-208d-4e41-9ba6-8bcff521dbe9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/ips" status: 200 len: 147 microversion: 2.1 time: 0.043655 Jun 02 19:37:03.525489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1453/2919] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:37:03 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:37:05.671665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:05.676731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-957daef7-c44a-4467-a5fb-211cac21ec2e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7b72877-98e9-454b-a3de-39a36f655fe6"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:37:05.677878 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-957daef7-c44a-4467-a5fb-211cac21ec2e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:05.685008 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-957daef7-c44a-4467-a5fb-211cac21ec2e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:05.685481 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-957daef7-c44a-4467-a5fb-211cac21ec2e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:05.686275 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-957daef7-c44a-4467-a5fb-211cac21ec2e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:05.686704 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-957daef7-c44a-4467-a5fb-211cac21ec2e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:05.965568 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-957daef7-c44a-4467-a5fb-211cac21ec2e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295289 Jun 02 19:37:05.966383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1467/2920] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:37:05 2022] POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:37:13.532943 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f22173d1-d701-41e8-ac4d-5fa2a31deebb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:37:13.536912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:13.537608 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:13.541823 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f22173d1-d701-41e8-ac4d-5fa2a31deebb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:13.542407 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f22173d1-d701-41e8-ac4d-5fa2a31deebb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:13.614177 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f22173d1-d701-41e8-ac4d-5fa2a31deebb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Going to try to stop instance {{(pid=117777) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 19:37:13.673300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f22173d1-d701-41e8-ac4d-5fa2a31deebb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/action" status: 202 len: 0 microversion: 2.1 time: 0.145034 Jun 02 19:37:13.674511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1454/2921] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:37:13 2022] POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:37:13.684826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cee7b1ee-193e-48b5-92a9-b7ae1d489b08 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:13.686470 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cee7b1ee-193e-48b5-92a9-b7ae1d489b08 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:13.693880 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cee7b1ee-193e-48b5-92a9-b7ae1d489b08 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:13.694595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cee7b1ee-193e-48b5-92a9-b7ae1d489b08 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:13.695575 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cee7b1ee-193e-48b5-92a9-b7ae1d489b08 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:13.696126 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cee7b1ee-193e-48b5-92a9-b7ae1d489b08 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:13.865460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cee7b1ee-193e-48b5-92a9-b7ae1d489b08 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:13.873941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cee7b1ee-193e-48b5-92a9-b7ae1d489b08 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.193147 Jun 02 19:37:13.874652 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1468/2922] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:13 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:14.892449 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-434de37d-6c00-4e00-aee9-5217073bf5d1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:14.893493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-434de37d-6c00-4e00-aee9-5217073bf5d1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:14.905536 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-434de37d-6c00-4e00-aee9-5217073bf5d1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:14.906025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-434de37d-6c00-4e00-aee9-5217073bf5d1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:14.906809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-434de37d-6c00-4e00-aee9-5217073bf5d1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:14.907244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-434de37d-6c00-4e00-aee9-5217073bf5d1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:15.048351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-434de37d-6c00-4e00-aee9-5217073bf5d1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:15.060953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-434de37d-6c00-4e00-aee9-5217073bf5d1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.172792 Jun 02 19:37:15.061907 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1455/2923] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:14 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:16.083030 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-80e8f779-1b35-4b37-8f3a-13e177bf57b2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:16.083524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-80e8f779-1b35-4b37-8f3a-13e177bf57b2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:16.090736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80e8f779-1b35-4b37-8f3a-13e177bf57b2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:16.091056 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80e8f779-1b35-4b37-8f3a-13e177bf57b2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:16.091836 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80e8f779-1b35-4b37-8f3a-13e177bf57b2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:16.092281 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-80e8f779-1b35-4b37-8f3a-13e177bf57b2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:16.241711 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-80e8f779-1b35-4b37-8f3a-13e177bf57b2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:16.253231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-80e8f779-1b35-4b37-8f3a-13e177bf57b2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.173939 Jun 02 19:37:16.253786 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1469/2924] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:16 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:17.273466 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5d154852-3759-4c3d-b5ca-26acaea10ca3 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:17.274341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5d154852-3759-4c3d-b5ca-26acaea10ca3 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:17.283067 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d154852-3759-4c3d-b5ca-26acaea10ca3 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:17.283656 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d154852-3759-4c3d-b5ca-26acaea10ca3 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:17.284654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d154852-3759-4c3d-b5ca-26acaea10ca3 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:17.285223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d154852-3759-4c3d-b5ca-26acaea10ca3 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:17.433972 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5d154852-3759-4c3d-b5ca-26acaea10ca3 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:17.442140 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5d154852-3759-4c3d-b5ca-26acaea10ca3 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.173908 Jun 02 19:37:17.442706 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1456/2925] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:17 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:18.459762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cd6b9f6e-701c-4120-9d66-39f1c77f5523 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:18.460399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cd6b9f6e-701c-4120-9d66-39f1c77f5523 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:18.467140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd6b9f6e-701c-4120-9d66-39f1c77f5523 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:18.467590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd6b9f6e-701c-4120-9d66-39f1c77f5523 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:18.468347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd6b9f6e-701c-4120-9d66-39f1c77f5523 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:18.468779 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd6b9f6e-701c-4120-9d66-39f1c77f5523 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:18.612440 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cd6b9f6e-701c-4120-9d66-39f1c77f5523 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:18.621496 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cd6b9f6e-701c-4120-9d66-39f1c77f5523 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.165482 Jun 02 19:37:18.622131 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1470/2926] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:18 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:19.638459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cc77536a-0c6f-4529-bee6-52b2154db94a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:19.639018 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cc77536a-0c6f-4529-bee6-52b2154db94a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:19.646209 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc77536a-0c6f-4529-bee6-52b2154db94a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:19.646665 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc77536a-0c6f-4529-bee6-52b2154db94a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:19.647513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc77536a-0c6f-4529-bee6-52b2154db94a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:19.647974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cc77536a-0c6f-4529-bee6-52b2154db94a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:19.786809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cc77536a-0c6f-4529-bee6-52b2154db94a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:19.795065 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cc77536a-0c6f-4529-bee6-52b2154db94a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.160551 Jun 02 19:37:19.795546 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1457/2927] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:19 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:20.813252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9f1cb423-3cce-4429-8ce9-10666a00daf1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:20.814064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9f1cb423-3cce-4429-8ce9-10666a00daf1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:20.820788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f1cb423-3cce-4429-8ce9-10666a00daf1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:20.821350 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f1cb423-3cce-4429-8ce9-10666a00daf1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:20.822248 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f1cb423-3cce-4429-8ce9-10666a00daf1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:20.822757 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f1cb423-3cce-4429-8ce9-10666a00daf1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:20.955865 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9f1cb423-3cce-4429-8ce9-10666a00daf1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:20.964427 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9f1cb423-3cce-4429-8ce9-10666a00daf1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.155084 Jun 02 19:37:20.965084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1471/2928] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:20 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:21.982491 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-95754bd7-a8db-4fd5-9460-36e2331c84ee tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:21.983215 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-95754bd7-a8db-4fd5-9460-36e2331c84ee tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:21.989668 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95754bd7-a8db-4fd5-9460-36e2331c84ee tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:21.990159 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95754bd7-a8db-4fd5-9460-36e2331c84ee tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:21.990921 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95754bd7-a8db-4fd5-9460-36e2331c84ee tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:21.991350 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95754bd7-a8db-4fd5-9460-36e2331c84ee tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:22.122609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-95754bd7-a8db-4fd5-9460-36e2331c84ee tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:22.131747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-95754bd7-a8db-4fd5-9460-36e2331c84ee tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.153404 Jun 02 19:37:22.132319 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1458/2929] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:21 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:23.153588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4181d8aa-bca5-44ce-81a7-74aa9ae7a355 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:23.154659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4181d8aa-bca5-44ce-81a7-74aa9ae7a355 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:23.165761 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4181d8aa-bca5-44ce-81a7-74aa9ae7a355 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:23.166562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4181d8aa-bca5-44ce-81a7-74aa9ae7a355 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:23.167838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4181d8aa-bca5-44ce-81a7-74aa9ae7a355 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:23.168563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4181d8aa-bca5-44ce-81a7-74aa9ae7a355 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:23.316935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4181d8aa-bca5-44ce-81a7-74aa9ae7a355 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:23.330648 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4181d8aa-bca5-44ce-81a7-74aa9ae7a355 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.182838 Jun 02 19:37:23.331321 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1472/2930] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:23 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:24.355806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-732adb00-4d60-4e10-ba05-df2b92e35924 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:24.356508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-732adb00-4d60-4e10-ba05-df2b92e35924 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:24.366858 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-732adb00-4d60-4e10-ba05-df2b92e35924 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:24.367493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-732adb00-4d60-4e10-ba05-df2b92e35924 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:24.368596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-732adb00-4d60-4e10-ba05-df2b92e35924 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:24.369127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-732adb00-4d60-4e10-ba05-df2b92e35924 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:24.516444 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-732adb00-4d60-4e10-ba05-df2b92e35924 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:24.525512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-732adb00-4d60-4e10-ba05-df2b92e35924 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.175959 Jun 02 19:37:24.526129 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1459/2931] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:24 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:25.543310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a29b5687-25e2-435c-a5f5-6845a5966c97 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:25.543924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a29b5687-25e2-435c-a5f5-6845a5966c97 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:25.551494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a29b5687-25e2-435c-a5f5-6845a5966c97 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:25.551939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a29b5687-25e2-435c-a5f5-6845a5966c97 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:25.552692 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a29b5687-25e2-435c-a5f5-6845a5966c97 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:25.553130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a29b5687-25e2-435c-a5f5-6845a5966c97 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:25.704903 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a29b5687-25e2-435c-a5f5-6845a5966c97 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:25.718090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a29b5687-25e2-435c-a5f5-6845a5966c97 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.178315 Jun 02 19:37:25.718860 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1473/2932] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:25 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:26.740190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-81ce71f4-5c2b-4f41-b1f5-d902e97d59ed tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:26.740772 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-81ce71f4-5c2b-4f41-b1f5-d902e97d59ed tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:26.747845 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ce71f4-5c2b-4f41-b1f5-d902e97d59ed tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:26.748298 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ce71f4-5c2b-4f41-b1f5-d902e97d59ed tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:26.749059 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ce71f4-5c2b-4f41-b1f5-d902e97d59ed tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:26.749495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-81ce71f4-5c2b-4f41-b1f5-d902e97d59ed tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:26.890202 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-81ce71f4-5c2b-4f41-b1f5-d902e97d59ed tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:26.899327 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-81ce71f4-5c2b-4f41-b1f5-d902e97d59ed tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.164957 Jun 02 19:37:26.899893 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1460/2933] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:26 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:27.920662 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57bf9d3f-254a-444d-a2b1-cea9723d2f4a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:27.921665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-57bf9d3f-254a-444d-a2b1-cea9723d2f4a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:27.933524 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57bf9d3f-254a-444d-a2b1-cea9723d2f4a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:27.934347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57bf9d3f-254a-444d-a2b1-cea9723d2f4a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:27.935615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57bf9d3f-254a-444d-a2b1-cea9723d2f4a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:27.936354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57bf9d3f-254a-444d-a2b1-cea9723d2f4a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:28.073283 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57bf9d3f-254a-444d-a2b1-cea9723d2f4a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:28.081982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-57bf9d3f-254a-444d-a2b1-cea9723d2f4a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1724 microversion: 2.1 time: 0.167877 Jun 02 19:37:28.082558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1474/2934] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:27 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:29.098987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-486510d6-94ca-4a8e-8b73-6bcdb2a6fcb2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:29.099868 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-486510d6-94ca-4a8e-8b73-6bcdb2a6fcb2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:29.106421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-486510d6-94ca-4a8e-8b73-6bcdb2a6fcb2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:29.106867 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-486510d6-94ca-4a8e-8b73-6bcdb2a6fcb2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:29.107601 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-486510d6-94ca-4a8e-8b73-6bcdb2a6fcb2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:29.108026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-486510d6-94ca-4a8e-8b73-6bcdb2a6fcb2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:29.257138 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-486510d6-94ca-4a8e-8b73-6bcdb2a6fcb2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:29.265236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-486510d6-94ca-4a8e-8b73-6bcdb2a6fcb2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1701 microversion: 2.1 time: 0.170499 Jun 02 19:37:29.265812 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1461/2935] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:29 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1701 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:29.286271 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0214ad85-b0a5-479f-b7e5-d587a79c1a4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:37:29.295663 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0214ad85-b0a5-479f-b7e5-d587a79c1a4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:29.296293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0214ad85-b0a5-479f-b7e5-d587a79c1a4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:29.368916 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0214ad85-b0a5-479f-b7e5-d587a79c1a4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Going to try to start instance {{(pid=117776) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 19:37:29.429367 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0214ad85-b0a5-479f-b7e5-d587a79c1a4c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/action" status: 202 len: 0 microversion: 2.1 time: 0.149254 Jun 02 19:37:29.430361 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1475/2936] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:37:29 2022] POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:37:29.438944 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7e64bd70-95ff-4473-b531-c14e8d1780c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:29.439553 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7e64bd70-95ff-4473-b531-c14e8d1780c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:29.447771 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e64bd70-95ff-4473-b531-c14e8d1780c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:29.448404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e64bd70-95ff-4473-b531-c14e8d1780c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:29.449322 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e64bd70-95ff-4473-b531-c14e8d1780c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:29.450001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7e64bd70-95ff-4473-b531-c14e8d1780c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:29.647577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7e64bd70-95ff-4473-b531-c14e8d1780c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:29.656420 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7e64bd70-95ff-4473-b531-c14e8d1780c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1710 microversion: 2.1 time: 0.221276 Jun 02 19:37:29.666213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1462/2937] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:29 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1710 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:30.675624 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ed717ab0-349f-42d7-9cae-bbd8110ae634 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:30.676304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ed717ab0-349f-42d7-9cae-bbd8110ae634 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:30.683055 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed717ab0-349f-42d7-9cae-bbd8110ae634 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:30.683519 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed717ab0-349f-42d7-9cae-bbd8110ae634 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:30.684289 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed717ab0-349f-42d7-9cae-bbd8110ae634 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:30.684723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed717ab0-349f-42d7-9cae-bbd8110ae634 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:30.837356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ed717ab0-349f-42d7-9cae-bbd8110ae634 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:30.846068 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ed717ab0-349f-42d7-9cae-bbd8110ae634 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1710 microversion: 2.1 time: 0.175531 Jun 02 19:37:30.846640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1476/2938] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:30 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:31.864111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c2667d1a-f7bc-4fea-9088-8c916fb95dd1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:37:31.865083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c2667d1a-f7bc-4fea-9088-8c916fb95dd1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:37:31.874632 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c2667d1a-f7bc-4fea-9088-8c916fb95dd1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:31.875495 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c2667d1a-f7bc-4fea-9088-8c916fb95dd1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:31.877597 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c2667d1a-f7bc-4fea-9088-8c916fb95dd1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:37:31.878857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c2667d1a-f7bc-4fea-9088-8c916fb95dd1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:37:32.042739 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c2667d1a-f7bc-4fea-9088-8c916fb95dd1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:37:32.053208 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c2667d1a-f7bc-4fea-9088-8c916fb95dd1 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1714 microversion: 2.1 time: 0.193321 Jun 02 19:37:32.054191 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1463/2939] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:37:31 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1714 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:37:44.918003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=22 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:44.918441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:45.116815 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2d2b74c8-18c9-4a9b-898e-1675e2673536 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Action: 'create', calling method: .version_select at 0x7f5b79893a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-832014537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItkieynazA1Ktw+b5FklxYEuC3UWtBxu1qF7MeRQssfp+dkRr5IlbYCmnMcNCnK/vE4gv8mMqcHFq4KsdpD7dUPQ0p5E1nmL/R16WyTBhkEon1u/JQZvHhD7e5DyBupHA=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:37:45.131282 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-2d2b74c8-18c9-4a9b-898e-1675e2673536 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Getting quotas for project 7d83706590a34c76b0315e6a5e0ee931. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:37:45.137434 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-2d2b74c8-18c9-4a9b-898e-1675e2673536 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Getting quotas for user 5f92f1059a8b481aa5d44ebac5a7819d and project 7d83706590a34c76b0315e6a5e0ee931. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:37:45.161756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2d2b74c8-18c9-4a9b-898e-1675e2673536 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.253575 Jun 02 19:37:45.166100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1477/2940] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:37:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:38:01.487303 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1067522732", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-832014537", "security_groups": [{"name": "tempest-secgroup-smoke-143591275"}], "networks": [{"uuid": "c7fe29e9-9a6b-451e-a563-b04fa51ae57f"}], "block_device_mapping_v2": [{"uuid": "f5c4967a-f85e-49bf-a6d4-b71547909c27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:01.495892 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=20 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:01.496541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:01.604544 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] validate_networks() for [('c7fe29e9-9a6b-451e-a563-b04fa51ae57f', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:38:01.993709 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:38:01.994246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:38:01.994736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:38:01.995142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:38:01.995548 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:38:02.005938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:02.006358 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:02.007171 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:02.007599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:02.026539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Getting quotas for project 7d83706590a34c76b0315e6a5e0ee931. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:38:02.031214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Getting quotas for user 5f92f1059a8b481aa5d44ebac5a7819d and project 7d83706590a34c76b0315e6a5e0ee931. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:38:02.095291 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:38:02.097404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5c4967a-f85e-49bf-a6d4-b71547909c27',volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:38:02.252564 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-19422e2a-d8cf-4def-a394-b0fa6f5c219c tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769089 Jun 02 19:38:02.253104 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1464/2941] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:38:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:38:02.264356 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dc4df240-3751-4a2d-9b51-dd2b7b165a8d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:02.264937 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dc4df240-3751-4a2d-9b51-dd2b7b165a8d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:02.267022 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:02.267893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:02.327421 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dc4df240-3751-4a2d-9b51-dd2b7b165a8d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:02.334376 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dc4df240-3751-4a2d-9b51-dd2b7b165a8d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1088 microversion: 2.1 time: 0.074561 Jun 02 19:38:02.335143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1478/2942] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:02 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:03.352878 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a2f11006-d4b8-4703-b1a9-f47530982c08 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:03.353624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a2f11006-d4b8-4703-b1a9-f47530982c08 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:03.362397 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2f11006-d4b8-4703-b1a9-f47530982c08 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:03.362836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2f11006-d4b8-4703-b1a9-f47530982c08 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:03.363777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2f11006-d4b8-4703-b1a9-f47530982c08 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:03.364370 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2f11006-d4b8-4703-b1a9-f47530982c08 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:03.449145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a2f11006-d4b8-4703-b1a9-f47530982c08 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:03.457006 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a2f11006-d4b8-4703-b1a9-f47530982c08 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1204 microversion: 2.1 time: 0.109436 Jun 02 19:38:03.457646 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1465/2943] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:03 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1204 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:04.474911 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-047bccaf-4190-410d-83df-3176a4434554 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:04.475537 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-047bccaf-4190-410d-83df-3176a4434554 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:04.483094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-047bccaf-4190-410d-83df-3176a4434554 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:04.483548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-047bccaf-4190-410d-83df-3176a4434554 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:04.484535 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-047bccaf-4190-410d-83df-3176a4434554 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:04.485362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-047bccaf-4190-410d-83df-3176a4434554 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:04.673198 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-047bccaf-4190-410d-83df-3176a4434554 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:04.681965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-047bccaf-4190-410d-83df-3176a4434554 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.211125 Jun 02 19:38:04.682539 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1479/2944] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:04 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:38:04.998800 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-36fba1a6-d9a0-4355-b1e1-0e285c7f0fc6 req-4e78ec4d-1016-464a-b7ca-4b05deb345f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5018c4-4b2a-4ea0-b313-2d93a1caf897", "tag": "59e6acbd-667f-4a21-ba99-aaedcc060a5e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:05.011334 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-36fba1a6-d9a0-4355-b1e1-0e285c7f0fc6 req-4e78ec4d-1016-464a-b7ca-4b05deb345f7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:05.012135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-36fba1a6-d9a0-4355-b1e1-0e285c7f0fc6 req-4e78ec4d-1016-464a-b7ca-4b05deb345f7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:05.024580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-36fba1a6-d9a0-4355-b1e1-0e285c7f0fc6 req-4e78ec4d-1016-464a-b7ca-4b05deb345f7 service nova] Creating event network-changed:59e6acbd-667f-4a21-ba99-aaedcc060a5e for instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 on hv-cinder-79760 Jun 02 19:38:05.029585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-36fba1a6-d9a0-4355-b1e1-0e285c7f0fc6 req-4e78ec4d-1016-464a-b7ca-4b05deb345f7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034386 Jun 02 19:38:05.038137 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1466/2945] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:38:05.417528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cc0ee0bd-22ed-48f9-a574-091c5ceb6ad4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:05.418099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cc0ee0bd-22ed-48f9-a574-091c5ceb6ad4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:05.424929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0bd-22ed-48f9-a574-091c5ceb6ad4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:05.425382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0bd-22ed-48f9-a574-091c5ceb6ad4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:05.426186 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0bd-22ed-48f9-a574-091c5ceb6ad4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:05.426622 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0bd-22ed-48f9-a574-091c5ceb6ad4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:05.508560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-cc0ee0bd-22ed-48f9-a574-091c5ceb6ad4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lazy-loading 'services' on Instance uuid a8d47d4c-7e0a-4ff5-b560-557ef9c7493e {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:38:05.598413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cc0ee0bd-22ed-48f9-a574-091c5ceb6ad4 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/os-volume_attachments/e7b72877-98e9-454b-a3de-39a36f655fe6" status: 202 len: 0 microversion: 2.1 time: 0.184098 Jun 02 19:38:05.599195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1480/2946] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:38:05 2022] DELETE /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/os-volume_attachments/e7b72877-98e9-454b-a3de-39a36f655fe6 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:38:05.703894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-108725c2-73a6-444e-9a17-c11b46a79389 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:05.704580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-108725c2-73a6-444e-9a17-c11b46a79389 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:05.711446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-108725c2-73a6-444e-9a17-c11b46a79389 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:05.711891 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-108725c2-73a6-444e-9a17-c11b46a79389 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:05.712644 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-108725c2-73a6-444e-9a17-c11b46a79389 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:05.713072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-108725c2-73a6-444e-9a17-c11b46a79389 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:05.938975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-108725c2-73a6-444e-9a17-c11b46a79389 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:05.946773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-108725c2-73a6-444e-9a17-c11b46a79389 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.249565 Jun 02 19:38:05.947613 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1467/2947] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:05 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:06.728696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-73fd4058-380d-4022-8d98-5d935475f7b0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:06.739280 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73fd4058-380d-4022-8d98-5d935475f7b0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:06.739900 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73fd4058-380d-4022-8d98-5d935475f7b0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:06.766307 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-73fd4058-380d-4022-8d98-5d935475f7b0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Going to try to stop instance {{(pid=117776) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 19:38:06.815590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-73fd4058-380d-4022-8d98-5d935475f7b0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/action" status: 202 len: 0 microversion: 2.1 time: 0.093974 Jun 02 19:38:06.816620 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1481/2948] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:38:06 2022] POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:38:06.825976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5b30b73f-6312-49a6-903d-228e476576a9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:06.826750 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5b30b73f-6312-49a6-903d-228e476576a9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:06.833992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b30b73f-6312-49a6-903d-228e476576a9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:06.834499 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b30b73f-6312-49a6-903d-228e476576a9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:06.835326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b30b73f-6312-49a6-903d-228e476576a9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:06.835760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b30b73f-6312-49a6-903d-228e476576a9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:06.964805 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2aaa4866-a329-4646-a7b7-518665a039d0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:06.965587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2aaa4866-a329-4646-a7b7-518665a039d0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:06.971994 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5b30b73f-6312-49a6-903d-228e476576a9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:06.972716 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2aaa4866-a329-4646-a7b7-518665a039d0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:06.973167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2aaa4866-a329-4646-a7b7-518665a039d0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:06.973969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2aaa4866-a329-4646-a7b7-518665a039d0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:06.974400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2aaa4866-a329-4646-a7b7-518665a039d0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:06.980117 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5b30b73f-6312-49a6-903d-228e476576a9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.158658 Jun 02 19:38:06.980795 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1468/2949] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:06 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:38:07.128579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2aaa4866-a329-4646-a7b7-518665a039d0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:07.136777 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2aaa4866-a329-4646-a7b7-518665a039d0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.176448 Jun 02 19:38:07.137354 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1482/2950] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:06 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:08.002557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6d2b6a12-4f27-48ea-b0b2-49b0f5c9995b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:08.003504 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6d2b6a12-4f27-48ea-b0b2-49b0f5c9995b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:08.014830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d2b6a12-4f27-48ea-b0b2-49b0f5c9995b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:08.015579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d2b6a12-4f27-48ea-b0b2-49b0f5c9995b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:08.016830 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d2b6a12-4f27-48ea-b0b2-49b0f5c9995b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:08.018078 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6d2b6a12-4f27-48ea-b0b2-49b0f5c9995b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:08.154426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-40cf3c64-2682-4c3c-8d42-44f6909ec322 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:08.155040 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-40cf3c64-2682-4c3c-8d42-44f6909ec322 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:08.158195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6d2b6a12-4f27-48ea-b0b2-49b0f5c9995b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:08.161998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-40cf3c64-2682-4c3c-8d42-44f6909ec322 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:08.162453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-40cf3c64-2682-4c3c-8d42-44f6909ec322 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:08.163217 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-40cf3c64-2682-4c3c-8d42-44f6909ec322 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:08.163651 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-40cf3c64-2682-4c3c-8d42-44f6909ec322 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:08.165819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6d2b6a12-4f27-48ea-b0b2-49b0f5c9995b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.170462 Jun 02 19:38:08.166409 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1469/2951] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:07 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:08.311165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-40cf3c64-2682-4c3c-8d42-44f6909ec322 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:08.320625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-40cf3c64-2682-4c3c-8d42-44f6909ec322 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.170125 Jun 02 19:38:08.321170 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1483/2952] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:08 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:09.187626 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea23c3e5-c6cd-47b8-8e6b-ee49d5e1d8e0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:09.188629 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ea23c3e5-c6cd-47b8-8e6b-ee49d5e1d8e0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:09.199511 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea23c3e5-c6cd-47b8-8e6b-ee49d5e1d8e0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:09.200232 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea23c3e5-c6cd-47b8-8e6b-ee49d5e1d8e0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:09.201482 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea23c3e5-c6cd-47b8-8e6b-ee49d5e1d8e0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:09.202264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea23c3e5-c6cd-47b8-8e6b-ee49d5e1d8e0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:09.336850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-39c02b5b-998f-4905-910e-6d508e27cce5 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:09.337464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-39c02b5b-998f-4905-910e-6d508e27cce5 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:09.338091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ea23c3e5-c6cd-47b8-8e6b-ee49d5e1d8e0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:09.344036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39c02b5b-998f-4905-910e-6d508e27cce5 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:09.344511 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39c02b5b-998f-4905-910e-6d508e27cce5 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:09.345508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39c02b5b-998f-4905-910e-6d508e27cce5 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:09.346013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ea23c3e5-c6cd-47b8-8e6b-ee49d5e1d8e0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.164603 Jun 02 19:38:09.346136 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39c02b5b-998f-4905-910e-6d508e27cce5 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:09.347163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1470/2953] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:09 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:09.486790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-39c02b5b-998f-4905-910e-6d508e27cce5 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:09.494377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-39c02b5b-998f-4905-910e-6d508e27cce5 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.161561 Jun 02 19:38:09.494921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1484/2954] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:09 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:09.990464 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:38:09.990870 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:38:10.365383 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-67b7c4c5-445d-4e5a-9c8f-afe86d2015e5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:10.366246 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-67b7c4c5-445d-4e5a-9c8f-afe86d2015e5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:10.374687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67b7c4c5-445d-4e5a-9c8f-afe86d2015e5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:10.375242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67b7c4c5-445d-4e5a-9c8f-afe86d2015e5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:10.376170 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67b7c4c5-445d-4e5a-9c8f-afe86d2015e5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:10.376741 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67b7c4c5-445d-4e5a-9c8f-afe86d2015e5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:10.511573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f07f089f-732f-4829-9edd-485c89476ab7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:10.512235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f07f089f-732f-4829-9edd-485c89476ab7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:10.519712 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f07f089f-732f-4829-9edd-485c89476ab7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:10.520165 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f07f089f-732f-4829-9edd-485c89476ab7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:10.520561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67b7c4c5-445d-4e5a-9c8f-afe86d2015e5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:10.520915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f07f089f-732f-4829-9edd-485c89476ab7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:10.521370 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f07f089f-732f-4829-9edd-485c89476ab7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:10.528764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-67b7c4c5-445d-4e5a-9c8f-afe86d2015e5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.168511 Jun 02 19:38:10.529579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1471/2955] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:10 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:10.655762 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f07f089f-732f-4829-9edd-485c89476ab7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:10.665532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f07f089f-732f-4829-9edd-485c89476ab7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.157556 Jun 02 19:38:10.666438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1485/2956] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:10 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:11.550955 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9211e5ae-160e-4d0c-8e5c-f55d1fe7617c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:11.551573 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9211e5ae-160e-4d0c-8e5c-f55d1fe7617c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:11.558610 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9211e5ae-160e-4d0c-8e5c-f55d1fe7617c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:11.559060 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9211e5ae-160e-4d0c-8e5c-f55d1fe7617c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:11.559809 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9211e5ae-160e-4d0c-8e5c-f55d1fe7617c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:11.560235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9211e5ae-160e-4d0c-8e5c-f55d1fe7617c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:11.683382 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a700a167-dbb8-4495-b177-28b5413d3feb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:11.683939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a700a167-dbb8-4495-b177-28b5413d3feb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:11.691457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a700a167-dbb8-4495-b177-28b5413d3feb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:11.691979 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a700a167-dbb8-4495-b177-28b5413d3feb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:11.692772 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a700a167-dbb8-4495-b177-28b5413d3feb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:11.693210 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a700a167-dbb8-4495-b177-28b5413d3feb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:11.704850 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9211e5ae-160e-4d0c-8e5c-f55d1fe7617c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:11.713083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9211e5ae-160e-4d0c-8e5c-f55d1fe7617c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.168741 Jun 02 19:38:11.713648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1472/2957] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:11 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:11.835523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a700a167-dbb8-4495-b177-28b5413d3feb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:11.847806 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a700a167-dbb8-4495-b177-28b5413d3feb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.168394 Jun 02 19:38:11.848377 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1486/2958] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:11 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:12.735121 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d79a2b2e-9bbb-4c33-a6dc-591db9016170 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:12.736162 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d79a2b2e-9bbb-4c33-a6dc-591db9016170 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:12.740031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:12.741111 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:12.751577 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d79a2b2e-9bbb-4c33-a6dc-591db9016170 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:12.752326 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d79a2b2e-9bbb-4c33-a6dc-591db9016170 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:12.753637 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d79a2b2e-9bbb-4c33-a6dc-591db9016170 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:12.754562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d79a2b2e-9bbb-4c33-a6dc-591db9016170 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:12.864847 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-25963b6d-7768-4db1-86e3-b22f3ef36fc7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:12.865501 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-25963b6d-7768-4db1-86e3-b22f3ef36fc7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:12.867588 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:12.873701 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25963b6d-7768-4db1-86e3-b22f3ef36fc7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:12.874101 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25963b6d-7768-4db1-86e3-b22f3ef36fc7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:12.874869 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25963b6d-7768-4db1-86e3-b22f3ef36fc7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:12.875301 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-25963b6d-7768-4db1-86e3-b22f3ef36fc7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:12.898580 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d79a2b2e-9bbb-4c33-a6dc-591db9016170 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:12.906251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d79a2b2e-9bbb-4c33-a6dc-591db9016170 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.177870 Jun 02 19:38:12.907011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1473/2959] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:12 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:13.011853 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-25963b6d-7768-4db1-86e3-b22f3ef36fc7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:13.022668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-25963b6d-7768-4db1-86e3-b22f3ef36fc7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.161966 Jun 02 19:38:13.023240 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1487/2960] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:12 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:13.924108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d4ae569-1bf0-490b-8af8-ba7bcf25cbb0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:13.925050 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9d4ae569-1bf0-490b-8af8-ba7bcf25cbb0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:13.932229 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d4ae569-1bf0-490b-8af8-ba7bcf25cbb0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:13.932681 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d4ae569-1bf0-490b-8af8-ba7bcf25cbb0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:13.933440 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d4ae569-1bf0-490b-8af8-ba7bcf25cbb0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:13.934001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d4ae569-1bf0-490b-8af8-ba7bcf25cbb0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:14.039831 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15e224ea-c079-40de-a132-e552744411a0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:14.040658 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-15e224ea-c079-40de-a132-e552744411a0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:14.048310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e224ea-c079-40de-a132-e552744411a0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:14.049033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e224ea-c079-40de-a132-e552744411a0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:14.050320 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e224ea-c079-40de-a132-e552744411a0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:14.050758 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15e224ea-c079-40de-a132-e552744411a0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:14.069130 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9d4ae569-1bf0-490b-8af8-ba7bcf25cbb0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:14.077275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9d4ae569-1bf0-490b-8af8-ba7bcf25cbb0 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.157041 Jun 02 19:38:14.077873 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1474/2961] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:13 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:14.199460 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-15e224ea-c079-40de-a132-e552744411a0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:14.207108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15e224ea-c079-40de-a132-e552744411a0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.171183 Jun 02 19:38:14.207714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1488/2962] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:14 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:15.099835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ba2f6bc0-282a-4ecd-887f-bb1b7dd4e91a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:15.100813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ba2f6bc0-282a-4ecd-887f-bb1b7dd4e91a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:15.111676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ba2f6bc0-282a-4ecd-887f-bb1b7dd4e91a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:15.112421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ba2f6bc0-282a-4ecd-887f-bb1b7dd4e91a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:15.113672 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ba2f6bc0-282a-4ecd-887f-bb1b7dd4e91a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:15.114455 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ba2f6bc0-282a-4ecd-887f-bb1b7dd4e91a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:15.224194 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-abe9b96c-a497-49ff-b7b9-be002d600948 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:15.224941 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-abe9b96c-a497-49ff-b7b9-be002d600948 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:15.232308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-abe9b96c-a497-49ff-b7b9-be002d600948 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:15.232844 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-abe9b96c-a497-49ff-b7b9-be002d600948 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:15.233637 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-abe9b96c-a497-49ff-b7b9-be002d600948 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:15.234109 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-abe9b96c-a497-49ff-b7b9-be002d600948 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:15.259446 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ba2f6bc0-282a-4ecd-887f-bb1b7dd4e91a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:15.267399 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ba2f6bc0-282a-4ecd-887f-bb1b7dd4e91a tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.174186 Jun 02 19:38:15.267974 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1475/2963] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:15 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:15.373431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-abe9b96c-a497-49ff-b7b9-be002d600948 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:15.381579 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-abe9b96c-a497-49ff-b7b9-be002d600948 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.160896 Jun 02 19:38:15.382192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1489/2964] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:15 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:15.763889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-491e24b3-87de-4b60-940d-9cb84651c666 req-b74c6948-778d-4387-af9b-723d6b6d9442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5018c4-4b2a-4ea0-b313-2d93a1caf897", "name": "network-vif-plugged", "status": "completed", "tag": "59e6acbd-667f-4a21-ba99-aaedcc060a5e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:15.772392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-491e24b3-87de-4b60-940d-9cb84651c666 req-b74c6948-778d-4387-af9b-723d6b6d9442 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:15.772814 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-491e24b3-87de-4b60-940d-9cb84651c666 req-b74c6948-778d-4387-af9b-723d6b6d9442 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:15.784142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-491e24b3-87de-4b60-940d-9cb84651c666 req-b74c6948-778d-4387-af9b-723d6b6d9442 service nova] Creating event network-vif-plugged:59e6acbd-667f-4a21-ba99-aaedcc060a5e for instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 on hv-cinder-79760 Jun 02 19:38:15.789473 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-491e24b3-87de-4b60-940d-9cb84651c666 req-b74c6948-778d-4387-af9b-723d6b6d9442 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029479 Jun 02 19:38:15.790115 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1476/2965] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:38:16.286285 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-66fcf4b9-4974-42dd-86d2-198e3cff86d8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:16.287264 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-66fcf4b9-4974-42dd-86d2-198e3cff86d8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:16.294290 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66fcf4b9-4974-42dd-86d2-198e3cff86d8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:16.294742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66fcf4b9-4974-42dd-86d2-198e3cff86d8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:16.296244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66fcf4b9-4974-42dd-86d2-198e3cff86d8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:16.296736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66fcf4b9-4974-42dd-86d2-198e3cff86d8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:16.405062 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3dbeebde-fef5-4a08-8ced-b9a138f124ca tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:16.405760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3dbeebde-fef5-4a08-8ced-b9a138f124ca tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:16.412618 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3dbeebde-fef5-4a08-8ced-b9a138f124ca tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:16.414058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3dbeebde-fef5-4a08-8ced-b9a138f124ca tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:16.414270 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3dbeebde-fef5-4a08-8ced-b9a138f124ca tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:16.414570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3dbeebde-fef5-4a08-8ced-b9a138f124ca tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:16.432072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-66fcf4b9-4974-42dd-86d2-198e3cff86d8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:16.440260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-66fcf4b9-4974-42dd-86d2-198e3cff86d8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1678 microversion: 2.1 time: 0.159150 Jun 02 19:38:16.440838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1490/2966] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:16 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:16.552047 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3dbeebde-fef5-4a08-8ced-b9a138f124ca tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:16.560622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3dbeebde-fef5-4a08-8ced-b9a138f124ca tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1259 microversion: 2.1 time: 0.160327 Jun 02 19:38:16.561194 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1477/2967] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:16 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:17.460192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bbcafc06-d21b-4193-9a6c-27a154103b87 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:17.460826 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bbcafc06-d21b-4193-9a6c-27a154103b87 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:17.467935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbcafc06-d21b-4193-9a6c-27a154103b87 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.468395 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbcafc06-d21b-4193-9a6c-27a154103b87 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:17.469167 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbcafc06-d21b-4193-9a6c-27a154103b87 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.469617 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bbcafc06-d21b-4193-9a6c-27a154103b87 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:17.578042 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-15bab248-3bca-4c34-8321-84505d0cb99a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:17.578745 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-15bab248-3bca-4c34-8321-84505d0cb99a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:17.585916 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15bab248-3bca-4c34-8321-84505d0cb99a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.586352 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15bab248-3bca-4c34-8321-84505d0cb99a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:17.587145 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15bab248-3bca-4c34-8321-84505d0cb99a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.587654 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-15bab248-3bca-4c34-8321-84505d0cb99a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:17.626790 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bbcafc06-d21b-4193-9a6c-27a154103b87 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:17.635435 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bbcafc06-d21b-4193-9a6c-27a154103b87 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1655 microversion: 2.1 time: 0.181389 Jun 02 19:38:17.636252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1491/2968] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:17 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1655 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:17.651964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bc09f78d-088f-4bc2-8202-9aecf938b120 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:17.658243 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc09f78d-088f-4bc2-8202-9aecf938b120 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.658731 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc09f78d-088f-4bc2-8202-9aecf938b120 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:17.681467 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bc09f78d-088f-4bc2-8202-9aecf938b120 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Going to try to start instance {{(pid=117776) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 19:38:17.716655 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:17.728017 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bc09f78d-088f-4bc2-8202-9aecf938b120 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/action" status: 202 len: 0 microversion: 2.1 time: 0.079747 Jun 02 19:38:17.728626 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1492/2969] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:38:17 2022] POST /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 19:38:17.734761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-15bab248-3bca-4c34-8321-84505d0cb99a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:17.739127 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6c61f8c6-bd87-47aa-a24d-5d7fd218a1f7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:17.739912 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6c61f8c6-bd87-47aa-a24d-5d7fd218a1f7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:17.743238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-15bab248-3bca-4c34-8321-84505d0cb99a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1443 microversion: 2.1 time: 0.169236 Jun 02 19:38:17.743838 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1478/2970] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:17 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:17.748696 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c61f8c6-bd87-47aa-a24d-5d7fd218a1f7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.749157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c61f8c6-bd87-47aa-a24d-5d7fd218a1f7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:17.750311 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c61f8c6-bd87-47aa-a24d-5d7fd218a1f7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.750752 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c61f8c6-bd87-47aa-a24d-5d7fd218a1f7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:17.759541 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f287a591-ce49-4050-aa4c-f01622912fb0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:17.760154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f287a591-ce49-4050-aa4c-f01622912fb0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:17.766299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f287a591-ce49-4050-aa4c-f01622912fb0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.766746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f287a591-ce49-4050-aa4c-f01622912fb0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:17.767505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f287a591-ce49-4050-aa4c-f01622912fb0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:17.767931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f287a591-ce49-4050-aa4c-f01622912fb0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:18.042607 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c61f8c6-bd87-47aa-a24d-5d7fd218a1f7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:18.050891 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6c61f8c6-bd87-47aa-a24d-5d7fd218a1f7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1664 microversion: 2.1 time: 0.315731 Jun 02 19:38:18.051479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1493/2971] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:17 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1664 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:18.066683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f287a591-ce49-4050-aa4c-f01622912fb0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:18.074836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f287a591-ce49-4050-aa4c-f01622912fb0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1443 microversion: 2.1 time: 0.319261 Jun 02 19:38:18.075405 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1479/2972] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:17 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1443 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:38:19.069558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b1119510-d6ea-4aa4-b080-1a20ce490a4f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:19.070312 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b1119510-d6ea-4aa4-b080-1a20ce490a4f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:19.078383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b1119510-d6ea-4aa4-b080-1a20ce490a4f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:19.078832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b1119510-d6ea-4aa4-b080-1a20ce490a4f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:19.079615 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b1119510-d6ea-4aa4-b080-1a20ce490a4f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:19.080049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b1119510-d6ea-4aa4-b080-1a20ce490a4f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:19.222080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b1119510-d6ea-4aa4-b080-1a20ce490a4f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:19.231821 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b1119510-d6ea-4aa4-b080-1a20ce490a4f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1664 microversion: 2.1 time: 0.165929 Jun 02 19:38:19.233071 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1494/2973] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:19 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:20.160092 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-181fef85-39ff-4065-9954-ce0ab89d4ef5 req-a3608053-86fd-4e49-b5bc-a2f5c77e8533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5018c4-4b2a-4ea0-b313-2d93a1caf897", "tag": "59e6acbd-667f-4a21-ba99-aaedcc060a5e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:20.170045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-181fef85-39ff-4065-9954-ce0ab89d4ef5 req-a3608053-86fd-4e49-b5bc-a2f5c77e8533 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:20.170520 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-181fef85-39ff-4065-9954-ce0ab89d4ef5 req-a3608053-86fd-4e49-b5bc-a2f5c77e8533 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:20.183174 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-181fef85-39ff-4065-9954-ce0ab89d4ef5 req-a3608053-86fd-4e49-b5bc-a2f5c77e8533 service nova] Creating event network-changed:59e6acbd-667f-4a21-ba99-aaedcc060a5e for instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 on hv-cinder-79760 Jun 02 19:38:20.188415 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-181fef85-39ff-4065-9954-ce0ab89d4ef5 req-a3608053-86fd-4e49-b5bc-a2f5c77e8533 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Jun 02 19:38:20.189192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1480/2974] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:38:20.251160 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e323263d-3cdc-4234-a161-b09cdf0df037 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:20.251759 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e323263d-3cdc-4234-a161-b09cdf0df037 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:20.259245 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e323263d-3cdc-4234-a161-b09cdf0df037 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:20.259718 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e323263d-3cdc-4234-a161-b09cdf0df037 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:20.260507 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e323263d-3cdc-4234-a161-b09cdf0df037 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:20.260946 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e323263d-3cdc-4234-a161-b09cdf0df037 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:20.473138 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e323263d-3cdc-4234-a161-b09cdf0df037 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:20.481785 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e323263d-3cdc-4234-a161-b09cdf0df037 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1668 microversion: 2.1 time: 0.234800 Jun 02 19:38:20.482698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1495/2975] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:20 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1668 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:53.281465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:53.282247 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=86 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:53.286989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cd7d3bcd-b77e-48dc-9a1a-0595810d5c0b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:53.288007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cd7d3bcd-b77e-48dc-9a1a-0595810d5c0b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:53.296080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd7d3bcd-b77e-48dc-9a1a-0595810d5c0b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:53.296522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd7d3bcd-b77e-48dc-9a1a-0595810d5c0b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:53.297283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd7d3bcd-b77e-48dc-9a1a-0595810d5c0b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:53.297721 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd7d3bcd-b77e-48dc-9a1a-0595810d5c0b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:53.328853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cd7d3bcd-b77e-48dc-9a1a-0595810d5c0b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049424 Jun 02 19:38:53.329404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1481/2976] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:38:53 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 19:38:53.395493 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dcd0c950-c8d6-4e8a-a93d-a860de84b35e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:53.396029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dcd0c950-c8d6-4e8a-a93d-a860de84b35e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:53.398500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=38 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:53.399177 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=18 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:53.405260 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcd0c950-c8d6-4e8a-a93d-a860de84b35e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:53.405714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcd0c950-c8d6-4e8a-a93d-a860de84b35e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:53.406508 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcd0c950-c8d6-4e8a-a93d-a860de84b35e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:53.406950 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcd0c950-c8d6-4e8a-a93d-a860de84b35e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:53.432422 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dcd0c950-c8d6-4e8a-a93d-a860de84b35e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:38:53.522544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dcd0c950-c8d6-4e8a-a93d-a860de84b35e tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 204 len: 0 microversion: 2.1 time: 0.130488 Jun 02 19:38:53.526191 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1496/2977] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:38:53 2022] DELETE /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:38:53.531525 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-72c7b6c7-3f0b-4544-b6c4-af416a8e183f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:53.532080 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-72c7b6c7-3f0b-4544-b6c4-af416a8e183f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:53.538901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72c7b6c7-3f0b-4544-b6c4-af416a8e183f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:53.539351 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72c7b6c7-3f0b-4544-b6c4-af416a8e183f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:53.540127 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72c7b6c7-3f0b-4544-b6c4-af416a8e183f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:53.540534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72c7b6c7-3f0b-4544-b6c4-af416a8e183f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:53.691195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-72c7b6c7-3f0b-4544-b6c4-af416a8e183f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:53.699223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-72c7b6c7-3f0b-4544-b6c4-af416a8e183f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1674 microversion: 2.1 time: 0.171622 Jun 02 19:38:53.700025 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1482/2978] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:53 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:54.721548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d19c1584-4fd7-46e6-b1bc-00cdbad58a93 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:54.722857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d19c1584-4fd7-46e6-b1bc-00cdbad58a93 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:54.733306 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d19c1584-4fd7-46e6-b1bc-00cdbad58a93 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:54.733770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d19c1584-4fd7-46e6-b1bc-00cdbad58a93 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:54.734572 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d19c1584-4fd7-46e6-b1bc-00cdbad58a93 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:54.735015 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d19c1584-4fd7-46e6-b1bc-00cdbad58a93 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:54.879410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d19c1584-4fd7-46e6-b1bc-00cdbad58a93 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:54.887410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d19c1584-4fd7-46e6-b1bc-00cdbad58a93 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1674 microversion: 2.1 time: 0.173189 Jun 02 19:38:54.887980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1497/2979] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:54 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:55.909773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c11de836-f905-41ee-a62d-03da61cce486 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:55.910513 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c11de836-f905-41ee-a62d-03da61cce486 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:55.917435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c11de836-f905-41ee-a62d-03da61cce486 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:55.917827 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c11de836-f905-41ee-a62d-03da61cce486 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:55.918596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c11de836-f905-41ee-a62d-03da61cce486 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:55.919027 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c11de836-f905-41ee-a62d-03da61cce486 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:56.101493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c11de836-f905-41ee-a62d-03da61cce486 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:38:56.109692 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c11de836-f905-41ee-a62d-03da61cce486 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 200 len: 1674 microversion: 2.1 time: 0.203760 Jun 02 19:38:56.110300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1483/2980] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:55 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:38:56.419250 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-b04140b6-7ed2-47d1-afaa-5e51773c3724 req-2b892a51-a054-4ab4-84c0-799929f8f441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d47d4c-7e0a-4ff5-b560-557ef9c7493e", "name": "network-vif-deleted", "tag": "7f72f3b1-8fa8-44f3-a759-0f39264573fc"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:56.432387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b04140b6-7ed2-47d1-afaa-5e51773c3724 req-2b892a51-a054-4ab4-84c0-799929f8f441 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:56.432834 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b04140b6-7ed2-47d1-afaa-5e51773c3724 req-2b892a51-a054-4ab4-84c0-799929f8f441 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:56.447369 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-b04140b6-7ed2-47d1-afaa-5e51773c3724 req-2b892a51-a054-4ab4-84c0-799929f8f441 service nova] Creating event network-vif-deleted:7f72f3b1-8fa8-44f3-a759-0f39264573fc for instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e on hv-cinder-79760 Jun 02 19:38:56.454043 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-b04140b6-7ed2-47d1-afaa-5e51773c3724 req-2b892a51-a054-4ab4-84c0-799929f8f441 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038739 Jun 02 19:38:56.454838 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1498/2981] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:38:57.128373 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:57.128987 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:38:57.135636 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:57.136366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:57.137120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:57.137512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:57.152813 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] HTTP exception thrown: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Request method failure captured: Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e HTTP/1.1 Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimREk1jo-3vj94oKuKLaQHYSGM30Tub7O2oJSAHhsHvrZUnO94fAB52FUb_jKoPF_MaM0M5503jiAp2cnHID8s9k8IGDM_CmQEtAEVzm3Saiwdvwaz61ct949Jz-PDjB5KLpx0s5ajZ-GDg2XeNzPZv69DxNdHqcGWzw3luxzMFig1vE Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:38:57.154528 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_119263b9683e44eba604fc24eca20061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/119263b9683e44eba604fc24eca20061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: d160ccef27104953beadc68e74b2d49e Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:38:57.156857 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': 'a8d47d4c-7e0a-4ff5-b560-557ef9c7493e'} Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:38:57.157966 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:38:57.159774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:38:57.161489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Returning 404 to user: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:38:57.161489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f31446db-ea89-41c6-92ab-c8b13fb26540 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 404 len: 111 microversion: 2.1 time: 0.031897 Jun 02 19:38:57.161489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1484/2982] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:57 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:38:57.166398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2a8b4ff4-05e2-4ba0-9f69-5693d7dc6e2b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '.version_select at 0x7f5b78d69310>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:57.186966 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2a8b4ff4-05e2-4ba0-9f69-5693d7dc6e2b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399839843" status: 202 len: 0 microversion: 2.1 time: 0.024580 Jun 02 19:38:57.187684 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1499/2983] 10.222.0.15 () {58 vars in 1217 bytes} [Thu Jun 2 19:38:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399839843 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:38:57.836764 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e5c9b5f0-8a15-4afb-85e8-51e9f7140aca tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'create', calling method: .version_select at 0x7f5b7e0a0c10>, body: {"keypair": {"name": "tempest-keypair-2011202980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi1lr7aSN7+5nsMkIr3BcMveL2o/GrRPdYQusIloApepN9ogIFvhHhZRE3+4wSEuoQgEptkVwRfo+XDVPp3y/94y4YeTFqqEfZ9RI14pHPQBQkCsKiP0iF4kYNeWfmX7A=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:57.851467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-e5c9b5f0-8a15-4afb-85e8-51e9f7140aca tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Getting quotas for project 119263b9683e44eba604fc24eca20061. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:38:57.855468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-e5c9b5f0-8a15-4afb-85e8-51e9f7140aca tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Getting quotas for user d160ccef27104953beadc68e74b2d49e and project 119263b9683e44eba604fc24eca20061. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:38:57.883904 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e5c9b5f0-8a15-4afb-85e8-51e9f7140aca tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051164 Jun 02 19:38:57.884480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1485/2984] 10.222.0.15 () {60 vars in 1158 bytes} [Thu Jun 2 19:38:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:38:59.300741 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1354522223", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2194255b-05f0-42dc-8cf5-100db25c9d89"}], "security_groups": [{"name": "tempest-securitygroup--1190701923"}], "key_name": "tempest-keypair-2011202980", "user_data": "}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:38:59.412293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] validate_networks() for [('2194255b-05f0-42dc-8cf5-100db25c9d89', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:38:59.853977 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:38:59.854398 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:38:59.854870 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:38:59.855276 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:38:59.855681 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:38:59.864756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:59.865207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:59.866038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:38:59.866476 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:38:59.883143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Getting quotas for project 119263b9683e44eba604fc24eca20061. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:38:59.887122 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Getting quotas for user d160ccef27104953beadc68e74b2d49e and project 119263b9683e44eba604fc24eca20061. Resources: {'cores', 'instances', 'ram'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:38:59.898075 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:38:59.900441 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:38:59.957366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0698b82f-58ce-4175-b304-1a17877d64d5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.661947 Jun 02 19:38:59.958063 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1500/2985] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:38:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:38:59.969154 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-19b82b7e-d068-4936-94f2-0e41467fec1b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:38:59.969760 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-19b82b7e-d068-4936-94f2-0e41467fec1b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:00.026773 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-19b82b7e-d068-4936-94f2-0e41467fec1b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:00.035421 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-19b82b7e-d068-4936-94f2-0e41467fec1b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1238 microversion: 2.1 time: 0.071050 Jun 02 19:39:00.035975 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1486/2986] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:38:59 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:01.053498 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-50259bb8-bde0-47f5-8a47-e0e0f02292bf tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:01.054152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-50259bb8-bde0-47f5-8a47-e0e0f02292bf tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:01.061224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-50259bb8-bde0-47f5-8a47-e0e0f02292bf tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:01.061691 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-50259bb8-bde0-47f5-8a47-e0e0f02292bf tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:01.063115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-50259bb8-bde0-47f5-8a47-e0e0f02292bf tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:01.063560 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-50259bb8-bde0-47f5-8a47-e0e0f02292bf tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:01.143562 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-50259bb8-bde0-47f5-8a47-e0e0f02292bf tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:01.151500 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-50259bb8-bde0-47f5-8a47-e0e0f02292bf tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1296 microversion: 2.1 time: 0.102015 Jun 02 19:39:01.152072 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1501/2987] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:01 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:02.168938 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-484897dc-4674-4e27-830f-0f29207e4187 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:02.171689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-484897dc-4674-4e27-830f-0f29207e4187 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:02.179844 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-484897dc-4674-4e27-830f-0f29207e4187 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:02.180279 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-484897dc-4674-4e27-830f-0f29207e4187 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:02.181419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-484897dc-4674-4e27-830f-0f29207e4187 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:02.181887 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-484897dc-4674-4e27-830f-0f29207e4187 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:02.377392 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-484897dc-4674-4e27-830f-0f29207e4187 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:02.385166 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-484897dc-4674-4e27-830f-0f29207e4187 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1364 microversion: 2.1 time: 0.220206 Jun 02 19:39:02.385737 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1487/2988] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:02 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:02.476426 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-70de9031-48d7-4f9d-884d-2e171180352b req-3700abee-e299-49c8-a526-873950f240f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d14a56-b31d-4136-bf95-7779d65b7d4f", "tag": "64aa9389-2118-4b8c-b963-159a10db17e3"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:39:02.489474 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-70de9031-48d7-4f9d-884d-2e171180352b req-3700abee-e299-49c8-a526-873950f240f8 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:02.490132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-70de9031-48d7-4f9d-884d-2e171180352b req-3700abee-e299-49c8-a526-873950f240f8 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:02.510076 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-70de9031-48d7-4f9d-884d-2e171180352b req-3700abee-e299-49c8-a526-873950f240f8 service nova] Creating event network-changed:64aa9389-2118-4b8c-b963-159a10db17e3 for instance a4d14a56-b31d-4136-bf95-7779d65b7d4f on hv-cinder-79760 Jun 02 19:39:02.516272 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-70de9031-48d7-4f9d-884d-2e171180352b req-3700abee-e299-49c8-a526-873950f240f8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044255 Jun 02 19:39:02.517431 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1502/2989] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:39:03.402635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d9e9f282-a37f-4207-b118-f920c216c987 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:03.403333 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d9e9f282-a37f-4207-b118-f920c216c987 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:03.410751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d9e9f282-a37f-4207-b118-f920c216c987 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:03.411196 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d9e9f282-a37f-4207-b118-f920c216c987 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:03.411952 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d9e9f282-a37f-4207-b118-f920c216c987 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:03.412379 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d9e9f282-a37f-4207-b118-f920c216c987 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:03.550576 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d9e9f282-a37f-4207-b118-f920c216c987 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:03.558609 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d9e9f282-a37f-4207-b118-f920c216c987 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1364 microversion: 2.1 time: 0.159936 Jun 02 19:39:03.559190 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1488/2990] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:03 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:04.576808 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ceeb44fa-2c13-4f06-b4b4-b6bdc39f4f65 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:04.577547 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ceeb44fa-2c13-4f06-b4b4-b6bdc39f4f65 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:04.584364 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ceeb44fa-2c13-4f06-b4b4-b6bdc39f4f65 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:04.584812 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ceeb44fa-2c13-4f06-b4b4-b6bdc39f4f65 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:04.585569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ceeb44fa-2c13-4f06-b4b4-b6bdc39f4f65 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:04.586038 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ceeb44fa-2c13-4f06-b4b4-b6bdc39f4f65 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:04.733166 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ceeb44fa-2c13-4f06-b4b4-b6bdc39f4f65 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:04.745445 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ceeb44fa-2c13-4f06-b4b4-b6bdc39f4f65 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1364 microversion: 2.1 time: 0.173082 Jun 02 19:39:04.746465 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1503/2991] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:04 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:05.768017 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-09b27c0d-fb45-4aa5-a9a1-6cc16577d925 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:05.769057 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-09b27c0d-fb45-4aa5-a9a1-6cc16577d925 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:05.780354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09b27c0d-fb45-4aa5-a9a1-6cc16577d925 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:05.781108 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09b27c0d-fb45-4aa5-a9a1-6cc16577d925 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:05.782996 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09b27c0d-fb45-4aa5-a9a1-6cc16577d925 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:05.783448 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09b27c0d-fb45-4aa5-a9a1-6cc16577d925 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:05.916282 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-09b27c0d-fb45-4aa5-a9a1-6cc16577d925 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:05.924951 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-09b27c0d-fb45-4aa5-a9a1-6cc16577d925 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1364 microversion: 2.1 time: 0.163745 Jun 02 19:39:05.925622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1489/2992] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:05 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:06.946993 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ec45d6f0-d7a5-4205-aacd-83740b0b08d2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:06.947965 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ec45d6f0-d7a5-4205-aacd-83740b0b08d2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:06.960101 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec45d6f0-d7a5-4205-aacd-83740b0b08d2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:06.960857 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec45d6f0-d7a5-4205-aacd-83740b0b08d2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:06.962183 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec45d6f0-d7a5-4205-aacd-83740b0b08d2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:06.962919 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec45d6f0-d7a5-4205-aacd-83740b0b08d2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:07.109665 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ec45d6f0-d7a5-4205-aacd-83740b0b08d2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:07.121213 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ec45d6f0-d7a5-4205-aacd-83740b0b08d2 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1364 microversion: 2.1 time: 0.180577 Jun 02 19:39:07.122041 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1504/2993] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:06 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:07.965112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-ebeb25bf-a19b-4221-9810-439aadbba8d3 req-c9f95fad-bfd0-489f-a8a2-d784291bb8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d14a56-b31d-4136-bf95-7779d65b7d4f", "name": "network-vif-plugged", "status": "completed", "tag": "64aa9389-2118-4b8c-b963-159a10db17e3"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:39:07.974366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-ebeb25bf-a19b-4221-9810-439aadbba8d3 req-c9f95fad-bfd0-489f-a8a2-d784291bb8c7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:07.974802 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-ebeb25bf-a19b-4221-9810-439aadbba8d3 req-c9f95fad-bfd0-489f-a8a2-d784291bb8c7 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:07.988058 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-ebeb25bf-a19b-4221-9810-439aadbba8d3 req-c9f95fad-bfd0-489f-a8a2-d784291bb8c7 service nova] Creating event network-vif-plugged:64aa9389-2118-4b8c-b963-159a10db17e3 for instance a4d14a56-b31d-4136-bf95-7779d65b7d4f on hv-cinder-79760 Jun 02 19:39:07.993836 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-ebeb25bf-a19b-4221-9810-439aadbba8d3 req-c9f95fad-bfd0-489f-a8a2-d784291bb8c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032400 Jun 02 19:39:07.994430 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1490/2994] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:39:08.138915 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e88a5cd9-5d37-47b1-b525-ddb62e13e65b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:08.139578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e88a5cd9-5d37-47b1-b525-ddb62e13e65b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:08.146559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e88a5cd9-5d37-47b1-b525-ddb62e13e65b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:08.147019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e88a5cd9-5d37-47b1-b525-ddb62e13e65b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:08.147796 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e88a5cd9-5d37-47b1-b525-ddb62e13e65b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:08.148236 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e88a5cd9-5d37-47b1-b525-ddb62e13e65b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:08.311926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e88a5cd9-5d37-47b1-b525-ddb62e13e65b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:08.319837 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e88a5cd9-5d37-47b1-b525-ddb62e13e65b tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1364 microversion: 2.1 time: 0.184844 Jun 02 19:39:08.320413 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1505/2995] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:08 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:09.338309 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6c3dfefa-538a-4a04-82da-6f5f3c5f0427 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:09.339007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6c3dfefa-538a-4a04-82da-6f5f3c5f0427 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:09.345733 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c3dfefa-538a-4a04-82da-6f5f3c5f0427 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:09.346346 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c3dfefa-538a-4a04-82da-6f5f3c5f0427 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:09.347255 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c3dfefa-538a-4a04-82da-6f5f3c5f0427 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:09.347693 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c3dfefa-538a-4a04-82da-6f5f3c5f0427 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:09.492592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6c3dfefa-538a-4a04-82da-6f5f3c5f0427 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:09.503942 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6c3dfefa-538a-4a04-82da-6f5f3c5f0427 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1364 microversion: 2.1 time: 0.170038 Jun 02 19:39:09.504722 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1491/2996] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:09 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:10.526371 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-789ae792-e4ee-4253-9b79-303cfa13ca76 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:10.527252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-789ae792-e4ee-4253-9b79-303cfa13ca76 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:10.530872 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:39:10.531799 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:39:10.540675 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-789ae792-e4ee-4253-9b79-303cfa13ca76 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:10.541406 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-789ae792-e4ee-4253-9b79-303cfa13ca76 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:10.542720 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-789ae792-e4ee-4253-9b79-303cfa13ca76 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:10.543410 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-789ae792-e4ee-4253-9b79-303cfa13ca76 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:10.685400 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-789ae792-e4ee-4253-9b79-303cfa13ca76 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:39:10.693728 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-789ae792-e4ee-4253-9b79-303cfa13ca76 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1550 microversion: 2.1 time: 0.172585 Jun 02 19:39:10.694324 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1506/2997] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:39:10 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:39:10.710339 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2627b04b-6c8f-49e2-a151-7b1652df77c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:10.710880 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2627b04b-6c8f-49e2-a151-7b1652df77c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:10.712694 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:39:10.719036 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2627b04b-6c8f-49e2-a151-7b1652df77c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:10.719480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2627b04b-6c8f-49e2-a151-7b1652df77c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:10.720225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2627b04b-6c8f-49e2-a151-7b1652df77c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:10.720653 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2627b04b-6c8f-49e2-a151-7b1652df77c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:10.804021 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2627b04b-6c8f-49e2-a151-7b1652df77c8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097616 Jun 02 19:39:10.804743 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1492/2998] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Jun 2 19:39:10 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:39:11.765748 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-db8193e1-50bd-4ad6-8faa-f7b2b93302d1 req-6934b115-f85f-4f5d-8509-1cc866cda2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d14a56-b31d-4136-bf95-7779d65b7d4f", "tag": "64aa9389-2118-4b8c-b963-159a10db17e3"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:39:11.775699 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-db8193e1-50bd-4ad6-8faa-f7b2b93302d1 req-6934b115-f85f-4f5d-8509-1cc866cda2b4 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:11.776161 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-db8193e1-50bd-4ad6-8faa-f7b2b93302d1 req-6934b115-f85f-4f5d-8509-1cc866cda2b4 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:11.789180 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-db8193e1-50bd-4ad6-8faa-f7b2b93302d1 req-6934b115-f85f-4f5d-8509-1cc866cda2b4 service nova] Creating event network-changed:64aa9389-2118-4b8c-b963-159a10db17e3 for instance a4d14a56-b31d-4136-bf95-7779d65b7d4f on hv-cinder-79760 Jun 02 19:39:11.794901 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-db8193e1-50bd-4ad6-8faa-f7b2b93302d1 req-6934b115-f85f-4f5d-8509-1cc866cda2b4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032821 Jun 02 19:39:11.796100 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1507/2999] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:39:45.893971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:39:45.895091 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=50 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:39:45.900071 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b62e80e6-059d-4de9-8ad0-9a00ab88464c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:45.900561 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b62e80e6-059d-4de9-8ad0-9a00ab88464c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:45.908253 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b62e80e6-059d-4de9-8ad0-9a00ab88464c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:45.908702 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b62e80e6-059d-4de9-8ad0-9a00ab88464c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:45.909460 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b62e80e6-059d-4de9-8ad0-9a00ab88464c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:45.909924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b62e80e6-059d-4de9-8ad0-9a00ab88464c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:45.942201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b62e80e6-059d-4de9-8ad0-9a00ab88464c tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/ips" status: 200 len: 145 microversion: 2.1 time: 0.050555 Jun 02 19:39:45.942953 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1493/3000] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Jun 2 19:39:45 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:39:47.291029 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-79796c1d-a266-45c9-beb5-8e91a492f717 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af0ed7a3-301b-4d60-848b-a36b000ca18d"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:39:47.292235 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-79796c1d-a266-45c9-beb5-8e91a492f717 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:47.294505 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:39:47.295293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:39:47.302322 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79796c1d-a266-45c9-beb5-8e91a492f717 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:47.302769 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79796c1d-a266-45c9-beb5-8e91a492f717 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:47.303939 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79796c1d-a266-45c9-beb5-8e91a492f717 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:47.304705 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-79796c1d-a266-45c9-beb5-8e91a492f717 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:47.605827 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-79796c1d-a266-45c9-beb5-8e91a492f717 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320032 Jun 02 19:39:47.606729 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1508/3001] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:39:47 2022] POST /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:39:54.104537 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ec7d91b2-dc79-453e-921e-7e21c460b7fa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:54.105518 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ec7d91b2-dc79-453e-921e-7e21c460b7fa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:54.112570 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec7d91b2-dc79-453e-921e-7e21c460b7fa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:54.113010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec7d91b2-dc79-453e-921e-7e21c460b7fa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:54.113774 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec7d91b2-dc79-453e-921e-7e21c460b7fa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:54.114264 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ec7d91b2-dc79-453e-921e-7e21c460b7fa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:54.145683 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ec7d91b2-dc79-453e-921e-7e21c460b7fa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Jun 02 19:39:54.146283 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1494/3002] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:39:54 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:39:54.157583 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b4d7a06b-16e1-41c9-97c2-2edec2c1f6eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:39:54.158293 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b4d7a06b-16e1-41c9-97c2-2edec2c1f6eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:54.165266 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4d7a06b-16e1-41c9-97c2-2edec2c1f6eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:54.165723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4d7a06b-16e1-41c9-97c2-2edec2c1f6eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:54.166548 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4d7a06b-16e1-41c9-97c2-2edec2c1f6eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:54.166986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4d7a06b-16e1-41c9-97c2-2edec2c1f6eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:54.197227 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b4d7a06b-16e1-41c9-97c2-2edec2c1f6eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/af0ed7a3-301b-4d60-848b-a36b000ca18d" status: 200 len: 194 microversion: 2.1 time: 0.044532 Jun 02 19:39:54.197873 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1509/3003] 10.222.0.15 () {58 vars in 1412 bytes} [Thu Jun 2 19:39:54 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/af0ed7a3-301b-4d60-848b-a36b000ca18d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:39:55.534768 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2cd83cbc-e344-435f-897b-193b3042f2eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb95687a-90e5-4985-926b-c5b9bfa6072e"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:39:55.535736 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2cd83cbc-e344-435f-897b-193b3042f2eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:39:55.542923 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cd83cbc-e344-435f-897b-193b3042f2eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:55.543364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cd83cbc-e344-435f-897b-193b3042f2eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:55.544112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cd83cbc-e344-435f-897b-193b3042f2eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:39:55.544534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cd83cbc-e344-435f-897b-193b3042f2eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:39:55.810167 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2cd83cbc-e344-435f-897b-193b3042f2eb tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "POST /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279073 Jun 02 19:39:55.810783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1495/3004] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Jun 2 19:39:55 2022] POST /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:40:03.363600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a436a999-49e3-4f4c-a9d1-9eb602277bb9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:03.364536 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a436a999-49e3-4f4c-a9d1-9eb602277bb9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:03.371114 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a436a999-49e3-4f4c-a9d1-9eb602277bb9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:03.371558 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a436a999-49e3-4f4c-a9d1-9eb602277bb9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:03.372353 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a436a999-49e3-4f4c-a9d1-9eb602277bb9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:03.372788 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a436a999-49e3-4f4c-a9d1-9eb602277bb9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:03.404064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a436a999-49e3-4f4c-a9d1-9eb602277bb9 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044400 Jun 02 19:40:03.404659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1510/3005] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:40:03 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:40:03.548214 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-915dc7a6-f08a-433a-b6b3-5b266011eb7f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:03.548958 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-915dc7a6-f08a-433a-b6b3-5b266011eb7f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:03.556400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-915dc7a6-f08a-433a-b6b3-5b266011eb7f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:03.556846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-915dc7a6-f08a-433a-b6b3-5b266011eb7f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:03.557615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-915dc7a6-f08a-433a-b6b3-5b266011eb7f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:03.558075 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-915dc7a6-f08a-433a-b6b3-5b266011eb7f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:03.588931 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-915dc7a6-f08a-433a-b6b3-5b266011eb7f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/af0ed7a3-301b-4d60-848b-a36b000ca18d" status: 200 len: 194 microversion: 2.1 time: 0.045533 Jun 02 19:40:03.589532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1496/3006] 10.222.0.15 () {58 vars in 1412 bytes} [Thu Jun 2 19:40:03 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/af0ed7a3-301b-4d60-848b-a36b000ca18d => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:40:03.601553 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9df0585b-6a43-456a-ad15-b375b038cfb8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:03.602094 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9df0585b-6a43-456a-ad15-b375b038cfb8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:03.608949 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9df0585b-6a43-456a-ad15-b375b038cfb8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:03.609401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9df0585b-6a43-456a-ad15-b375b038cfb8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:03.610202 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9df0585b-6a43-456a-ad15-b375b038cfb8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:03.610633 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9df0585b-6a43-456a-ad15-b375b038cfb8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:03.697379 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-9df0585b-6a43-456a-ad15-b375b038cfb8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lazy-loading 'services' on Instance uuid a4d14a56-b31d-4136-bf95-7779d65b7d4f {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:40:03.780964 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9df0585b-6a43-456a-ad15-b375b038cfb8 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/af0ed7a3-301b-4d60-848b-a36b000ca18d" status: 202 len: 0 microversion: 2.1 time: 0.183161 Jun 02 19:40:03.782023 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1511/3007] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:40:03 2022] DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/af0ed7a3-301b-4d60-848b-a36b000ca18d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:40:04.901622 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-750e698e-bd9d-4320-a853-0b897daef7cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:04.902278 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-750e698e-bd9d-4320-a853-0b897daef7cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:04.909512 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-750e698e-bd9d-4320-a853-0b897daef7cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:04.910010 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-750e698e-bd9d-4320-a853-0b897daef7cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:04.910783 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-750e698e-bd9d-4320-a853-0b897daef7cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:04.911235 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-750e698e-bd9d-4320-a853-0b897daef7cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:04.943757 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-750e698e-bd9d-4320-a853-0b897daef7cc tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/fb95687a-90e5-4985-926b-c5b9bfa6072e" status: 200 len: 194 microversion: 2.1 time: 0.046971 Jun 02 19:40:04.944360 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1497/3008] 10.222.0.15 () {58 vars in 1412 bytes} [Thu Jun 2 19:40:04 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/fb95687a-90e5-4985-926b-c5b9bfa6072e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:40:04.955797 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-163436ca-6afc-4393-93f3-5fb229e54b38 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:04.956416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-163436ca-6afc-4393-93f3-5fb229e54b38 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:04.963688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-163436ca-6afc-4393-93f3-5fb229e54b38 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:04.964143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-163436ca-6afc-4393-93f3-5fb229e54b38 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:04.964927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-163436ca-6afc-4393-93f3-5fb229e54b38 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:04.965399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-163436ca-6afc-4393-93f3-5fb229e54b38 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:05.052157 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-163436ca-6afc-4393-93f3-5fb229e54b38 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lazy-loading 'services' on Instance uuid a4d14a56-b31d-4136-bf95-7779d65b7d4f {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:40:05.138544 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-163436ca-6afc-4393-93f3-5fb229e54b38 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/fb95687a-90e5-4985-926b-c5b9bfa6072e" status: 202 len: 0 microversion: 2.1 time: 0.187468 Jun 02 19:40:05.139188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1512/3009] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Jun 2 19:40:04 2022] DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments/fb95687a-90e5-4985-926b-c5b9bfa6072e => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:40:06.310751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-37869642-38cb-47c8-902b-fc1ce1069449 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:06.311738 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-37869642-38cb-47c8-902b-fc1ce1069449 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:06.319072 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37869642-38cb-47c8-902b-fc1ce1069449 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:06.319533 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37869642-38cb-47c8-902b-fc1ce1069449 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:06.320308 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37869642-38cb-47c8-902b-fc1ce1069449 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:06.320735 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-37869642-38cb-47c8-902b-fc1ce1069449 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:06.354988 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-37869642-38cb-47c8-902b-fc1ce1069449 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048693 Jun 02 19:40:06.355603 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1498/3010] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:40:06 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 19:40:06.480338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6cf00cc6-ff86-4dec-b717-cc6c8c9f2bd5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:06.481409 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6cf00cc6-ff86-4dec-b717-cc6c8c9f2bd5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:06.488108 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6cf00cc6-ff86-4dec-b717-cc6c8c9f2bd5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:06.488557 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6cf00cc6-ff86-4dec-b717-cc6c8c9f2bd5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:06.489315 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6cf00cc6-ff86-4dec-b717-cc6c8c9f2bd5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:06.490403 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6cf00cc6-ff86-4dec-b717-cc6c8c9f2bd5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:06.525013 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6cf00cc6-ff86-4dec-b717-cc6c8c9f2bd5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050339 Jun 02 19:40:06.525597 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1513/3011] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Jun 2 19:40:06 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 19:40:06.586045 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0b25304b-8fd2-499a-a5bd-00f2264d91aa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:06.586596 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0b25304b-8fd2-499a-a5bd-00f2264d91aa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:06.593163 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b25304b-8fd2-499a-a5bd-00f2264d91aa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:06.593616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b25304b-8fd2-499a-a5bd-00f2264d91aa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:06.594431 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b25304b-8fd2-499a-a5bd-00f2264d91aa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:06.594864 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b25304b-8fd2-499a-a5bd-00f2264d91aa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:06.620543 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0b25304b-8fd2-499a-a5bd-00f2264d91aa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:40:06.715986 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0b25304b-8fd2-499a-a5bd-00f2264d91aa tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 204 len: 0 microversion: 2.1 time: 0.133342 Jun 02 19:40:06.716498 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1499/3012] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:40:06 2022] DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:40:06.725329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89045695-d342-4a40-8b17-eea5b328dc23 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:06.726001 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-89045695-d342-4a40-8b17-eea5b328dc23 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:06.732736 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89045695-d342-4a40-8b17-eea5b328dc23 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:06.733189 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89045695-d342-4a40-8b17-eea5b328dc23 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:06.733986 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89045695-d342-4a40-8b17-eea5b328dc23 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:06.734425 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89045695-d342-4a40-8b17-eea5b328dc23 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:06.883316 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-89045695-d342-4a40-8b17-eea5b328dc23 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:06.892457 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-89045695-d342-4a40-8b17-eea5b328dc23 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1674 microversion: 2.1 time: 0.170934 Jun 02 19:40:06.893048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1514/3013] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:06 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:07.911061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-91a83209-cec4-4a06-9fa9-7f7d904ba4ea tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:07.911726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-91a83209-cec4-4a06-9fa9-7f7d904ba4ea tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:07.919051 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91a83209-cec4-4a06-9fa9-7f7d904ba4ea tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:07.919505 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91a83209-cec4-4a06-9fa9-7f7d904ba4ea tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:07.920280 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91a83209-cec4-4a06-9fa9-7f7d904ba4ea tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:07.920715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-91a83209-cec4-4a06-9fa9-7f7d904ba4ea tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:08.062494 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-91a83209-cec4-4a06-9fa9-7f7d904ba4ea tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:08.070134 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-91a83209-cec4-4a06-9fa9-7f7d904ba4ea tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1674 microversion: 2.1 time: 0.163372 Jun 02 19:40:08.070696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1500/3014] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:07 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:09.088224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-84309a23-90f0-4807-ad71-67274d57524f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:09.088906 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-84309a23-90f0-4807-ad71-67274d57524f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:09.095599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84309a23-90f0-4807-ad71-67274d57524f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:09.096061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84309a23-90f0-4807-ad71-67274d57524f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:09.096968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84309a23-90f0-4807-ad71-67274d57524f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:09.097399 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84309a23-90f0-4807-ad71-67274d57524f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:09.357074 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84309a23-90f0-4807-ad71-67274d57524f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd160ccef27104953beadc68e74b2d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119263b9683e44eba604fc24eca20061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:09.365466 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-84309a23-90f0-4807-ad71-67274d57524f tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 200 len: 1674 microversion: 2.1 time: 0.281286 Jun 02 19:40:09.366107 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1515/3015] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:09 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 1674 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:09.583977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-6c0163b8-9edb-4435-a193-ec2cb5e990f4 req-1a1103f7-2eba-4490-bea7-d1a76bc743f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d14a56-b31d-4136-bf95-7779d65b7d4f", "name": "network-vif-deleted", "tag": "64aa9389-2118-4b8c-b963-159a10db17e3"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:40:09.595236 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-6c0163b8-9edb-4435-a193-ec2cb5e990f4 req-1a1103f7-2eba-4490-bea7-d1a76bc743f5 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:09.595684 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-6c0163b8-9edb-4435-a193-ec2cb5e990f4 req-1a1103f7-2eba-4490-bea7-d1a76bc743f5 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:09.608686 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-6c0163b8-9edb-4435-a193-ec2cb5e990f4 req-1a1103f7-2eba-4490-bea7-d1a76bc743f5 service nova] Creating event network-vif-deleted:64aa9389-2118-4b8c-b963-159a10db17e3 for instance a4d14a56-b31d-4136-bf95-7779d65b7d4f on hv-cinder-79760 Jun 02 19:40:09.614109 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-6c0163b8-9edb-4435-a193-ec2cb5e990f4 req-1a1103f7-2eba-4490-bea7-d1a76bc743f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034292 Jun 02 19:40:09.614716 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1501/3016] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:40:10.383078 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:10.383898 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:10.391090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:10.391657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:10.392472 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:10.392921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:10.408585 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] HTTP exception thrown: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Request method failure captured: Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f HTTP/1.1 Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimREk1jo-3vj94oKuKLaQHYSGM30Tub7O2oJSAHhsHvrZUnO94fAB52FUb_jKoPF_MaM0M5503jiAp2cnHID8s9k8IGDM_CmQEtAEVzm3Saiwdvwaz61ct949Jz-PDjB5KLpx0s5ajZ-GDg2XeNzPZv69DxNdHqcGWzw3luxzMFig1vE Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:40:10.410359 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_119263b9683e44eba604fc24eca20061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/119263b9683e44eba604fc24eca20061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: d160ccef27104953beadc68e74b2d49e Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:10.412195 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'a4d14a56-b31d-4136-bf95-7779d65b7d4f'} Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:40:10.413171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:10.415036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:10.416534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Returning 404 to user: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:40:10.416534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b42cb159-e634-4d95-90da-f00c858509a7 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 404 len: 111 microversion: 2.1 time: 0.032670 Jun 02 19:40:10.416534 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1516/3017] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:10 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:40:10.422758 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-abf49c6b-dcc3-4229-974c-502b157a6f83 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '.version_select at 0x7f5b786973a0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:10.444740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-abf49c6b-dcc3-4229-974c-502b157a6f83 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011202980" status: 202 len: 0 microversion: 2.1 time: 0.025676 Jun 02 19:40:10.444740 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1502/3018] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Jun 2 19:40:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011202980 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:40:13.392241 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:13.392851 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:13.399929 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:13.400383 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:13.401152 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:13.401593 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:13.415580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] HTTP exception thrown: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Request method failure captured: Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f HTTP/1.1 Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimREk1jo-3vj94oKuKLaQHYSGM30Tub7O2oJSAHhsHvrZUnO94fAB52FUb_jKoPF_MaM0M5503jiAp2cnHID8s9k8IGDM_CmQEtAEVzm3Saiwdvwaz61ct949Jz-PDjB5KLpx0s5ajZ-GDg2XeNzPZv69DxNdHqcGWzw3luxzMFig1vE Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:40:13.417169 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_119263b9683e44eba604fc24eca20061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/119263b9683e44eba604fc24eca20061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: d160ccef27104953beadc68e74b2d49e Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.419957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'a4d14a56-b31d-4136-bf95-7779d65b7d4f'} Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:40:13.421049 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.423203 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.425070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Returning 404 to user: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:40:13.425070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e84d4c16-aa83-4eea-becb-1da10c516fd6 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 404 len: 111 microversion: 2.1 time: 0.030577 Jun 02 19:40:13.425070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1517/3019] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:40:13 2022] DELETE /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:40:13.428485 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:13.429251 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a4d14a56-b31d-4136-bf95-7779d65b7d4f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:13.437126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:13.437578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:13.438562 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:13.439000 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:13.453039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] HTTP exception thrown: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Request method failure captured: Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f HTTP/1.1 Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimREk1jo-3vj94oKuKLaQHYSGM30Tub7O2oJSAHhsHvrZUnO94fAB52FUb_jKoPF_MaM0M5503jiAp2cnHID8s9k8IGDM_CmQEtAEVzm3Saiwdvwaz61ct949Jz-PDjB5KLpx0s5ajZ-GDg2XeNzPZv69DxNdHqcGWzw3luxzMFig1vE Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:40:13.454926 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_119263b9683e44eba604fc24eca20061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/119263b9683e44eba604fc24eca20061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: d160ccef27104953beadc68e74b2d49e Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.456759 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': 'a4d14a56-b31d-4136-bf95-7779d65b7d4f'} Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:40:13.457964 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. Jun 02 19:40:13.459585 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:13.461238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Returning 404 to user: Instance a4d14a56-b31d-4136-bf95-7779d65b7d4f could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:40:13.461238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-59d217c5-5ec2-4a7e-9bab-35f040df4bf5 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f" status: 404 len: 111 microversion: 2.1 time: 0.031896 Jun 02 19:40:13.461238 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1503/3020] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:13 2022] GET /compute/v2.1/servers/a4d14a56-b31d-4136-bf95-7779d65b7d4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:40:14.610947 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:14.611564 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:14.618389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:14.618850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:14.619627 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:14.620070 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:14.634864 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] HTTP exception thrown: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Request method failure captured: Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e HTTP/1.1 Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimREk1jo-3vj94oKuKLaQHYSGM30Tub7O2oJSAHhsHvrZUnO94fAB52FUb_jKoPF_MaM0M5503jiAp2cnHID8s9k8IGDM_CmQEtAEVzm3Saiwdvwaz61ct949Jz-PDjB5KLpx0s5ajZ-GDg2XeNzPZv69DxNdHqcGWzw3luxzMFig1vE Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:40:14.636559 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_119263b9683e44eba604fc24eca20061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/119263b9683e44eba604fc24eca20061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: d160ccef27104953beadc68e74b2d49e Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.640115 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': 'a8d47d4c-7e0a-4ff5-b560-557ef9c7493e'} Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:40:14.642028 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.645088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.648048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Returning 404 to user: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:40:14.648048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d4332803-b2ca-4e69-b805-c6b075139d11 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 404 len: 111 microversion: 2.1 time: 0.031325 Jun 02 19:40:14.648048 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1518/3021] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:40:14 2022] DELETE /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:40:14.648879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:14.648879 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] [instance: a8d47d4c-7e0a-4ff5-b560-557ef9c7493e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:14.655424 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:14.655886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:14.656650 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:14.657082 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:14.672852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] HTTP exception thrown: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Request method failure captured: Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e HTTP/1.1 Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimREk1jo-3vj94oKuKLaQHYSGM30Tub7O2oJSAHhsHvrZUnO94fAB52FUb_jKoPF_MaM0M5503jiAp2cnHID8s9k8IGDM_CmQEtAEVzm3Saiwdvwaz61ct949Jz-PDjB5KLpx0s5ajZ-GDg2XeNzPZv69DxNdHqcGWzw3luxzMFig1vE Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:40:14.674578 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_119263b9683e44eba604fc24eca20061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/119263b9683e44eba604fc24eca20061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/119263b9683e44eba604fc24eca20061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 119263b9683e44eba604fc24eca20061 Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1332029433 Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: d160ccef27104953beadc68e74b2d49e Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeTestJSON-1332029433-project Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.676378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': 'a8d47d4c-7e0a-4ff5-b560-557ef9c7493e'} Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:40:14.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. Jun 02 19:40:14.679132 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:40:14.680592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] Returning 404 to user: Instance a8d47d4c-7e0a-4ff5-b560-557ef9c7493e could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:40:14.680592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-11053693-3f45-4af9-84df-885d42f72874 tempest-AttachVolumeTestJSON-1332029433 tempest-AttachVolumeTestJSON-1332029433-project] 10.222.0.15 "GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e" status: 404 len: 111 microversion: 2.1 time: 0.032446 Jun 02 19:40:14.680592 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1504/3022] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:14 2022] GET /compute/v2.1/servers/a8d47d4c-7e0a-4ff5-b560-557ef9c7493e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:40:15.768930 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ee1b240f-f217-4e24-aaa6-1d72707d9a6f tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:40:15.769756 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ee1b240f-f217-4e24-aaa6-1d72707d9a6f tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:15.779045 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee1b240f-f217-4e24-aaa6-1d72707d9a6f tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:15.779923 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee1b240f-f217-4e24-aaa6-1d72707d9a6f tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:15.781238 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee1b240f-f217-4e24-aaa6-1d72707d9a6f tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:15.782232 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ee1b240f-f217-4e24-aaa6-1d72707d9a6f tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:15.819698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-ee1b240f-f217-4e24-aaa6-1d72707d9a6f tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lazy-loading 'flavor' on Instance uuid 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 19:40:15.909573 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ee1b240f-f217-4e24-aaa6-1d72707d9a6f tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "POST /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897/action" status: 202 len: 0 microversion: 2.1 time: 0.144611 Jun 02 19:40:15.910542 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1519/3023] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:40:15 2022] POST /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:40:15.920275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-61156344-afeb-47a0-8991-7300fd2fde24 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:15.921230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-61156344-afeb-47a0-8991-7300fd2fde24 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:15.924033 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:15.929417 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61156344-afeb-47a0-8991-7300fd2fde24 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:15.930011 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61156344-afeb-47a0-8991-7300fd2fde24 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:15.930676 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61156344-afeb-47a0-8991-7300fd2fde24 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:15.931054 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61156344-afeb-47a0-8991-7300fd2fde24 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:15.935516 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:16.178660 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-61156344-afeb-47a0-8991-7300fd2fde24 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:16.187192 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-61156344-afeb-47a0-8991-7300fd2fde24 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.271346 Jun 02 19:40:16.187777 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1505/3024] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:15 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:17.214325 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-af44a38a-3efb-4674-8d0f-47f8a9246f7b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:17.215609 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-af44a38a-3efb-4674-8d0f-47f8a9246f7b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:17.225667 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af44a38a-3efb-4674-8d0f-47f8a9246f7b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:17.227389 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af44a38a-3efb-4674-8d0f-47f8a9246f7b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:17.229478 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af44a38a-3efb-4674-8d0f-47f8a9246f7b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:17.230599 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af44a38a-3efb-4674-8d0f-47f8a9246f7b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:17.578708 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-af44a38a-3efb-4674-8d0f-47f8a9246f7b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:17.604980 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:17.646119 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-af44a38a-3efb-4674-8d0f-47f8a9246f7b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.426841 Jun 02 19:40:17.657983 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1520/3025] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:17 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:18.667388 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3ac3256e-2acb-4dc7-979e-006cb137d01e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:18.668664 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ac3256e-2acb-4dc7-979e-006cb137d01e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:18.676837 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ac3256e-2acb-4dc7-979e-006cb137d01e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:18.677354 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ac3256e-2acb-4dc7-979e-006cb137d01e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:18.678468 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ac3256e-2acb-4dc7-979e-006cb137d01e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:18.678977 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ac3256e-2acb-4dc7-979e-006cb137d01e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:18.853390 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3ac3256e-2acb-4dc7-979e-006cb137d01e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:18.864393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3ac3256e-2acb-4dc7-979e-006cb137d01e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.202822 Jun 02 19:40:18.865008 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1506/3026] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:18 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:19.883084 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7553a547-3c5a-4d64-9f40-8f33d9c23452 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:19.883714 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7553a547-3c5a-4d64-9f40-8f33d9c23452 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:19.885614 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=27 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:19.892693 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7553a547-3c5a-4d64-9f40-8f33d9c23452 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:19.893153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7553a547-3c5a-4d64-9f40-8f33d9c23452 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:19.894012 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7553a547-3c5a-4d64-9f40-8f33d9c23452 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:19.894634 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7553a547-3c5a-4d64-9f40-8f33d9c23452 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:20.053348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7553a547-3c5a-4d64-9f40-8f33d9c23452 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:20.061734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7553a547-3c5a-4d64-9f40-8f33d9c23452 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.183212 Jun 02 19:40:20.062664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1521/3027] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:19 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:21.082960 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-25056b89-edac-4217-9857-bd4a44b6ca30 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:21.085012 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-25056b89-edac-4217-9857-bd4a44b6ca30 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:21.095616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-25056b89-edac-4217-9857-bd4a44b6ca30 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:21.095616 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-25056b89-edac-4217-9857-bd4a44b6ca30 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:21.096559 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-25056b89-edac-4217-9857-bd4a44b6ca30 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:21.097313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-25056b89-edac-4217-9857-bd4a44b6ca30 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:21.264317 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-25056b89-edac-4217-9857-bd4a44b6ca30 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:21.273314 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-25056b89-edac-4217-9857-bd4a44b6ca30 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.196913 Jun 02 19:40:21.273933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1507/3028] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:21 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:22.293604 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-18c3c78c-4e87-4b49-8b79-ba97509e91db tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:22.294453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-18c3c78c-4e87-4b49-8b79-ba97509e91db tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:22.301738 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18c3c78c-4e87-4b49-8b79-ba97509e91db tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:22.302218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18c3c78c-4e87-4b49-8b79-ba97509e91db tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:22.302985 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18c3c78c-4e87-4b49-8b79-ba97509e91db tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:22.303417 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18c3c78c-4e87-4b49-8b79-ba97509e91db tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:22.485338 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-18c3c78c-4e87-4b49-8b79-ba97509e91db tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:22.494310 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-18c3c78c-4e87-4b49-8b79-ba97509e91db tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.206242 Jun 02 19:40:22.495098 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1522/3029] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:22 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:40:23.512203 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-afe29f58-4e5b-4ee4-9682-29156f8c71a9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:23.512833 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-afe29f58-4e5b-4ee4-9682-29156f8c71a9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:23.520368 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe29f58-4e5b-4ee4-9682-29156f8c71a9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:23.520728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe29f58-4e5b-4ee4-9682-29156f8c71a9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:23.521502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe29f58-4e5b-4ee4-9682-29156f8c71a9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:23.521978 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-afe29f58-4e5b-4ee4-9682-29156f8c71a9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:23.677450 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-afe29f58-4e5b-4ee4-9682-29156f8c71a9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:23.688366 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-afe29f58-4e5b-4ee4-9682-29156f8c71a9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.180334 Jun 02 19:40:23.688949 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1508/3030] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:23 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:24.711348 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5164f0bf-a941-47bc-9708-db8a02ca7ba0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:24.711997 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5164f0bf-a941-47bc-9708-db8a02ca7ba0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:24.719763 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5164f0bf-a941-47bc-9708-db8a02ca7ba0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:24.720192 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5164f0bf-a941-47bc-9708-db8a02ca7ba0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:24.720969 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5164f0bf-a941-47bc-9708-db8a02ca7ba0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:24.721412 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5164f0bf-a941-47bc-9708-db8a02ca7ba0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:24.892926 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5164f0bf-a941-47bc-9708-db8a02ca7ba0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:24.904330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5164f0bf-a941-47bc-9708-db8a02ca7ba0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.196864 Jun 02 19:40:24.905298 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1523/3031] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:24 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:25.925991 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a33844c0-f0e1-42d9-a478-c336311a441b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:25.927039 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a33844c0-f0e1-42d9-a478-c336311a441b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:25.939061 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a33844c0-f0e1-42d9-a478-c336311a441b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:25.939901 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a33844c0-f0e1-42d9-a478-c336311a441b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:25.941349 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a33844c0-f0e1-42d9-a478-c336311a441b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:25.942189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a33844c0-f0e1-42d9-a478-c336311a441b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:26.128565 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a33844c0-f0e1-42d9-a478-c336311a441b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:26.139155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a33844c0-f0e1-42d9-a478-c336311a441b tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.220086 Jun 02 19:40:26.139842 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1509/3032] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:25 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:40:27.157706 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ceff8ddd-9232-4f0f-b899-c114bd507032 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:27.158791 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ceff8ddd-9232-4f0f-b899-c114bd507032 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:27.170130 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ceff8ddd-9232-4f0f-b899-c114bd507032 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:27.170668 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ceff8ddd-9232-4f0f-b899-c114bd507032 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:27.172247 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ceff8ddd-9232-4f0f-b899-c114bd507032 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:27.172968 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ceff8ddd-9232-4f0f-b899-c114bd507032 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:27.341366 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ceff8ddd-9232-4f0f-b899-c114bd507032 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:27.350806 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ceff8ddd-9232-4f0f-b899-c114bd507032 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.197808 Jun 02 19:40:27.351405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1524/3033] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:27 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:28.370365 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-26da7f1f-fc43-4a85-8255-bb2b34e03a0a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:28.370992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-26da7f1f-fc43-4a85-8255-bb2b34e03a0a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:28.378286 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26da7f1f-fc43-4a85-8255-bb2b34e03a0a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:28.378728 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26da7f1f-fc43-4a85-8255-bb2b34e03a0a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:28.379503 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26da7f1f-fc43-4a85-8255-bb2b34e03a0a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:28.379933 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26da7f1f-fc43-4a85-8255-bb2b34e03a0a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:28.576624 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-26da7f1f-fc43-4a85-8255-bb2b34e03a0a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:28.585501 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-26da7f1f-fc43-4a85-8255-bb2b34e03a0a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.219269 Jun 02 19:40:28.586213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1510/3034] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:28 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:40:29.604595 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2b22fc3a-fb3c-4123-8a0f-6d4e9d691dcb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:29.605594 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2b22fc3a-fb3c-4123-8a0f-6d4e9d691dcb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:29.613683 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2b22fc3a-fb3c-4123-8a0f-6d4e9d691dcb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:29.614304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2b22fc3a-fb3c-4123-8a0f-6d4e9d691dcb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:29.615088 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2b22fc3a-fb3c-4123-8a0f-6d4e9d691dcb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:29.615528 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2b22fc3a-fb3c-4123-8a0f-6d4e9d691dcb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:29.763723 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2b22fc3a-fb3c-4123-8a0f-6d4e9d691dcb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:29.772077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2b22fc3a-fb3c-4123-8a0f-6d4e9d691dcb tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1509 microversion: 2.1 time: 0.171417 Jun 02 19:40:29.772664 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1525/3035] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:29 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:29.789747 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-76ec8d3e-2fa3-480a-a6af-6d3c8ff7099d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:40:29.790393 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-76ec8d3e-2fa3-480a-a6af-6d3c8ff7099d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:29.798079 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76ec8d3e-2fa3-480a-a6af-6d3c8ff7099d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:29.798534 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76ec8d3e-2fa3-480a-a6af-6d3c8ff7099d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:29.799313 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76ec8d3e-2fa3-480a-a6af-6d3c8ff7099d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:29.799756 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-76ec8d3e-2fa3-480a-a6af-6d3c8ff7099d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:29.900579 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-76ec8d3e-2fa3-480a-a6af-6d3c8ff7099d tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "POST /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897/action" status: 202 len: 0 microversion: 2.1 time: 0.114757 Jun 02 19:40:29.901712 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1511/3036] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Jun 2 19:40:29 2022] POST /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:40:29.909935 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-df12f556-bd10-433f-906f-e30f8f33e22e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:29.910858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-df12f556-bd10-433f-906f-e30f8f33e22e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:29.917956 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df12f556-bd10-433f-906f-e30f8f33e22e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:29.918304 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df12f556-bd10-433f-906f-e30f8f33e22e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:29.919218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df12f556-bd10-433f-906f-e30f8f33e22e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:29.919754 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df12f556-bd10-433f-906f-e30f8f33e22e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:30.066927 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-df12f556-bd10-433f-906f-e30f8f33e22e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:30.075025 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-df12f556-bd10-433f-906f-e30f8f33e22e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1517 microversion: 2.1 time: 0.169109 Jun 02 19:40:30.075879 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1526/3037] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:29 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:40:31.093894 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b3e01d64-57b0-447e-8c35-1022417d2bf2 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:31.094474 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b3e01d64-57b0-447e-8c35-1022417d2bf2 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:31.101493 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3e01d64-57b0-447e-8c35-1022417d2bf2 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:31.101971 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3e01d64-57b0-447e-8c35-1022417d2bf2 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:31.102742 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3e01d64-57b0-447e-8c35-1022417d2bf2 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:31.103230 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3e01d64-57b0-447e-8c35-1022417d2bf2 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:31.254852 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b3e01d64-57b0-447e-8c35-1022417d2bf2 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:31.264074 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b3e01d64-57b0-447e-8c35-1022417d2bf2 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1519 microversion: 2.1 time: 0.175372 Jun 02 19:40:31.264689 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1512/3038] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:31 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:32.290082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ed836187-f3fa-4907-bba6-9313bf036642 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:32.291494 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ed836187-f3fa-4907-bba6-9313bf036642 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:32.300132 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed836187-f3fa-4907-bba6-9313bf036642 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:32.300569 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed836187-f3fa-4907-bba6-9313bf036642 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:32.302600 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed836187-f3fa-4907-bba6-9313bf036642 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:32.303347 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed836187-f3fa-4907-bba6-9313bf036642 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:32.327083 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-0742fe71-0d2a-4bc5-8241-73c2ba8e4ae2 req-a077bfba-2872-451d-bcf2-da4878b8f192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5018c4-4b2a-4ea0-b313-2d93a1caf897", "name": "network-vif-unplugged", "status": "completed", "tag": "59e6acbd-667f-4a21-ba99-aaedcc060a5e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:40:32.356189 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-0742fe71-0d2a-4bc5-8241-73c2ba8e4ae2 req-a077bfba-2872-451d-bcf2-da4878b8f192 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:32.356532 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-0742fe71-0d2a-4bc5-8241-73c2ba8e4ae2 req-a077bfba-2872-451d-bcf2-da4878b8f192 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:32.371465 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-0742fe71-0d2a-4bc5-8241-73c2ba8e4ae2 req-a077bfba-2872-451d-bcf2-da4878b8f192 service nova] Creating event network-vif-unplugged:59e6acbd-667f-4a21-ba99-aaedcc060a5e for instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 on hv-cinder-79760 Jun 02 19:40:32.377918 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-0742fe71-0d2a-4bc5-8241-73c2ba8e4ae2 req-a077bfba-2872-451d-bcf2-da4878b8f192 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054791 Jun 02 19:40:32.379160 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1513/3039] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:40:32.527292 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ed836187-f3fa-4907-bba6-9313bf036642 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:32.535982 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ed836187-f3fa-4907-bba6-9313bf036642 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1575 microversion: 2.1 time: 0.250843 Jun 02 19:40:32.536578 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1527/3040] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:32 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1575 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:33.554295 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dadc79b9-59ff-4492-9390-19db9b863540 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:33.555002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dadc79b9-59ff-4492-9390-19db9b863540 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:33.562566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dadc79b9-59ff-4492-9390-19db9b863540 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:33.562566 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dadc79b9-59ff-4492-9390-19db9b863540 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:33.563300 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dadc79b9-59ff-4492-9390-19db9b863540 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:33.563751 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dadc79b9-59ff-4492-9390-19db9b863540 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:33.725142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dadc79b9-59ff-4492-9390-19db9b863540 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:33.736459 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dadc79b9-59ff-4492-9390-19db9b863540 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1575 microversion: 2.1 time: 0.186833 Jun 02 19:40:33.737266 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1514/3041] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:33 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:34.755832 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-411cd5e9-e542-4a82-a0bf-5d473bfec7d7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:34.756452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-411cd5e9-e542-4a82-a0bf-5d473bfec7d7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:34.763995 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-411cd5e9-e542-4a82-a0bf-5d473bfec7d7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:34.764405 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-411cd5e9-e542-4a82-a0bf-5d473bfec7d7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:34.765173 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-411cd5e9-e542-4a82-a0bf-5d473bfec7d7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:34.765616 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-411cd5e9-e542-4a82-a0bf-5d473bfec7d7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:34.908858 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-411cd5e9-e542-4a82-a0bf-5d473bfec7d7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:34.917083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-411cd5e9-e542-4a82-a0bf-5d473bfec7d7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1575 microversion: 2.1 time: 0.165346 Jun 02 19:40:34.918222 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1528/3042] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:34 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:40:35.936554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-18bed7df-f56c-4696-9c6a-b9648f7b1794 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:35.937315 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-18bed7df-f56c-4696-9c6a-b9648f7b1794 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:35.944614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18bed7df-f56c-4696-9c6a-b9648f7b1794 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:35.945095 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18bed7df-f56c-4696-9c6a-b9648f7b1794 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:35.946040 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18bed7df-f56c-4696-9c6a-b9648f7b1794 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:35.946489 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18bed7df-f56c-4696-9c6a-b9648f7b1794 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:36.106806 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-18bed7df-f56c-4696-9c6a-b9648f7b1794 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:36.114648 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-18bed7df-f56c-4696-9c6a-b9648f7b1794 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1575 microversion: 2.1 time: 0.182730 Jun 02 19:40:36.115223 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1515/3043] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:35 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:37.131517 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-39c08e9b-0d6f-4aa0-987e-3fcfeafc093e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:37.132135 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-39c08e9b-0d6f-4aa0-987e-3fcfeafc093e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:37.139566 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39c08e9b-0d6f-4aa0-987e-3fcfeafc093e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:37.140019 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39c08e9b-0d6f-4aa0-987e-3fcfeafc093e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:37.140787 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39c08e9b-0d6f-4aa0-987e-3fcfeafc093e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:37.141225 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-39c08e9b-0d6f-4aa0-987e-3fcfeafc093e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:37.295747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-39c08e9b-0d6f-4aa0-987e-3fcfeafc093e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:37.304171 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-39c08e9b-0d6f-4aa0-987e-3fcfeafc093e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1575 microversion: 2.1 time: 0.176522 Jun 02 19:40:37.304770 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1529/3044] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:37 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:38.322426 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aca21e25-c3a1-44a2-86dc-d5c2b888dcd6 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:38.323112 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aca21e25-c3a1-44a2-86dc-d5c2b888dcd6 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:38.330435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aca21e25-c3a1-44a2-86dc-d5c2b888dcd6 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:38.331149 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aca21e25-c3a1-44a2-86dc-d5c2b888dcd6 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:38.331912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aca21e25-c3a1-44a2-86dc-d5c2b888dcd6 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:38.332341 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aca21e25-c3a1-44a2-86dc-d5c2b888dcd6 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:38.523304 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aca21e25-c3a1-44a2-86dc-d5c2b888dcd6 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:38.531924 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aca21e25-c3a1-44a2-86dc-d5c2b888dcd6 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1575 microversion: 2.1 time: 0.213750 Jun 02 19:40:38.532480 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1516/3045] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:38 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:39.551913 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c4f8847a-acdd-4f58-aef1-2c32b1884c2e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:39.552580 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c4f8847a-acdd-4f58-aef1-2c32b1884c2e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:39.563145 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4f8847a-acdd-4f58-aef1-2c32b1884c2e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:39.563734 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4f8847a-acdd-4f58-aef1-2c32b1884c2e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:39.564745 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4f8847a-acdd-4f58-aef1-2c32b1884c2e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:39.565331 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c4f8847a-acdd-4f58-aef1-2c32b1884c2e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:39.709137 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c4f8847a-acdd-4f58-aef1-2c32b1884c2e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:39.719411 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c4f8847a-acdd-4f58-aef1-2c32b1884c2e tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1575 microversion: 2.1 time: 0.173844 Jun 02 19:40:39.720220 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1530/3046] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:39 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:40.738142 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-26e55ad5-575a-411f-bee1-fd59e9bd96e8 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:40:40.738790 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-26e55ad5-575a-411f-bee1-fd59e9bd96e8 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:40:40.746221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26e55ad5-575a-411f-bee1-fd59e9bd96e8 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:40.746678 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26e55ad5-575a-411f-bee1-fd59e9bd96e8 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:40.747435 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26e55ad5-575a-411f-bee1-fd59e9bd96e8 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:40.748023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26e55ad5-575a-411f-bee1-fd59e9bd96e8 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:40.887275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-26e55ad5-575a-411f-bee1-fd59e9bd96e8 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:40:40.897674 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-26e55ad5-575a-411f-bee1-fd59e9bd96e8 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1562 microversion: 2.1 time: 0.164518 Jun 02 19:40:40.898299 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1517/3047] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:40:40 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:40:42.818601 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-e8ff63f0-c0c1-445e-bb67-5e00420036be req-969da0b8-0a18-437d-82a3-fb4573d53a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5018c4-4b2a-4ea0-b313-2d93a1caf897", "name": "network-vif-plugged", "status": "completed", "tag": "59e6acbd-667f-4a21-ba99-aaedcc060a5e"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:40:42.828083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-e8ff63f0-c0c1-445e-bb67-5e00420036be req-969da0b8-0a18-437d-82a3-fb4573d53a5e service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:40:42.828512 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-e8ff63f0-c0c1-445e-bb67-5e00420036be req-969da0b8-0a18-437d-82a3-fb4573d53a5e service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:40:42.840024 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-e8ff63f0-c0c1-445e-bb67-5e00420036be req-969da0b8-0a18-437d-82a3-fb4573d53a5e service nova] Creating event network-vif-plugged:59e6acbd-667f-4a21-ba99-aaedcc060a5e for instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 on hv-cinder-79760 Jun 02 19:40:42.845329 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-e8ff63f0-c0c1-445e-bb67-5e00420036be req-969da0b8-0a18-437d-82a3-fb4573d53a5e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030337 Jun 02 19:40:42.845961 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1531/3048] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:41:11.669026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1705128796", "imageRef": "4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70", "flavorRef": "452"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:41:11.675244 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=27 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:11.675895 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:11.933026 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] validate_networks() for None {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 19:41:12.449554 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 19:41:12.450013 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 19:41:12.450475 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 19:41:12.451031 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 19:41:12.451447 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 19:41:12.461680 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:12.462182 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:12.462976 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:12.463404 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:12.481826 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Getting quotas for project 4f99a86c522e4efb92d2c2a5bb790eb8. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 19:41:12.486720 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Getting quotas for user b29cae7d05754c89885964d3cb6393e1 and project 4f99a86c522e4efb92d2c2a5bb790eb8. Resources: {'cores', 'instances', 'ram'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 19:41:12.498002 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 19:41:12.500408 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b8aa397-dbfb-4c59-ad9c-e75c9cf39b70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 19:41:12.547225 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c9671c43-adc3-4bf2-ba7a-8f8df3fd3db2 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882158 Jun 02 19:41:12.547889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1518/3049] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Jun 2 19:41:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 19:41:12.555973 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=21 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:12.556742 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=63 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:12.561574 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-60e348fc-ac7d-4c4f-b4a5-75e719833676 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:12.562302 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-60e348fc-ac7d-4c4f-b4a5-75e719833676 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:12.733854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-60e348fc-ac7d-4c4f-b4a5-75e719833676 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:12.740981 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-60e348fc-ac7d-4c4f-b4a5-75e719833676 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1215 microversion: 2.1 time: 0.186691 Jun 02 19:41:12.741563 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1532/3050] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:12 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:13.764195 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d3420f6c-349a-46c1-8fc9-334c8bf6e621 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:13.765004 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d3420f6c-349a-46c1-8fc9-334c8bf6e621 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:13.774467 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3420f6c-349a-46c1-8fc9-334c8bf6e621 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:13.775034 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3420f6c-349a-46c1-8fc9-334c8bf6e621 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:13.775846 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3420f6c-349a-46c1-8fc9-334c8bf6e621 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:13.776320 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3420f6c-349a-46c1-8fc9-334c8bf6e621 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:13.890526 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d3420f6c-349a-46c1-8fc9-334c8bf6e621 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:13.897442 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d3420f6c-349a-46c1-8fc9-334c8bf6e621 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1273 microversion: 2.1 time: 0.137679 Jun 02 19:41:13.898041 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1519/3051] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:13 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:14.914792 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4d3b823c-e906-49fe-a4de-20fceef41447 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:14.915397 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4d3b823c-e906-49fe-a4de-20fceef41447 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:14.923644 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d3b823c-e906-49fe-a4de-20fceef41447 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:14.924095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d3b823c-e906-49fe-a4de-20fceef41447 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:14.924889 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d3b823c-e906-49fe-a4de-20fceef41447 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:14.925330 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d3b823c-e906-49fe-a4de-20fceef41447 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:15.192244 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4d3b823c-e906-49fe-a4de-20fceef41447 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:15.205423 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4d3b823c-e906-49fe-a4de-20fceef41447 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1315 microversion: 2.1 time: 0.294227 Jun 02 19:41:15.206632 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1533/3052] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:14 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:15.376418 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-6f709de1-3aae-4621-8c37-12cb938b8513 req-e8023435-b1fe-4b14-98a9-69328e606ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572e23c4-20f8-4675-991a-4498821764a6", "tag": "f4c47b28-da91-4257-b7e2-5f31d5272261"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:41:15.389348 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-6f709de1-3aae-4621-8c37-12cb938b8513 req-e8023435-b1fe-4b14-98a9-69328e606ccc service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:15.389819 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-6f709de1-3aae-4621-8c37-12cb938b8513 req-e8023435-b1fe-4b14-98a9-69328e606ccc service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:15.405502 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-6f709de1-3aae-4621-8c37-12cb938b8513 req-e8023435-b1fe-4b14-98a9-69328e606ccc service nova] Creating event network-changed:f4c47b28-da91-4257-b7e2-5f31d5272261 for instance 572e23c4-20f8-4675-991a-4498821764a6 on hv-cinder-79760 Jun 02 19:41:15.411292 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-6f709de1-3aae-4621-8c37-12cb938b8513 req-e8023435-b1fe-4b14-98a9-69328e606ccc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045290 Jun 02 19:41:15.412076 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1520/3053] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:41:16.226746 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-69b6a1d6-2173-462a-bbf1-587ed2b02f79 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:16.227416 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-69b6a1d6-2173-462a-bbf1-587ed2b02f79 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:16.237747 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69b6a1d6-2173-462a-bbf1-587ed2b02f79 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:16.238453 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69b6a1d6-2173-462a-bbf1-587ed2b02f79 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:16.239590 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69b6a1d6-2173-462a-bbf1-587ed2b02f79 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:16.240188 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69b6a1d6-2173-462a-bbf1-587ed2b02f79 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:16.397207 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-69b6a1d6-2173-462a-bbf1-587ed2b02f79 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:16.410523 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-69b6a1d6-2173-462a-bbf1-587ed2b02f79 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1315 microversion: 2.1 time: 0.189633 Jun 02 19:41:16.411328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1534/3054] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:16 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:17.433221 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f6f10dd7-e82b-427a-bda1-0cc99f5cbd53 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:17.434118 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f6f10dd7-e82b-427a-bda1-0cc99f5cbd53 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:17.441900 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6f10dd7-e82b-427a-bda1-0cc99f5cbd53 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:17.442353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6f10dd7-e82b-427a-bda1-0cc99f5cbd53 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:17.443135 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6f10dd7-e82b-427a-bda1-0cc99f5cbd53 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:17.443568 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f6f10dd7-e82b-427a-bda1-0cc99f5cbd53 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:17.586331 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f6f10dd7-e82b-427a-bda1-0cc99f5cbd53 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:17.594746 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f6f10dd7-e82b-427a-bda1-0cc99f5cbd53 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1315 microversion: 2.1 time: 0.166151 Jun 02 19:41:17.595342 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1521/3055] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:17 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:18.612077 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5b14494c-cd55-4047-a0da-418c344fbdf0 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:18.612875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5b14494c-cd55-4047-a0da-418c344fbdf0 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:18.619602 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b14494c-cd55-4047-a0da-418c344fbdf0 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:18.620080 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b14494c-cd55-4047-a0da-418c344fbdf0 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:18.620924 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b14494c-cd55-4047-a0da-418c344fbdf0 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:18.621308 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5b14494c-cd55-4047-a0da-418c344fbdf0 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:18.761782 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5b14494c-cd55-4047-a0da-418c344fbdf0 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:18.770921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5b14494c-cd55-4047-a0da-418c344fbdf0 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1315 microversion: 2.1 time: 0.162947 Jun 02 19:41:18.771495 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1535/3056] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:18 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:19.788834 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c683f657-91db-47f1-adb3-06da6ae1c138 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:19.789488 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c683f657-91db-47f1-adb3-06da6ae1c138 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:19.796927 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c683f657-91db-47f1-adb3-06da6ae1c138 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:19.797374 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c683f657-91db-47f1-adb3-06da6ae1c138 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:19.798245 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c683f657-91db-47f1-adb3-06da6ae1c138 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:19.798669 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c683f657-91db-47f1-adb3-06da6ae1c138 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:19.939396 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c683f657-91db-47f1-adb3-06da6ae1c138 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:19.947599 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c683f657-91db-47f1-adb3-06da6ae1c138 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1315 microversion: 2.1 time: 0.162831 Jun 02 19:41:19.948183 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1522/3057] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:19 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:20.641438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-d0f37e56-f918-4ade-966e-6acd8dc6ba70 req-a359e465-9213-4e20-880e-92062142c96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572e23c4-20f8-4675-991a-4498821764a6", "name": "network-vif-plugged", "status": "completed", "tag": "f4c47b28-da91-4257-b7e2-5f31d5272261"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:41:20.650951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d0f37e56-f918-4ade-966e-6acd8dc6ba70 req-a359e465-9213-4e20-880e-92062142c96b service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:20.651461 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d0f37e56-f918-4ade-966e-6acd8dc6ba70 req-a359e465-9213-4e20-880e-92062142c96b service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:20.663850 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-d0f37e56-f918-4ade-966e-6acd8dc6ba70 req-a359e465-9213-4e20-880e-92062142c96b service nova] Creating event network-vif-plugged:f4c47b28-da91-4257-b7e2-5f31d5272261 for instance 572e23c4-20f8-4675-991a-4498821764a6 on hv-cinder-79760 Jun 02 19:41:20.668854 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-d0f37e56-f918-4ade-966e-6acd8dc6ba70 req-a359e465-9213-4e20-880e-92062142c96b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105108 Jun 02 19:41:20.669479 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1536/3058] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:41:20.965542 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6c7ab855-5e45-4eb7-98aa-ff0bff719ec1 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:20.966201 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6c7ab855-5e45-4eb7-98aa-ff0bff719ec1 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:20.974590 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c7ab855-5e45-4eb7-98aa-ff0bff719ec1 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:20.975335 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c7ab855-5e45-4eb7-98aa-ff0bff719ec1 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:20.976635 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c7ab855-5e45-4eb7-98aa-ff0bff719ec1 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:20.977353 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c7ab855-5e45-4eb7-98aa-ff0bff719ec1 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:21.118582 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6c7ab855-5e45-4eb7-98aa-ff0bff719ec1 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:21.130242 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6c7ab855-5e45-4eb7-98aa-ff0bff719ec1 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1315 microversion: 2.1 time: 0.168732 Jun 02 19:41:21.131126 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1523/3059] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:20 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:22.152231 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-12ee6346-f2ae-4414-b764-3f2cb6237523 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:22.152909 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-12ee6346-f2ae-4414-b764-3f2cb6237523 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:22.160003 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12ee6346-f2ae-4414-b764-3f2cb6237523 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:22.160464 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12ee6346-f2ae-4414-b764-3f2cb6237523 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:22.161255 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12ee6346-f2ae-4414-b764-3f2cb6237523 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:22.161698 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12ee6346-f2ae-4414-b764-3f2cb6237523 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:22.327387 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-12ee6346-f2ae-4414-b764-3f2cb6237523 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:22.335274 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-12ee6346-f2ae-4414-b764-3f2cb6237523 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1315 microversion: 2.1 time: 0.187767 Jun 02 19:41:22.336061 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1537/3060] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:22 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:23.353007 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f63b7f6e-a356-48d2-b919-747b1f63d3de tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:23.353615 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f63b7f6e-a356-48d2-b919-747b1f63d3de tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:23.356049 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:23.356715 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:23.363847 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f63b7f6e-a356-48d2-b919-747b1f63d3de tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:23.364293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f63b7f6e-a356-48d2-b919-747b1f63d3de tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:23.365068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f63b7f6e-a356-48d2-b919-747b1f63d3de tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:23.365642 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f63b7f6e-a356-48d2-b919-747b1f63d3de tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:23.507343 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f63b7f6e-a356-48d2-b919-747b1f63d3de tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:23.515702 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f63b7f6e-a356-48d2-b919-747b1f63d3de tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1464 microversion: 2.1 time: 0.166744 Jun 02 19:41:23.516275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1524/3061] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:23 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1464 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:23.562920 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3071449b-22ac-431c-b902-1b111a76c442 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:23.563587 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3071449b-22ac-431c-b902-1b111a76c442 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:23.565509 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:23.571463 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3071449b-22ac-431c-b902-1b111a76c442 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:23.571921 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3071449b-22ac-431c-b902-1b111a76c442 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:23.572719 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3071449b-22ac-431c-b902-1b111a76c442 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:23.573140 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3071449b-22ac-431c-b902-1b111a76c442 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:23.601570 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3071449b-22ac-431c-b902-1b111a76c442 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:41:23.691807 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3071449b-22ac-431c-b902-1b111a76c442 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "DELETE /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 204 len: 0 microversion: 2.1 time: 0.132650 Jun 02 19:41:23.692401 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1538/3062] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:41:23 2022] DELETE /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:41:23.701726 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-79017c54-de3f-4f58-9e6e-9b906040a8d3 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:23.702364 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-79017c54-de3f-4f58-9e6e-9b906040a8d3 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:23.708703 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79017c54-de3f-4f58-9e6e-9b906040a8d3 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:23.709155 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79017c54-de3f-4f58-9e6e-9b906040a8d3 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:23.709945 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79017c54-de3f-4f58-9e6e-9b906040a8d3 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:23.710382 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79017c54-de3f-4f58-9e6e-9b906040a8d3 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:23.854539 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-79017c54-de3f-4f58-9e6e-9b906040a8d3 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:23.863989 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-79017c54-de3f-4f58-9e6e-9b906040a8d3 tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1470 microversion: 2.1 time: 0.165986 Jun 02 19:41:23.864645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1525/3063] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:23 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:24.882168 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e5564b8e-6be4-4b09-92a7-0f3b9350964d tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:24.882875 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e5564b8e-6be4-4b09-92a7-0f3b9350964d tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:24.889767 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5564b8e-6be4-4b09-92a7-0f3b9350964d tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:24.890252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5564b8e-6be4-4b09-92a7-0f3b9350964d tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:24.891033 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5564b8e-6be4-4b09-92a7-0f3b9350964d tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:24.891475 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5564b8e-6be4-4b09-92a7-0f3b9350964d tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:25.108998 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e5564b8e-6be4-4b09-92a7-0f3b9350964d tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29cae7d05754c89885964d3cb6393e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f99a86c522e4efb92d2c2a5bb790eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:25.116951 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e5564b8e-6be4-4b09-92a7-0f3b9350964d tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 200 len: 1470 microversion: 2.1 time: 0.239112 Jun 02 19:41:25.117531 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1539/3064] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:24 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:25.536374 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:41:25.537755 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:41:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:41:25.608835 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-312b73e8-6d0e-4bd7-b491-3cc15b4d23bc req-7d3e0cc9-abb8-4ab4-a6e4-285a2dd6be93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572e23c4-20f8-4675-991a-4498821764a6", "name": "network-vif-deleted", "tag": "f4c47b28-da91-4257-b7e2-5f31d5272261"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:41:25.619530 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-312b73e8-6d0e-4bd7-b491-3cc15b4d23bc req-7d3e0cc9-abb8-4ab4-a6e4-285a2dd6be93 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:25.620068 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-312b73e8-6d0e-4bd7-b491-3cc15b4d23bc req-7d3e0cc9-abb8-4ab4-a6e4-285a2dd6be93 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:25.633936 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-312b73e8-6d0e-4bd7-b491-3cc15b4d23bc req-7d3e0cc9-abb8-4ab4-a6e4-285a2dd6be93 service nova] Creating event network-vif-deleted:f4c47b28-da91-4257-b7e2-5f31d5272261 for instance 572e23c4-20f8-4675-991a-4498821764a6 on hv-cinder-79760 Jun 02 19:41:25.640275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-312b73e8-6d0e-4bd7-b491-3cc15b4d23bc req-7d3e0cc9-abb8-4ab4-a6e4-285a2dd6be93 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133860 Jun 02 19:41:25.641522 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1526/3065] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:41:26.136893 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:26.137657 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] [instance: 572e23c4-20f8-4675-991a-4498821764a6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:26.144659 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:26.145113 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:26.145897 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:26.146328 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:26.160143 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] HTTP exception thrown: Instance 572e23c4-20f8-4675-991a-4498821764a6 could not be found. Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Request method failure captured: Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 HTTP/1.1 Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept: application/json Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Connection: close Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Host: 10.222.0.15 Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.9 Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABimRJWykg5KC_vdVP0KYRydLYyVh4CK-1kdl1J2z6xum2i7CipcDRNkleE5xcqIpoR5c8F3R9NUqvkpgsAHMvp9nSh33l35_Acc8sz_aiAuOV1X8oaY4Vrdst6sX45pNlY-sqidhwFFdCgF_-zqXeFxgaoSxGcPfGENu1xT0f4HiNBpKU Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Id: 4f99a86c522e4efb92d2c2a5bb790eb8 Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesNegativeTest-1145148952 Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jun 02 19:41:26.161819 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4f99a86c522e4efb92d2c2a5bb790eb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4f99a86c522e4efb92d2c2a5bb790eb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4f99a86c522e4efb92d2c2a5bb790eb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4f99a86c522e4efb92d2c2a5bb790eb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesNegativeTest-1145148952 Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 4f99a86c522e4efb92d2c2a5bb790eb8 Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesNegativeTest-1145148952 Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesNegativeTest-1145148952-project Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Id: b29cae7d05754c89885964d3cb6393e1 Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesNegativeTest-1145148952-project Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: method: > Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: exception: Instance 572e23c4-20f8-4675-991a-4498821764a6 could not be found. Jun 02 19:41:26.163643 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: action_args: {'id': '572e23c4-20f8-4675-991a-4498821764a6'} Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572e23c4-20f8-4675-991a-4498821764a6 could not be found. Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:41:26.164700 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572e23c4-20f8-4675-991a-4498821764a6 could not be found. Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572e23c4-20f8-4675-991a-4498821764a6 could not be found. Jun 02 19:41:26.166491 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jun 02 19:41:26.168036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] Returning 404 to user: Instance 572e23c4-20f8-4675-991a-4498821764a6 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:41:26.168036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a76355bf-e742-4299-b3b4-bed53b20277f tempest-VolumesNegativeTest-1145148952 tempest-VolumesNegativeTest-1145148952-project] 10.222.0.15 "GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6" status: 404 len: 111 microversion: 2.1 time: 0.030464 Jun 02 19:41:26.168036 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1540/3066] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:26 2022] GET /compute/v2.1/servers/572e23c4-20f8-4675-991a-4498821764a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:41:57.437992 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1bb31e08-39ae-44ac-92e9-05dbca5fd5c7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:57.438645 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1bb31e08-39ae-44ac-92e9-05dbca5fd5c7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:57.440362 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:57.441095 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:57.443853 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:57.444531 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=42 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:57.448886 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bb31e08-39ae-44ac-92e9-05dbca5fd5c7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:57.450023 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bb31e08-39ae-44ac-92e9-05dbca5fd5c7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:57.450917 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bb31e08-39ae-44ac-92e9-05dbca5fd5c7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:57.451394 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1bb31e08-39ae-44ac-92e9-05dbca5fd5c7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:57.480574 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1bb31e08-39ae-44ac-92e9-05dbca5fd5c7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 19:41:57.583620 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1bb31e08-39ae-44ac-92e9-05dbca5fd5c7 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 204 len: 0 microversion: 2.1 time: 0.149713 Jun 02 19:41:57.584371 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1527/3067] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Jun 2 19:41:57 2022] DELETE /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 19:41:57.584488 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-d4d6345e-3f8c-4193-92fa-ccb2c6447098 req-0d6e89e1-d234-4ccf-82c0-817774b9bf0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5018c4-4b2a-4ea0-b313-2d93a1caf897", "tag": "59e6acbd-667f-4a21-ba99-aaedcc060a5e"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:41:57.592877 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b7bc5e42-c4ca-4b60-a0e7-d6d80b73e3af tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:57.593557 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b7bc5e42-c4ca-4b60-a0e7-d6d80b73e3af tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:57.594139 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d4d6345e-3f8c-4193-92fa-ccb2c6447098 req-0d6e89e1-d234-4ccf-82c0-817774b9bf0d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:57.594640 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d4d6345e-3f8c-4193-92fa-ccb2c6447098 req-0d6e89e1-d234-4ccf-82c0-817774b9bf0d service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:57.599508 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b7bc5e42-c4ca-4b60-a0e7-d6d80b73e3af tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:57.599948 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b7bc5e42-c4ca-4b60-a0e7-d6d80b73e3af tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:57.600696 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b7bc5e42-c4ca-4b60-a0e7-d6d80b73e3af tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:57.601120 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b7bc5e42-c4ca-4b60-a0e7-d6d80b73e3af tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:57.608436 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-d4d6345e-3f8c-4193-92fa-ccb2c6447098 req-0d6e89e1-d234-4ccf-82c0-817774b9bf0d service nova] Creating event network-changed:59e6acbd-667f-4a21-ba99-aaedcc060a5e for instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 on hv-cinder-79760 Jun 02 19:41:57.613862 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-d4d6345e-3f8c-4193-92fa-ccb2c6447098 req-0d6e89e1-d234-4ccf-82c0-817774b9bf0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178096 Jun 02 19:41:57.614541 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1541/3068] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 19:41:57.741293 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b7bc5e42-c4ca-4b60-a0e7-d6d80b73e3af tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:57.749316 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b7bc5e42-c4ca-4b60-a0e7-d6d80b73e3af tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.160794 Jun 02 19:41:57.750001 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1528/3069] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:57 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 19:41:58.768584 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-44ea541a-6380-4b2e-8b07-fa2b3ba71bd0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:41:58.769252 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-44ea541a-6380-4b2e-8b07-fa2b3ba71bd0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:41:58.775771 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44ea541a-6380-4b2e-8b07-fa2b3ba71bd0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:58.776224 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44ea541a-6380-4b2e-8b07-fa2b3ba71bd0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:58.777053 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44ea541a-6380-4b2e-8b07-fa2b3ba71bd0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:58.777438 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44ea541a-6380-4b2e-8b07-fa2b3ba71bd0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:58.979082 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-44ea541a-6380-4b2e-8b07-fa2b3ba71bd0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:41:58.986554 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-44ea541a-6380-4b2e-8b07-fa2b3ba71bd0 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1568 microversion: 2.1 time: 0.222800 Jun 02 19:41:58.987314 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1542/3070] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:58 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:41:59.782662 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-550442be-c8e7-4528-bc33-d3ef335ce826 req-d44888a7-81c3-4b51-9e5d-4e474ff41561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5018c4-4b2a-4ea0-b313-2d93a1caf897", "name": "network-vif-deleted", "tag": "59e6acbd-667f-4a21-ba99-aaedcc060a5e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 19:41:59.792889 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-550442be-c8e7-4528-bc33-d3ef335ce826 req-d44888a7-81c3-4b51-9e5d-4e474ff41561 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:41:59.793614 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-550442be-c8e7-4528-bc33-d3ef335ce826 req-d44888a7-81c3-4b51-9e5d-4e474ff41561 service nova] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:41:59.806378 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-550442be-c8e7-4528-bc33-d3ef335ce826 req-d44888a7-81c3-4b51-9e5d-4e474ff41561 service nova] Creating event network-vif-deleted:59e6acbd-667f-4a21-ba99-aaedcc060a5e for instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 on hv-cinder-79760 Jun 02 19:41:59.811882 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-550442be-c8e7-4528-bc33-d3ef335ce826 req-d44888a7-81c3-4b51-9e5d-4e474ff41561 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034661 Jun 02 19:41:59.816103 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1529/3071] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Jun 2 19:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 19:42:00.006099 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6c26d720-4451-413f-a3e7-57194e6856f9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:42:00.006650 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6c26d720-4451-413f-a3e7-57194e6856f9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:42:00.014661 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c26d720-4451-413f-a3e7-57194e6856f9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:42:00.015218 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c26d720-4451-413f-a3e7-57194e6856f9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:42:00.016083 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c26d720-4451-413f-a3e7-57194e6856f9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:42:00.016532 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c26d720-4451-413f-a3e7-57194e6856f9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:42:00.103678 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c26d720-4451-413f-a3e7-57194e6856f9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f92f1059a8b481aa5d44ebac5a7819d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d83706590a34c76b0315e6a5e0ee931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 19:42:00.112685 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6c26d720-4451-413f-a3e7-57194e6856f9 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 200 len: 1382 microversion: 2.1 time: 0.111435 Jun 02 19:42:00.122971 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1543/3072] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:41:59 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 1382 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 19:42:01.135661 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:42:01.136400 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] [instance: 8e5018c4-4b2a-4ea0-b313-2d93a1caf897] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 19:42:01.146213 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:42:01.146912 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:42:01.148133 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 19:42:01.148780 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Lock "04738c04-a365-48d6-9e43-2e295188c73a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 19:42:01.165843 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] HTTP exception thrown: Instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 could not be found. Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Request method failure captured: Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 HTTP/1.1 Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept: application/json Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Connection: close Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Host: 10.222.0.15 Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.9 Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABimRGESPre9xhF5dokQjGkZ905FSfDuHXFPZ5-ObEFJI-e6Zqe4pvnhgqeDasMZm29qLC3i-WVsxf8FaR901mMahZ21kgASzs6w-FdYJGxTeDKgAv_OBNAh-njWu3EbVAW_7S5LPE9Jt7Ni1lhwDKlpklI2VCRlQAOGYqujOH3ahiVTww Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Id: 7d83706590a34c76b0315e6a5e0ee931 Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-TestShelveInstance-1893398925 Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jun 02 19:42:01.167479 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7d83706590a34c76b0315e6a5e0ee931"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d83706590a34c76b0315e6a5e0ee931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d83706590a34c76b0315e6a5e0ee931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7d83706590a34c76b0315e6a5e0ee931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-TestShelveInstance-1893398925 Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 7d83706590a34c76b0315e6a5e0ee931 Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-TestShelveInstance-1893398925 Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User: tempest-TestShelveInstance-1893398925-project Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Id: 5f92f1059a8b481aa5d44ebac5a7819d Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-TestShelveInstance-1893398925-project Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: method: > Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: exception: Instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 could not be found. Jun 02 19:42:01.168947 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: action_args: {'id': '8e5018c4-4b2a-4ea0-b313-2d93a1caf897'} Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 could not be found. Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 19:42:01.169655 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 could not be found. Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 could not be found. Jun 02 19:42:01.171275 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jun 02 19:42:01.172338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Returning 404 to user: Instance 8e5018c4-4b2a-4ea0-b313-2d93a1caf897 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 19:42:01.172338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8f24bf14-3354-48c3-8663-6e05412e8f7a tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897" status: 404 len: 111 microversion: 2.1 time: 0.040869 Jun 02 19:42:01.172338 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1530/3073] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Jun 2 19:42:01 2022] GET /compute/v2.1/servers/8e5018c4-4b2a-4ea0-b313-2d93a1caf897 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 19:42:01.352066 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1087df0b-46de-4b0b-a0bb-43aa87620ef1 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] Calling method '.version_select at 0x7f5b7e045a60>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 19:42:01.373090 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1087df0b-46de-4b0b-a0bb-43aa87620ef1 tempest-TestShelveInstance-1893398925 tempest-TestShelveInstance-1893398925-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-832014537" status: 202 len: 0 microversion: 2.1 time: 0.024442 Jun 02 19:42:01.373688 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1544/3074] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Jun 2 19:42:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-832014537 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 19:43:10.005559 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:43:10.006212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:43:31.027153 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:43:31.027797 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:43:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:44:45.554957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:44:45.554957 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:44:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:44:55.330153 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:44:55.331064 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:45:10.945452 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:45:10.946625 dv-cinder-797608-28-iscsi devstack@n-api.service[117776]: Thu Jun 2 19:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:46:30.015687 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:46:30.016312 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:46:51.036212 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:46:51.036761 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:46:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 19:47:00.885419 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 19:47:00.886484 dv-cinder-797608-28-iscsi devstack@n-api.service[117777]: Thu Jun 2 19:47:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!